SHARE
TWEET

lagom cpu hogged with cluster

leozilla Oct 21st, 2019 83 in 81 days
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
  1. $ docker logs -f $(docker ps | grep "bin/cart" | awk '{ print $1 }')
  2. 15:28:55,633 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
  3. 15:28:55,633 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy]
  4. 15:28:55,633 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [jar:file:/opt/docker/lib/global.bright.cart-1.0.1.jar!/logback.xml]
  5. 15:28:55,645 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@4bf48f6 - URL [jar:file:/opt/docker/lib/global.bright.cart-1.0.1.jar!/logback.xml] is not of type file
  6. 15:28:55,825 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
  7. 15:28:55,826 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
  8. 15:28:55,832 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
  9. 15:28:55,839 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
  10. 15:28:55,964 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.FileAppender]
  11. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.datastax.driver] to DEBUG
  12. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [akka] to DEBUG
  13. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [eventworld.cart.impl.CartService] to DEBUG
  14. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
  15. 15:28:55,969 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
  16. 15:28:55,969 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
  17. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
  18. 15:28:55,972 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@62833051 - Registering current configuration as safe fallback point
  19.  
  20. 15:28:55,633 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
  21. 15:28:55,633 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy]
  22. 15:28:55,633 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [jar:file:/opt/docker/lib/global.bright.cart-1.0.1.jar!/logback.xml]
  23. 15:28:55,645 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@4bf48f6 - URL [jar:file:/opt/docker/lib/global.bright.cart-1.0.1.jar!/logback.xml] is not of type file
  24. 15:28:55,825 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
  25. 15:28:55,826 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
  26. 15:28:55,832 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
  27. 15:28:55,839 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
  28. 15:28:55,964 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.FileAppender]
  29. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.datastax.driver] to DEBUG
  30. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [akka] to DEBUG
  31. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [eventworld.cart.impl.CartService] to DEBUG
  32. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
  33. 15:28:55,969 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
  34. 15:28:55,969 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
  35. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
  36. 15:28:55,972 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@62833051 - Registering current configuration as safe fallback point
  37. 15:28:56,834 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@24b6b8f6 - URL [jar:file:/opt/docker/lib/global.bright.cart-1.0.1.jar!/logback.xml] is not of type file
  38. 15:28:56,836 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
  39. 15:28:56,836 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
  40. 15:28:56,836 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
  41. 15:28:56,836 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
  42. 15:28:56,836 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.FileAppender]
  43. 15:28:56,837 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.datastax.driver] to DEBUG
  44. 15:28:56,837 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [akka] to DEBUG
  45. 15:28:56,837 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [eventworld.cart.impl.CartService] to DEBUG
  46. 15:28:56,837 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
  47. 15:28:56,837 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
  48. 15:28:56,837 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
  49. 15:28:56,837 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
  50. 15:28:56,837 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@72cf2de5 - Registering current configuration as safe fallback point
  51.  
  52. 2019-10-21 15:28:58,087 INFO  akka.event.slf4j.Slf4jLogger - Slf4jLogger started
  53. 2019-10-21 15:28:58,131 DEBUG akka.event.EventStream - logger log1-Slf4jLogger started
  54. 2019-10-21 15:28:58,133 DEBUG akka.event.EventStream - Default Loggers started
  55. 2019-10-21 15:28:58,155 INFO  akka.remote.Remoting - Starting remoting
  56. 2019-10-21 15:28:58,647 INFO  akka.remote.Remoting - Remoting started; listening on addresses :[akka.tcp://application@172.17.0.4:2552]
  57. 2019-10-21 15:28:58,650 INFO  akka.remote.Remoting - Remoting now listens on addresses: [akka.tcp://application@172.17.0.4:2552]
  58. 2019-10-21 15:28:58,738 INFO  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Starting up, Akka version [2.5.25] ...
  59. 2019-10-21 15:28:58,999 INFO  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Registered cluster JMX MBean [akka:type=Cluster]
  60. 2019-10-21 15:28:58,999 INFO  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Started up successfully
  61. 2019-10-21 15:28:59,135 INFO  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/cluster-usage.html#joining-to-seed-nodes
  62. 2019-10-21 15:29:00,041 INFO  akka.management.cluster.bootstrap.ClusterBootstrap - Bootstrap using `akka.discovery` method: kubernetes-api
  63. 2019-10-21 15:29:01,450 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Settings Settings(/var/run/secrets/kubernetes.io/serviceaccount/ca.crt, /var/run/secrets/kubernetes.io/serviceaccount/token, KUBERNETES_SERVICE_HOST, KUBERNETES_SERVICE_PORT, /var/run/secrets/kubernetes.io/serviceaccount/namespace, None, cluster.local)
  64. 2019-10-21 15:29:01,549 INFO  akka.management.internal.HealthChecksImpl - Loading readiness checks List(NamedHealthCheck(cluster-membership,akka.management.cluster.scaladsl.ClusterMembershipCheck))
  65. 2019-10-21 15:29:01,551 INFO  akka.management.internal.HealthChecksImpl - Loading liveness checks List()
  66. 2019-10-21 15:29:01,664 INFO  akka.management.scaladsl.AkkaManagement - Binding Akka Management (HTTP) endpoint to: 172.17.0.4:8558
  67. 2019-10-21 15:29:01,937 INFO  akka.management.scaladsl.AkkaManagement - Including HTTP management routes for ClusterHttpManagementRouteProvider
  68. 2019-10-21 15:29:02,042 INFO  akka.management.scaladsl.AkkaManagement - Including HTTP management routes for ClusterBootstrap
  69. 2019-10-21 15:29:02,046 INFO  akka.management.cluster.bootstrap.ClusterBootstrap - Using self contact point address: http://172.17.0.4:8558
  70. 2019-10-21 15:29:02,060 INFO  akka.management.scaladsl.AkkaManagement - Including HTTP management routes for HealthCheckRoutes
  71. 2019-10-21 15:29:02,526 DEBUG akka.io.TcpListener - Successfully bound to /172.17.0.4:8558
  72. 2019-10-21 15:29:02,549 INFO  akka.management.scaladsl.AkkaManagement - Bound Akka Management (HTTP) endpoint to: 172.17.0.4:8558
  73. 2019-10-21 15:29:02,648 INFO  akka.management.cluster.bootstrap.ClusterBootstrap - Initiating bootstrap procedure using kubernetes-api method...
  74. 2019-10-21 15:29:02,666 DEBUG akka.actor.TimerScheduler - Start timer [resolve-key] with generation [1]
  75. 2019-10-21 15:29:02,668 DEBUG akka.actor.TimerScheduler - Start timer [decide-key] with generation [2]
  76. 2019-10-21 15:29:02,668 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Locating service members. Using discovery [akka.discovery.kubernetes.KubernetesApiServiceDiscovery], join decider [akka.management.cluster.bootstrap.LowestAddressJoinDecider]
  77. 2019-10-21 15:29:02,668 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Looking up [Lookup(cart,None,Some(tcp))]
  78. 2019-10-21 15:29:02,671 INFO  akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Querying for pods with label selector: [app=cart]. Namespace: [default]. Port: [None]
  79. 2019-10-21 15:29:02,741 DEBUG akka.http.impl.engine.client.PoolGateway - (Re-)starting host connection pool to 10.96.0.1:443
  80. 2019-10-21 15:29:03,530 DEBUG akka.http.impl.engine.client.PoolGateway - InputBuffer (max-open-requests = 32) now filled with 1 request after enqueuing GET /api/v1/namespaces/default/pods Empty
  81. 2019-10-21 15:29:03,554 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Unconnected)] Dispatching request [GET /api/v1/namespaces/default/pods Empty]
  82. 2019-10-21 15:29:03,626 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Unconnected)] Before event [onNewRequest] In state [Unconnected] for [132 ms]
  83. 2019-10-21 15:29:03,630 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Unconnected)] Establishing connection
  84. 2019-10-21 15:29:03,762 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Looking up [Lookup(cart,None,Some(tcp))]
  85. 2019-10-21 15:29:03,762 INFO  akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Querying for pods with label selector: [app=cart]. Namespace: [default]. Port: [None]
  86. 2019-10-21 15:29:03,777 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] After event [onNewRequest] State change [Unconnected] -> [Connecting]
  87. 2019-10-21 15:29:03,832 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (Unconnected)] Dispatching request [GET /api/v1/namespaces/default/pods Empty]
  88. 2019-10-21 15:29:03,833 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (Unconnected)] Before event [onNewRequest] In state [Unconnected] for [401 ms]
  89. 2019-10-21 15:29:03,833 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (Unconnected)] Establishing connection
  90. 2019-10-21 15:29:03,835 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (Connecting)] After event [onNewRequest] State change [Unconnected] -> [Connecting]
  91. 2019-10-21 15:29:03,863 DEBUG akka.io.TcpOutgoingConnection - Resolving 10.96.0.1 before connecting
  92. 2019-10-21 15:29:03,928 DEBUG akka.io.TcpOutgoingConnection - Resolving 10.96.0.1 before connecting
  93. 2019-10-21 15:29:04,226 DEBUG akka.io.SimpleDnsManager - Resolution request for 10.96.0.1 from Actor[akka://application/system/IO-TCP/selectors/$a/2#399152651]
  94. 2019-10-21 15:29:04,434 DEBUG akka.io.SimpleDnsManager - Resolution request for 10.96.0.1 from Actor[akka://application/system/IO-TCP/selectors/$a/1#-1041973935]
  95. 2019-10-21 15:29:04,439 DEBUG akka.io.TcpOutgoingConnection - Attempting connection to [/10.96.0.1:443]
  96. 2019-10-21 15:29:04,440 DEBUG akka.io.TcpOutgoingConnection - Connection established to [10.96.0.1:443]
  97. 2019-10-21 15:29:04,445 DEBUG akka.io.TcpOutgoingConnection - Attempting connection to [/10.96.0.1:443]
  98. 2019-10-21 15:29:04,526 DEBUG akka.io.TcpOutgoingConnection - Connection established to [10.96.0.1:443]
  99. 2019-10-21 15:29:04,526 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (Connecting)] Connection attempt succeeded
  100. 2019-10-21 15:29:04,527 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (Connecting)] Before event [onConnectionAttemptSucceeded] In state [Connecting] for [616 ms]
  101. 2019-10-21 15:29:04,528 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (Connecting)] Slot connection was established
  102. 2019-10-21 15:29:04,528 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (PushingRequestToConnection)] After event [onConnectionAttemptSucceeded] State change [Connecting] -> [PushingRequestToConnection]
  103. 2019-10-21 15:29:04,528 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  104. 2019-10-21 15:29:04,528 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  105. 2019-10-21 15:29:04,633 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] Connection attempt succeeded
  106. 2019-10-21 15:29:04,633 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] Before event [onConnectionAttemptSucceeded] In state [Connecting] for [855 ms]
  107. 2019-10-21 15:29:04,633 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] Slot connection was established
  108. 2019-10-21 15:29:04,633 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onConnectionAttemptSucceeded] State change [Connecting] -> [PushingRequestToConnection]
  109. 2019-10-21 15:29:04,633 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  110. 2019-10-21 15:29:04,638 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  111. 2019-10-21 15:29:05,736 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  112. 2019-10-21 15:29:05,743 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [1110 ms]
  113. 2019-10-21 15:29:05,743 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  114. 2019-10-21 15:29:05,744 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  115. 2019-10-21 15:29:05,744 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  116. 2019-10-21 15:29:05,745 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  117. 2019-10-21 15:29:05,747 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForResponse)] Received response
  118. 2019-10-21 15:29:05,748 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [1294 ms]
  119. 2019-10-21 15:29:05,748 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  120. 2019-10-21 15:29:05,748 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  121. 2019-10-21 15:29:05,748 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  122. 2019-10-21 15:29:05,748 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  123. 2019-10-21 15:29:05,754 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [5 ms]
  124. 2019-10-21 15:29:05,755 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  125. 2019-10-21 15:29:05,755 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [10 ms]
  126. 2019-10-21 15:29:05,825 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  127. 2019-10-21 15:29:05,826 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [1 ms]
  128. 2019-10-21 15:29:05,830 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  129. 2019-10-21 15:29:05,834 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (Idle)] Slot became idle... Trying to pull
  130. 2019-10-21 15:29:05,835 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [2 ms]
  131. 2019-10-21 15:29:05,836 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  132. 2019-10-21 15:29:05,837 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  133. 2019-10-21 15:29:05,837 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Kubernetes API entity: [{"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces/default/pods","resourceVersion":"42502"},"items":[{"metadata":{"name":"cart-5cc9dc46ff-vd4kx","generateName":"cart-5cc9dc46ff-","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/cart-5cc9dc46ff-vd4kx","uid":"80fda555-a4fb-477f-8813-f7c11b95d0b0","resourceVersion":"42487","creationTimestamp":"2019-10-21T15:28:52Z","labels":{"app":"cart","app.kubernetes.io/chartVersion":"0.1.0","app.kubernetes.io/imageTag":"97dd28b69615d2452a3ef11c1a4192d11523cb20","app.kubernetes.io/instance":"cart","app.kubernetes.io/managed-by":"Tiller","app.kubernetes.io/name":"cart","app.kubernetes.io/part-of":"backend","app.kubernetes.io/version":"97dd28b69615d2452a3ef11c1a4192d11523cb20","helm.sh/chart":"cart-0.1.0","pod-template-hash":"5cc9dc46ff"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"cart-5cc9dc46ff","uid":"ddc4d2f9-5f71-4f7d-99bf-83b39f929f76","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-s9gwc","secret":{"secretName":"default-token-s9gwc","defaultMode":420}}],"containers":[{"name":"cart","image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","ports":[{"name":"http","containerPort":9000,"protocol":"TCP"},{"name":"management","containerPort":8558,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"common-service-config"}},{"configMapRef":{"name":"cart-config"}}],"env":[{"name":"CLUSTER_BOOTSTRAP_SERVICE_NAME","value":"cart"},{"name":"CLUSTER_BOOTSTRAP_CONTACT_POINT_NR","value":"1"},{"name":"JAVA_OPTS","value":"-Xms256m -Xmx256m -Dconfig.resource=prod-application.conf"},{"name":"PLAY_HTTP_SECRET_KEY","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"http.play.secretKey"}}},{"name":"DB_USER","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.user"}}},{"name":"DB_PASS","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.password"}}}],"resources":{"limits":{"cpu":"500m"},"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"default-token-s9gwc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/alive","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"readinessProbe":{"httpGet":{"path":"/ready","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Never"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"minikube","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"}],"hostIP":"10.0.2.15","podIP":"172.17.0.4","startTime":"2019-10-21T15:28:52Z","containerStatuses":[{"name":"cart","state":{"running":{"startedAt":"2019-10-21T15:28:53Z"}},"lastState":{},"ready":false,"restartCount":0,"image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","imageID":"docker://sha256:738a509b000132c58685974f4474e1e63fb31ea980d1f7acfcbc02c4cb0c4db4","containerID":"docker://405c46b2f8d8e9ae28d82d321dabaf4e269f9badc854eca14690a2f4b0c90e18"}],"qosClass":"Burstable"}}]}
  134. ]
  135. 2019-10-21 15:29:05,838 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Kubernetes API entity: [{"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces/default/pods","resourceVersion":"42502"},"items":[{"metadata":{"name":"cart-5cc9dc46ff-vd4kx","generateName":"cart-5cc9dc46ff-","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/cart-5cc9dc46ff-vd4kx","uid":"80fda555-a4fb-477f-8813-f7c11b95d0b0","resourceVersion":"42487","creationTimestamp":"2019-10-21T15:28:52Z","labels":{"app":"cart","app.kubernetes.io/chartVersion":"0.1.0","app.kubernetes.io/imageTag":"97dd28b69615d2452a3ef11c1a4192d11523cb20","app.kubernetes.io/instance":"cart","app.kubernetes.io/managed-by":"Tiller","app.kubernetes.io/name":"cart","app.kubernetes.io/part-of":"backend","app.kubernetes.io/version":"97dd28b69615d2452a3ef11c1a4192d11523cb20","helm.sh/chart":"cart-0.1.0","pod-template-hash":"5cc9dc46ff"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"cart-5cc9dc46ff","uid":"ddc4d2f9-5f71-4f7d-99bf-83b39f929f76","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-s9gwc","secret":{"secretName":"default-token-s9gwc","defaultMode":420}}],"containers":[{"name":"cart","image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","ports":[{"name":"http","containerPort":9000,"protocol":"TCP"},{"name":"management","containerPort":8558,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"common-service-config"}},{"configMapRef":{"name":"cart-config"}}],"env":[{"name":"CLUSTER_BOOTSTRAP_SERVICE_NAME","value":"cart"},{"name":"CLUSTER_BOOTSTRAP_CONTACT_POINT_NR","value":"1"},{"name":"JAVA_OPTS","value":"-Xms256m -Xmx256m -Dconfig.resource=prod-application.conf"},{"name":"PLAY_HTTP_SECRET_KEY","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"http.play.secretKey"}}},{"name":"DB_USER","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.user"}}},{"name":"DB_PASS","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.password"}}}],"resources":{"limits":{"cpu":"500m"},"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"default-token-s9gwc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/alive","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"readinessProbe":{"httpGet":{"path":"/ready","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Never"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"minikube","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"}],"hostIP":"10.0.2.15","podIP":"172.17.0.4","startTime":"2019-10-21T15:28:52Z","containerStatuses":[{"name":"cart","state":{"running":{"startedAt":"2019-10-21T15:28:53Z"}},"lastState":{},"ready":false,"restartCount":0,"image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","imageID":"docker://sha256:738a509b000132c58685974f4474e1e63fb31ea980d1f7acfcbc02c4cb0c4db4","containerID":"docker://405c46b2f8d8e9ae28d82d321dabaf4e269f9badc854eca14690a2f4b0c90e18"}],"qosClass":"Burstable"}}]}
  136. ]
  137. 2019-10-21 15:29:06,502 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Located service members based on: [Lookup(cart,None,Some(tcp))]: [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))], filtered to [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))]
  138. 2019-10-21 15:29:06,570 DEBUG akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Ensuring probing actor: contactPointProbe-172-17-0-4.default.pod.cluster.local-8558
  139. 2019-10-21 15:29:06,624 DEBUG akka.actor.TimerScheduler - Start timer [resolve-key] with generation [3]
  140. 2019-10-21 15:29:06,625 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Located service members based on: [Lookup(cart,None,Some(tcp))]: [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))], filtered to [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))]
  141. 2019-10-21 15:29:06,625 DEBUG akka.management.cluster.bootstrap.internal.HttpContactPointBootstrap - Probing [http://172-17-0-4.default.pod.cluster.local:8558/bootstrap/seed-nodes] for seed nodes...
  142. 2019-10-21 15:29:06,626 DEBUG akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Ensuring probing actor: contactPointProbe-172-17-0-4.default.pod.cluster.local-8558
  143. 2019-10-21 15:29:06,627 DEBUG akka.actor.TimerScheduler - Cancel timer [resolve-key] with generation [3]
  144. 2019-10-21 15:29:06,629 DEBUG akka.actor.TimerScheduler - Start timer [resolve-key] with generation [4]
  145. 2019-10-21 15:29:06,634 DEBUG akka.http.impl.engine.client.PoolGateway - (Re-)starting host connection pool to 172-17-0-4.default.pod.cluster.local:8558
  146. 2019-10-21 15:29:06,641 DEBUG akka.http.impl.engine.client.PoolGateway - InputBuffer (max-open-requests = 32) now filled with 1 request after enqueuing GET /bootstrap/seed-nodes Empty
  147. 2019-10-21 15:29:06,642 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Unconnected)] Dispatching request [GET /bootstrap/seed-nodes Empty]
  148. 2019-10-21 15:29:06,642 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Unconnected)] Before event [onNewRequest] In state [Unconnected] for [1 ms]
  149. 2019-10-21 15:29:06,642 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Unconnected)] Establishing connection
  150. 2019-10-21 15:29:06,643 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] After event [onNewRequest] State change [Unconnected] -> [Connecting]
  151. 2019-10-21 15:29:06,646 DEBUG akka.io.TcpOutgoingConnection - Resolving 172-17-0-4.default.pod.cluster.local before connecting
  152. 2019-10-21 15:29:06,646 DEBUG akka.io.SimpleDnsManager - Resolution request for 172-17-0-4.default.pod.cluster.local from Actor[akka://application/system/IO-TCP/selectors/$a/3#-1094176514]
  153. 2019-10-21 15:29:06,801 INFO  akka.management.cluster.bootstrap.LowestAddressJoinDecider - Discovered [1] contact points, confirmed [0], which is less than the required [1], retrying
  154. 2019-10-21 15:29:06,891 DEBUG akka.io.TcpOutgoingConnection - Attempting connection to [172-17-0-4.default.pod.cluster.local/172.17.0.4:8558]
  155. 2019-10-21 15:29:06,893 DEBUG akka.io.TcpOutgoingConnection - Connection established to [172-17-0-4.default.pod.cluster.local:8558]
  156. 2019-10-21 15:29:06,895 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] Connection attempt succeeded
  157. 2019-10-21 15:29:06,895 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] Before event [onConnectionAttemptSucceeded] In state [Connecting] for [251 ms]
  158. 2019-10-21 15:29:06,895 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] Slot connection was established
  159. 2019-10-21 15:29:06,895 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onConnectionAttemptSucceeded] State change [Connecting] -> [PushingRequestToConnection]
  160. 2019-10-21 15:29:06,895 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  161. 2019-10-21 15:29:06,895 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  162. 2019-10-21 15:29:06,903 DEBUG akka.io.TcpListener - New connection accepted
  163. 2019-10-21 15:29:07,251 DEBUG akka.serialization.Serialization(akka://application) - Using serializer [akka.cluster.ddata.protobuf.ReplicatorMessageSerializer] for message [akka.cluster.ddata.Replicator$Internal$DataEnvelope]
  164. 2019-10-21 15:29:07,256 DEBUG akka.cluster.sharding.ShardRegion - CartProcessor: Request shard [eventworld.cart.impl.evt$CartEvent] home. Coordinator [None]
  165. 2019-10-21 15:29:07,413 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Singleton not available, buffering message type [com.lightbend.lagom.internal.persistence.cluster.ClusterStartupTaskActor$Execute$]
  166. 2019-10-21 15:29:07,659 INFO  akka.management.cluster.bootstrap.contactpoint.HttpClusterBootstrapRoutes - Bootstrap request from 172.17.0.4:44046: Contact Point returning 0 seed-nodes ([TreeSet()])
  167. 2019-10-21 15:29:07,683 INFO  akka.management.cluster.bootstrap.LowestAddressJoinDecider - Discovered [1] contact points, confirmed [0], which is less than the required [1], retrying
  168. 2019-10-21 15:29:07,828 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  169. 2019-10-21 15:29:07,834 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [934 ms]
  170. 2019-10-21 15:29:07,834 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  171. 2019-10-21 15:29:07,834 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  172. 2019-10-21 15:29:07,835 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  173. 2019-10-21 15:29:07,835 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  174. 2019-10-21 15:29:07,835 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [0 ms]
  175. 2019-10-21 15:29:07,836 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  176. 2019-10-21 15:29:07,836 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  177. 2019-10-21 15:29:07,836 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  178. 2019-10-21 15:29:07,836 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  179. 2019-10-21 15:29:07,837 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Looking up [Lookup(cart,None,Some(tcp))]
  180. 2019-10-21 15:29:07,837 INFO  akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Querying for pods with label selector: [app=cart]. Namespace: [default]. Port: [None]
  181. 2019-10-21 15:29:07,842 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /api/v1/namespaces/default/pods Empty]
  182. 2019-10-21 15:29:07,842 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [2084 ms]
  183. 2019-10-21 15:29:07,842 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  184. 2019-10-21 15:29:07,843 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  185. 2019-10-21 15:29:07,843 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  186. 2019-10-21 15:29:07,847 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Contact point [akka.tcp://application@172.17.0.4:2552] returned [0] seed-nodes []
  187. 2019-10-21 15:29:07,849 DEBUG akka.actor.TimerScheduler - Start timer [probing-key] with generation [1]
  188. 2019-10-21 15:29:07,851 DEBUG akka.discovery.dns.DnsServiceDiscovery - system resolver is not async-dns. Loading isolated resolver
  189. 2019-10-21 15:29:07,853 INFO  akka.actor.ActorSystemImpl - Creating async dns resolver async-dns with manager name SD-DNS
  190. 2019-10-21 15:29:07,953 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  191. 2019-10-21 15:29:07,954 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [111 ms]
  192. 2019-10-21 15:29:07,954 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  193. 2019-10-21 15:29:07,954 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  194. 2019-10-21 15:29:07,954 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  195. 2019-10-21 15:29:07,955 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  196. 2019-10-21 15:29:07,956 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [1 ms]
  197. 2019-10-21 15:29:07,956 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  198. 2019-10-21 15:29:07,957 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  199. 2019-10-21 15:29:07,957 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  200. 2019-10-21 15:29:07,957 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  201. 2019-10-21 15:29:07,957 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Kubernetes API entity: [{"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces/default/pods","resourceVersion":"42506"},"items":[{"metadata":{"name":"cart-5cc9dc46ff-vd4kx","generateName":"cart-5cc9dc46ff-","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/cart-5cc9dc46ff-vd4kx","uid":"80fda555-a4fb-477f-8813-f7c11b95d0b0","resourceVersion":"42487","creationTimestamp":"2019-10-21T15:28:52Z","labels":{"app":"cart","app.kubernetes.io/chartVersion":"0.1.0","app.kubernetes.io/imageTag":"97dd28b69615d2452a3ef11c1a4192d11523cb20","app.kubernetes.io/instance":"cart","app.kubernetes.io/managed-by":"Tiller","app.kubernetes.io/name":"cart","app.kubernetes.io/part-of":"backend","app.kubernetes.io/version":"97dd28b69615d2452a3ef11c1a4192d11523cb20","helm.sh/chart":"cart-0.1.0","pod-template-hash":"5cc9dc46ff"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"cart-5cc9dc46ff","uid":"ddc4d2f9-5f71-4f7d-99bf-83b39f929f76","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-s9gwc","secret":{"secretName":"default-token-s9gwc","defaultMode":420}}],"containers":[{"name":"cart","image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","ports":[{"name":"http","containerPort":9000,"protocol":"TCP"},{"name":"management","containerPort":8558,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"common-service-config"}},{"configMapRef":{"name":"cart-config"}}],"env":[{"name":"CLUSTER_BOOTSTRAP_SERVICE_NAME","value":"cart"},{"name":"CLUSTER_BOOTSTRAP_CONTACT_POINT_NR","value":"1"},{"name":"JAVA_OPTS","value":"-Xms256m -Xmx256m -Dconfig.resource=prod-application.conf"},{"name":"PLAY_HTTP_SECRET_KEY","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"http.play.secretKey"}}},{"name":"DB_USER","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.user"}}},{"name":"DB_PASS","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.password"}}}],"resources":{"limits":{"cpu":"500m"},"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"default-token-s9gwc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/alive","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"readinessProbe":{"httpGet":{"path":"/ready","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Never"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"minikube","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"}],"hostIP":"10.0.2.15","podIP":"172.17.0.4","startTime":"2019-10-21T15:28:52Z","containerStatuses":[{"name":"cart","state":{"running":{"startedAt":"2019-10-21T15:28:53Z"}},"lastState":{},"ready":false,"restartCount":0,"image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","imageID":"docker://sha256:738a509b000132c58685974f4474e1e63fb31ea980d1f7acfcbc02c4cb0c4db4","containerID":"docker://405c46b2f8d8e9ae28d82d321dabaf4e269f9badc854eca14690a2f4b0c90e18"}],"qosClass":"Burstable"}}]}
  202. ]
  203. 2019-10-21 15:29:07,958 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Located service members based on: [Lookup(cart,None,Some(tcp))]: [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))], filtered to [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))]
  204. 2019-10-21 15:29:07,958 DEBUG akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Ensuring probing actor: contactPointProbe-172-17-0-4.default.pod.cluster.local-8558
  205. 2019-10-21 15:29:07,958 DEBUG akka.actor.TimerScheduler - Start timer [resolve-key] with generation [5]
  206. 2019-10-21 15:29:08,030 DEBUG akka.io.dns.internal.AsyncDnsResolver - Using name servers [List(/10.96.0.10:53)] and search domains [List(default.svc.cluster.local, svc.cluster.local, cluster.local)] with ndots=5
  207. 2019-10-21 15:29:08,081 DEBUG akka.actor.TimerScheduler - Start timer [CacheCleanup] with generation [1]
  208. 2019-10-21 15:29:08,211 DEBUG akka.io.UdpListener - Successfully bound to [/0.0.0.0:37169]
  209. 2019-10-21 15:29:08,219 DEBUG akka.io.dns.internal.DnsClient - Bound to UDP address [/0.0.0.0:37169]
  210. 2019-10-21 15:29:08,684 DEBUG akka.management.cluster.bootstrap.LowestAddressJoinDecider - Contact points observations have changed more recently than the stable-margin [5000 milliseconds], changed at [2019-10-21T15:29:06.501], not joining myself. This process will be retried.
  211. 2019-10-21 15:29:09,023 DEBUG akka.management.cluster.bootstrap.internal.HttpContactPointBootstrap - Probing [http://172-17-0-4.default.pod.cluster.local:8558/bootstrap/seed-nodes] for seed nodes...
  212. 2019-10-21 15:29:09,055 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /bootstrap/seed-nodes Empty]
  213. 2019-10-21 15:29:09,055 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1224 ms]
  214. 2019-10-21 15:29:09,056 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  215. 2019-10-21 15:29:09,056 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  216. 2019-10-21 15:29:09,056 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  217. 2019-10-21 15:29:09,163 INFO  akka.management.cluster.bootstrap.contactpoint.HttpClusterBootstrapRoutes - Bootstrap request from 172.17.0.4:44046: Contact Point returning 0 seed-nodes ([TreeSet()])
  218. 2019-10-21 15:29:09,171 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  219. 2019-10-21 15:29:09,172 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [116 ms]
  220. 2019-10-21 15:29:09,172 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  221. 2019-10-21 15:29:09,172 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  222. 2019-10-21 15:29:09,172 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  223. 2019-10-21 15:29:09,172 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  224. 2019-10-21 15:29:09,173 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [0 ms]
  225. 2019-10-21 15:29:09,173 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  226. 2019-10-21 15:29:09,173 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  227. 2019-10-21 15:29:09,173 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  228. 2019-10-21 15:29:09,173 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  229. 2019-10-21 15:29:09,174 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Looking up [Lookup(cart,None,Some(tcp))]
  230. 2019-10-21 15:29:09,174 INFO  akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Querying for pods with label selector: [app=cart]. Namespace: [default]. Port: [None]
  231. 2019-10-21 15:29:09,175 DEBUG akka.actor.TimerScheduler - Start timer [probing-key] with generation [2]
  232. 2019-10-21 15:29:09,175 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Contact point [akka.tcp://application@172.17.0.4:2552] returned [0] seed-nodes []
  233. 2019-10-21 15:29:09,182 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /api/v1/namespaces/default/pods Empty]
  234. 2019-10-21 15:29:09,183 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1224 ms]
  235. 2019-10-21 15:29:09,183 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  236. 2019-10-21 15:29:09,183 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  237. 2019-10-21 15:29:09,183 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  238. 2019-10-21 15:29:09,309 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  239. 2019-10-21 15:29:09,309 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [127 ms]
  240. 2019-10-21 15:29:09,309 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  241. 2019-10-21 15:29:09,309 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  242. 2019-10-21 15:29:09,313 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  243. 2019-10-21 15:29:09,313 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  244. 2019-10-21 15:29:09,320 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [11 ms]
  245. 2019-10-21 15:29:09,320 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  246. 2019-10-21 15:29:09,321 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  247. 2019-10-21 15:29:09,321 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  248. 2019-10-21 15:29:09,322 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  249. 2019-10-21 15:29:09,322 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Kubernetes API entity: [{"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces/default/pods","resourceVersion":"42508"},"items":[{"metadata":{"name":"cart-5cc9dc46ff-vd4kx","generateName":"cart-5cc9dc46ff-","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/cart-5cc9dc46ff-vd4kx","uid":"80fda555-a4fb-477f-8813-f7c11b95d0b0","resourceVersion":"42487","creationTimestamp":"2019-10-21T15:28:52Z","labels":{"app":"cart","app.kubernetes.io/chartVersion":"0.1.0","app.kubernetes.io/imageTag":"97dd28b69615d2452a3ef11c1a4192d11523cb20","app.kubernetes.io/instance":"cart","app.kubernetes.io/managed-by":"Tiller","app.kubernetes.io/name":"cart","app.kubernetes.io/part-of":"backend","app.kubernetes.io/version":"97dd28b69615d2452a3ef11c1a4192d11523cb20","helm.sh/chart":"cart-0.1.0","pod-template-hash":"5cc9dc46ff"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"cart-5cc9dc46ff","uid":"ddc4d2f9-5f71-4f7d-99bf-83b39f929f76","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-s9gwc","secret":{"secretName":"default-token-s9gwc","defaultMode":420}}],"containers":[{"name":"cart","image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","ports":[{"name":"http","containerPort":9000,"protocol":"TCP"},{"name":"management","containerPort":8558,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"common-service-config"}},{"configMapRef":{"name":"cart-config"}}],"env":[{"name":"CLUSTER_BOOTSTRAP_SERVICE_NAME","value":"cart"},{"name":"CLUSTER_BOOTSTRAP_CONTACT_POINT_NR","value":"1"},{"name":"JAVA_OPTS","value":"-Xms256m -Xmx256m -Dconfig.resource=prod-application.conf"},{"name":"PLAY_HTTP_SECRET_KEY","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"http.play.secretKey"}}},{"name":"DB_USER","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.user"}}},{"name":"DB_PASS","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.password"}}}],"resources":{"limits":{"cpu":"500m"},"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"default-token-s9gwc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/alive","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"readinessProbe":{"httpGet":{"path":"/ready","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Never"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"minikube","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"}],"hostIP":"10.0.2.15","podIP":"172.17.0.4","startTime":"2019-10-21T15:28:52Z","containerStatuses":[{"name":"cart","state":{"running":{"startedAt":"2019-10-21T15:28:53Z"}},"lastState":{},"ready":false,"restartCount":0,"image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","imageID":"docker://sha256:738a509b000132c58685974f4474e1e63fb31ea980d1f7acfcbc02c4cb0c4db4","containerID":"docker://405c46b2f8d8e9ae28d82d321dabaf4e269f9badc854eca14690a2f4b0c90e18"}],"qosClass":"Burstable"}}]}
  250. ]
  251. 2019-10-21 15:29:09,323 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Located service members based on: [Lookup(cart,None,Some(tcp))]: [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))], filtered to [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))]
  252. 2019-10-21 15:29:09,323 DEBUG akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Ensuring probing actor: contactPointProbe-172-17-0-4.default.pod.cluster.local-8558
  253. 2019-10-21 15:29:09,323 DEBUG akka.actor.TimerScheduler - Start timer [resolve-key] with generation [6]
  254. 2019-10-21 15:29:09,657 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart: Request shard [singleton] home. Coordinator [None]
  255. 2019-10-21 15:29:09,660 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_reservation: Request shard [singleton] home. Coordinator [None]
  256. 2019-10-21 15:29:09,662 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_price_offer: Request shard [singleton] home. Coordinator [None]
  257. 2019-10-21 15:29:09,683 DEBUG akka.management.cluster.bootstrap.LowestAddressJoinDecider - Contact points observations have changed more recently than the stable-margin [5000 milliseconds], changed at [2019-10-21T15:29:06.501], not joining myself. This process will be retried.
  258. 2019-10-21 15:29:10,030 DEBUG akka.kafka.internal.KafkaConsumerActor - Creating Kafka consumer with akka.kafka.ConsumerSettings(properties=auto.offset.reset -> earliest,group.id -> cart,bootstrap.servers -> kafka:9092,enable.auto.commit -> false,client.id -> cart-2,keyDeserializer=Some(org.apache.kafka.common.serialization.StringDeserializer@7ee2f76f),valueDeserializer=Some(com.lightbend.lagom.internal.scaladsl.broker.kafka.ScaladslKafkaDeserializer@702516c3),pollInterval=1 second,pollTimeout=50 milliseconds,stopTimeout=30 seconds,closeTimeout=20 seconds,commitTimeout=15 seconds,commitRefreshInterval=Duration.Inf,dispatcher=akka.kafka.default-dispatcher,commitTimeWarning=1 second,waitClosePartition=500 milliseconds,metadataRequestTimeout=5 seconds)
  259. 2019-10-21 15:29:10,031 DEBUG akka.kafka.internal.KafkaConsumerActor - Creating Kafka consumer with akka.kafka.ConsumerSettings(properties=auto.offset.reset -> earliest,group.id -> cart,bootstrap.servers -> kafka:9092,enable.auto.commit -> false,client.id -> cart-3,keyDeserializer=Some(org.apache.kafka.common.serialization.StringDeserializer@25a17c5b),valueDeserializer=Some(com.lightbend.lagom.internal.scaladsl.broker.kafka.ScaladslKafkaDeserializer@2b66969f),pollInterval=1 second,pollTimeout=50 milliseconds,stopTimeout=30 seconds,closeTimeout=20 seconds,commitTimeout=15 seconds,commitRefreshInterval=Duration.Inf,dispatcher=akka.kafka.default-dispatcher,commitTimeWarning=1 second,waitClosePartition=500 milliseconds,metadataRequestTimeout=5 seconds)
  260. 2019-10-21 15:29:10,033 DEBUG akka.kafka.internal.KafkaConsumerActor - Creating Kafka consumer with akka.kafka.ConsumerSettings(properties=auto.offset.reset -> earliest,group.id -> cart,bootstrap.servers -> kafka:9092,enable.auto.commit -> false,client.id -> cart-1,keyDeserializer=Some(org.apache.kafka.common.serialization.StringDeserializer@11171e5),valueDeserializer=Some(com.lightbend.lagom.internal.scaladsl.broker.kafka.ScaladslKafkaDeserializer@2acddaaf),pollInterval=1 second,pollTimeout=50 milliseconds,stopTimeout=30 seconds,closeTimeout=20 seconds,commitTimeout=15 seconds,commitRefreshInterval=Duration.Inf,dispatcher=akka.kafka.default-dispatcher,commitTimeWarning=1 second,waitClosePartition=500 milliseconds,metadataRequestTimeout=5 seconds)
  261. 2019-10-21 15:29:10,204 DEBUG akka.management.cluster.bootstrap.internal.HttpContactPointBootstrap - Probing [http://172-17-0-4.default.pod.cluster.local:8558/bootstrap/seed-nodes] for seed nodes...
  262. 2019-10-21 15:29:10,206 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /bootstrap/seed-nodes Empty]
  263. 2019-10-21 15:29:10,206 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1031 ms]
  264. 2019-10-21 15:29:10,206 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  265. 2019-10-21 15:29:10,206 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  266. 2019-10-21 15:29:10,206 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  267. 2019-10-21 15:29:10,225 INFO  akka.management.cluster.bootstrap.contactpoint.HttpClusterBootstrapRoutes - Bootstrap request from 172.17.0.4:44046: Contact Point returning 0 seed-nodes ([TreeSet()])
  268. 2019-10-21 15:29:10,228 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  269. 2019-10-21 15:29:10,228 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [21 ms]
  270. 2019-10-21 15:29:10,228 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  271. 2019-10-21 15:29:10,228 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  272. 2019-10-21 15:29:10,228 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  273. 2019-10-21 15:29:10,236 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  274. 2019-10-21 15:29:10,236 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [0 ms]
  275. 2019-10-21 15:29:10,236 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  276. 2019-10-21 15:29:10,236 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  277. 2019-10-21 15:29:10,236 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  278. 2019-10-21 15:29:10,237 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  279. 2019-10-21 15:29:10,237 DEBUG akka.actor.TimerScheduler - Start timer [probing-key] with generation [3]
  280. 2019-10-21 15:29:10,237 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Contact point [akka.tcp://application@172.17.0.4:2552] returned [0] seed-nodes []
  281. 2019-10-21 15:29:10,486 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Looking up [Lookup(cart,None,Some(tcp))]
  282. 2019-10-21 15:29:10,486 INFO  akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Querying for pods with label selector: [app=cart]. Namespace: [default]. Port: [None]
  283. 2019-10-21 15:29:10,487 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /api/v1/namespaces/default/pods Empty]
  284. 2019-10-21 15:29:10,487 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1166 ms]
  285. 2019-10-21 15:29:10,488 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  286. 2019-10-21 15:29:10,488 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  287. 2019-10-21 15:29:10,496 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  288. 2019-10-21 15:29:10,683 DEBUG akka.management.cluster.bootstrap.LowestAddressJoinDecider - Contact points observations have changed more recently than the stable-margin [5000 milliseconds], changed at [2019-10-21T15:29:06.501], not joining myself. This process will be retried.
  289. 2019-10-21 15:29:10,739 DEBUG akka.io.TcpListener - Successfully bound to /0.0.0.0:9000
  290. 2019-10-21 15:29:10,761 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  291. 2019-10-21 15:29:10,763 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [273 ms]
  292. 2019-10-21 15:29:10,764 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  293. 2019-10-21 15:29:10,766 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  294. 2019-10-21 15:29:10,766 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [1 ms]
  295. 2019-10-21 15:29:10,787 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  296. 2019-10-21 15:29:10,788 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [4 ms]
  297. 2019-10-21 15:29:10,789 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  298. 2019-10-21 15:29:10,790 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Kubernetes API entity: [{"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces/default/pods","resourceVersion":"42508"},"items":[{"metadata":{"name":"cart-5cc9dc46ff-vd4kx","generateName":"cart-5cc9dc46ff-","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/cart-5cc9dc46ff-vd4kx","uid":"80fda555-a4fb-477f-8813-f7c11b95d0b0","resourceVersion":"42487","creationTimestamp":"2019-10-21T15:28:52Z","labels":{"app":"cart","app.kubernetes.io/chartVersion":"0.1.0","app.kubernetes.io/imageTag":"97dd28b69615d2452a3ef11c1a4192d11523cb20","app.kubernetes.io/instance":"cart","app.kubernetes.io/managed-by":"Tiller","app.kubernetes.io/name":"cart","app.kubernetes.io/part-of":"backend","app.kubernetes.io/version":"97dd28b69615d2452a3ef11c1a4192d11523cb20","helm.sh/chart":"cart-0.1.0","pod-template-hash":"5cc9dc46ff"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"cart-5cc9dc46ff","uid":"ddc4d2f9-5f71-4f7d-99bf-83b39f929f76","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-s9gwc","secret":{"secretName":"default-token-s9gwc","defaultMode":420}}],"containers":[{"name":"cart","image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","ports":[{"name":"http","containerPort":9000,"protocol":"TCP"},{"name":"management","containerPort":8558,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"common-service-config"}},{"configMapRef":{"name":"cart-config"}}],"env":[{"name":"CLUSTER_BOOTSTRAP_SERVICE_NAME","value":"cart"},{"name":"CLUSTER_BOOTSTRAP_CONTACT_POINT_NR","value":"1"},{"name":"JAVA_OPTS","value":"-Xms256m -Xmx256m -Dconfig.resource=prod-application.conf"},{"name":"PLAY_HTTP_SECRET_KEY","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"http.play.secretKey"}}},{"name":"DB_USER","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.user"}}},{"name":"DB_PASS","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.password"}}}],"resources":{"limits":{"cpu":"500m"},"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"default-token-s9gwc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/alive","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"readinessProbe":{"httpGet":{"path":"/ready","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Never"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"minikube","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"}],"hostIP":"10.0.2.15","podIP":"172.17.0.4","startTime":"2019-10-21T15:28:52Z","containerStatuses":[{"name":"cart","state":{"running":{"startedAt":"2019-10-21T15:28:53Z"}},"lastState":{},"ready":false,"restartCount":0,"image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","imageID":"docker://sha256:738a509b000132c58685974f4474e1e63fb31ea980d1f7acfcbc02c4cb0c4db4","containerID":"docker://405c46b2f8d8e9ae28d82d321dabaf4e269f9badc854eca14690a2f4b0c90e18"}],"qosClass":"Burstable"}}]}
  299. ]
  300. 2019-10-21 15:29:10,793 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [3 ms]
  301. 2019-10-21 15:29:10,803 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  302. 2019-10-21 15:29:10,803 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Located service members based on: [Lookup(cart,None,Some(tcp))]: [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))], filtered to [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))]
  303. 2019-10-21 15:29:10,808 DEBUG akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Ensuring probing actor: contactPointProbe-172-17-0-4.default.pod.cluster.local-8558
  304. 2019-10-21 15:29:10,808 DEBUG akka.actor.TimerScheduler - Start timer [resolve-key] with generation [7]
  305. 2019-10-21 15:29:10,808 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  306. 2019-10-21 15:29:11,304 DEBUG akka.management.cluster.bootstrap.internal.HttpContactPointBootstrap - Probing [http://172-17-0-4.default.pod.cluster.local:8558/bootstrap/seed-nodes] for seed nodes...
  307. 2019-10-21 15:29:11,310 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /bootstrap/seed-nodes Empty]
  308. 2019-10-21 15:29:11,310 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1078 ms]
  309. 2019-10-21 15:29:11,310 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  310. 2019-10-21 15:29:11,310 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  311. 2019-10-21 15:29:11,310 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  312. 2019-10-21 15:29:11,348 INFO  akka.management.cluster.bootstrap.contactpoint.HttpClusterBootstrapRoutes - Bootstrap request from 172.17.0.4:44046: Contact Point returning 0 seed-nodes ([TreeSet()])
  313. 2019-10-21 15:29:11,358 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  314. 2019-10-21 15:29:11,358 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [44 ms]
  315. 2019-10-21 15:29:11,359 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  316. 2019-10-21 15:29:11,359 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  317. 2019-10-21 15:29:11,359 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  318. 2019-10-21 15:29:11,361 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  319. 2019-10-21 15:29:11,363 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [0 ms]
  320. 2019-10-21 15:29:11,363 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  321. 2019-10-21 15:29:11,364 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  322. 2019-10-21 15:29:11,364 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  323. 2019-10-21 15:29:11,364 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  324. 2019-10-21 15:29:11,365 DEBUG akka.actor.TimerScheduler - Start timer [probing-key] with generation [4]
  325. 2019-10-21 15:29:11,365 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Contact point [akka.tcp://application@172.17.0.4:2552] returned [0] seed-nodes []
  326. 2019-10-21 15:29:11,491 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [1]
  327. 2019-10-21 15:29:11,498 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [1]
  328. 2019-10-21 15:29:11,500 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [1]
  329. 2019-10-21 15:29:12,033 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Looking up [Lookup(cart,None,Some(tcp))]
  330. 2019-10-21 15:29:12,034 INFO  akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Querying for pods with label selector: [app=cart]. Namespace: [default]. Port: [None]
  331. 2019-10-21 15:29:12,036 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /api/v1/namespaces/default/pods Empty]
  332. 2019-10-21 15:29:12,036 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1263 ms]
  333. 2019-10-21 15:29:12,036 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  334. 2019-10-21 15:29:12,036 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  335. 2019-10-21 15:29:12,036 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  336. 2019-10-21 15:29:12,045 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Initiating new cluster, self-joining [akka.tcp://application@172.17.0.4:2552]. Other nodes are expected to locate this cluster via continued contact-point probing.
  337. 2019-10-21 15:29:12,118 DEBUG akka.actor.TimerScheduler - Cancel all timers
  338. 2019-10-21 15:29:12,120 DEBUG akka.actor.TimerScheduler - Cancel all timers
  339. 2019-10-21 15:29:12,122 INFO  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Node [akka.tcp://application@172.17.0.4:2552] is JOINING itself (with roles [dc-default]) and forming new cluster
  340. 2019-10-21 15:29:12,127 INFO  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - is the new leader among reachable nodes (more leaders may exist)
  341. 2019-10-21 15:29:12,266 INFO  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Leader is moving node [akka.tcp://application@172.17.0.4:2552] to [Up]
  342. 2019-10-21 15:29:12,269 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Creating singleton identification timer...
  343. 2019-10-21 15:29:12,271 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_reservation: Coordinator moved from [] to [akka.tcp://application@172.17.0.4:2552]
  344. 2019-10-21 15:29:12,272 DEBUG akka.cluster.sharding.ShardRegion - CartProcessor: Coordinator moved from [] to [akka.tcp://application@172.17.0.4:2552]
  345. 2019-10-21 15:29:12,276 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Trying to identify singleton at [akka.tcp://application@172.17.0.4:2552/user/jdbcCreateTables-singleton/singleton]
  346. 2019-10-21 15:29:12,277 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Creating singleton identification timer...
  347. 2019-10-21 15:29:12,279 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_price_offer: Coordinator moved from [] to [akka.tcp://application@172.17.0.4:2552]
  348. 2019-10-21 15:29:12,281 DEBUG akka.cluster.sharding.ShardRegion - CartAggregate: Coordinator moved from [] to [akka.tcp://application@172.17.0.4:2552]
  349. 2019-10-21 15:29:12,282 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Creating singleton identification timer...
  350. 2019-10-21 15:29:12,283 DEBUG akka.cluster.sharding.ShardRegion - MappingAggregate: Coordinator moved from [] to [akka.tcp://application@172.17.0.4:2552]
  351. 2019-10-21 15:29:12,285 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart: Coordinator moved from [] to [akka.tcp://application@172.17.0.4:2552]
  352. 2019-10-21 15:29:12,285 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Trying to identify singleton at [akka.tcp://application@172.17.0.4:2552/user/slickOffsetStorePrepare-singleton/singleton]
  353. 2019-10-21 15:29:12,285 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Trying to identify singleton at [akka.tcp://application@172.17.0.4:2552/user/readSideGlobalPrepare-CartProcessor-singleton/singleton]
  354. 2019-10-21 15:29:12,344 INFO  akka.cluster.singleton.ClusterSingletonManager - Singleton manager starting singleton actor [akka://application/user/slickOffsetStorePrepare-singleton/singleton]
  355. 2019-10-21 15:29:12,370 INFO  akka.cluster.singleton.ClusterSingletonManager - Singleton manager starting singleton actor [akka://application/system/sharding/kafkaProducer-cartCoordinator/singleton]
  356. 2019-10-21 15:29:12,391 INFO  akka.cluster.singleton.ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest]
  357. 2019-10-21 15:29:12,392 INFO  akka.cluster.singleton.ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest]
  358. 2019-10-21 15:29:12,398 INFO  akka.cluster.singleton.ClusterSingletonManager - Singleton manager starting singleton actor [akka://application/user/jdbcCreateTables-singleton/singleton]
  359. 2019-10-21 15:29:12,398 INFO  akka.cluster.singleton.ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest]
  360. 2019-10-21 15:29:12,399 INFO  akka.cluster.singleton.ClusterSingletonManager - Singleton manager starting singleton actor [akka://application/system/sharding/CartProcessorCoordinator/singleton]
  361. 2019-10-21 15:29:12,400 INFO  akka.cluster.singleton.ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest]
  362. 2019-10-21 15:29:12,400 INFO  akka.cluster.singleton.ClusterSingletonManager - Singleton manager starting singleton actor [akka://application/system/sharding/kafkaProducer-cart_price_offerCoordinator/singleton]
  363. 2019-10-21 15:29:12,400 INFO  akka.cluster.singleton.ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest]
  364. 2019-10-21 15:29:12,402 INFO  akka.cluster.singleton.ClusterSingletonManager - Singleton manager starting singleton actor [akka://application/system/sharding/MappingAggregateCoordinator/singleton]
  365. 2019-10-21 15:29:12,403 INFO  akka.cluster.singleton.ClusterSingletonManager - Singleton manager starting singleton actor [akka://application/user/readSideGlobalPrepare-CartProcessor-singleton/singleton]
  366. 2019-10-21 15:29:12,403 INFO  akka.cluster.singleton.ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest]
  367. 2019-10-21 15:29:12,403 INFO  akka.cluster.singleton.ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest]
  368. 2019-10-21 15:29:12,405 INFO  akka.cluster.singleton.ClusterSingletonManager - Singleton manager starting singleton actor [akka://application/system/sharding/CartAggregateCoordinator/singleton]
  369. 2019-10-21 15:29:12,405 INFO  akka.cluster.singleton.ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest]
  370. 2019-10-21 15:29:12,405 INFO  akka.cluster.singleton.ClusterSingletonManager - Singleton manager starting singleton actor [akka://application/system/sharding/kafkaProducer-cart_reservationCoordinator/singleton]
  371. 2019-10-21 15:29:12,406 INFO  akka.cluster.singleton.ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest]
  372. 2019-10-21 15:29:12,527 DEBUG akka.cluster.ddata.Replicator - Received Get for key [MappingAggregateCoordinatorState]
  373. 2019-10-21 15:29:12,544 DEBUG akka.cluster.ddata.Replicator - Received Get for key [kafkaProducer-cart_price_offerCoordinatorState]
  374. 2019-10-21 15:29:12,545 DEBUG akka.cluster.ddata.Replicator - Received Get for key [CartProcessorCoordinatorState]
  375. 2019-10-21 15:29:12,545 DEBUG akka.cluster.ddata.Replicator - Received Get for key [CartAggregateCoordinatorState]
  376. 2019-10-21 15:29:12,545 DEBUG akka.cluster.ddata.Replicator - Received Get for key [kafkaProducer-cartCoordinatorState]
  377. 2019-10-21 15:29:12,549 INFO  akka.cluster.sharding.DDataShardCoordinator - ShardCoordinator was moved to the active state State(Map())
  378. 2019-10-21 15:29:12,552 INFO  akka.cluster.sharding.DDataShardCoordinator - ShardCoordinator was moved to the active state State(Map())
  379. 2019-10-21 15:29:12,552 INFO  akka.cluster.sharding.DDataShardCoordinator - ShardCoordinator was moved to the active state State(Map())
  380. 2019-10-21 15:29:12,552 DEBUG akka.cluster.ddata.Replicator - Received Get for key [kafkaProducer-cart_reservationCoordinatorState]
  381. 2019-10-21 15:29:12,552 INFO  akka.cluster.sharding.DDataShardCoordinator - ShardCoordinator was moved to the active state State(Map())
  382. 2019-10-21 15:29:12,552 INFO  akka.cluster.sharding.DDataShardCoordinator - ShardCoordinator was moved to the active state State(Map())
  383. 2019-10-21 15:29:12,552 INFO  akka.cluster.sharding.DDataShardCoordinator - ShardCoordinator was moved to the active state State(Map())
  384. 2019-10-21 15:29:12,560 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Singleton not available, buffering message type [com.lightbend.lagom.internal.persistence.cluster.ClusterStartupTaskActor$Execute$]
  385. 2019-10-21 15:29:13,069 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  386. 2019-10-21 15:29:13,071 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [1033 ms]
  387. 2019-10-21 15:29:13,072 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  388. 2019-10-21 15:29:13,072 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  389. 2019-10-21 15:29:13,072 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  390. 2019-10-21 15:29:13,073 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  391. 2019-10-21 15:29:13,073 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [0 ms]
  392. 2019-10-21 15:29:13,073 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  393. 2019-10-21 15:29:13,073 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  394. 2019-10-21 15:29:13,073 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  395. 2019-10-21 15:29:13,073 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  396. 2019-10-21 15:29:13,073 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Kubernetes API entity: [{"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces/default/pods","resourceVersion":"42510"},"items":[{"metadata":{"name":"cart-5cc9dc46ff-vd4kx","generateName":"cart-5cc9dc46ff-","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/cart-5cc9dc46ff-vd4kx","uid":"80fda555-a4fb-477f-8813-f7c11b95d0b0","resourceVersion":"42487","creationTimestamp":"2019-10-21T15:28:52Z","labels":{"app":"cart","app.kubernetes.io/chartVersion":"0.1.0","app.kubernetes.io/imageTag":"97dd28b69615d2452a3ef11c1a4192d11523cb20","app.kubernetes.io/instance":"cart","app.kubernetes.io/managed-by":"Tiller","app.kubernetes.io/name":"cart","app.kubernetes.io/part-of":"backend","app.kubernetes.io/version":"97dd28b69615d2452a3ef11c1a4192d11523cb20","helm.sh/chart":"cart-0.1.0","pod-template-hash":"5cc9dc46ff"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"cart-5cc9dc46ff","uid":"ddc4d2f9-5f71-4f7d-99bf-83b39f929f76","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-s9gwc","secret":{"secretName":"default-token-s9gwc","defaultMode":420}}],"containers":[{"name":"cart","image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","ports":[{"name":"http","containerPort":9000,"protocol":"TCP"},{"name":"management","containerPort":8558,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"common-service-config"}},{"configMapRef":{"name":"cart-config"}}],"env":[{"name":"CLUSTER_BOOTSTRAP_SERVICE_NAME","value":"cart"},{"name":"CLUSTER_BOOTSTRAP_CONTACT_POINT_NR","value":"1"},{"name":"JAVA_OPTS","value":"-Xms256m -Xmx256m -Dconfig.resource=prod-application.conf"},{"name":"PLAY_HTTP_SECRET_KEY","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"http.play.secretKey"}}},{"name":"DB_USER","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.user"}}},{"name":"DB_PASS","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.password"}}}],"resources":{"limits":{"cpu":"500m"},"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"default-token-s9gwc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/alive","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"readinessProbe":{"httpGet":{"path":"/ready","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Never"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"minikube","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"}],"hostIP":"10.0.2.15","podIP":"172.17.0.4","startTime":"2019-10-21T15:28:52Z","containerStatuses":[{"name":"cart","state":{"running":{"startedAt":"2019-10-21T15:28:53Z"}},"lastState":{},"ready":false,"restartCount":0,"image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","imageID":"docker://sha256:738a509b000132c58685974f4474e1e63fb31ea980d1f7acfcbc02c4cb0c4db4","containerID":"docker://405c46b2f8d8e9ae28d82d321dabaf4e269f9badc854eca14690a2f4b0c90e18"}],"qosClass":"Burstable"}}]}
  397. ]
  398. 2019-10-21 15:29:13,183 DEBUG akka.cluster.sharding.DDataShardCoordinator - ShardRegion registered: [Actor[akka://application/system/sharding/CartProcessor#1718379659]]
  399. 2019-10-21 15:29:13,226 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  400. 2019-10-21 15:29:13,277 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Trying to identify singleton at [akka.tcp://application@172.17.0.4:2552/user/jdbcCreateTables-singleton/singleton]
  401. 2019-10-21 15:29:13,278 INFO  akka.cluster.singleton.ClusterSingletonProxy - Singleton identified at [akka://application/user/jdbcCreateTables-singleton/singleton]
  402. 2019-10-21 15:29:13,279 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Sending buffered messages to current singleton instance
  403. 2019-10-21 15:29:13,283 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Trying to identify singleton at [akka.tcp://application@172.17.0.4:2552/user/readSideGlobalPrepare-CartProcessor-singleton/singleton]
  404. 2019-10-21 15:29:13,297 INFO  akka.cluster.singleton.ClusterSingletonProxy - Singleton identified at [akka://application/user/readSideGlobalPrepare-CartProcessor-singleton/singleton]
  405. 2019-10-21 15:29:13,297 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Sending buffered messages to current singleton instance
  406. 2019-10-21 15:29:13,297 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Trying to identify singleton at [akka.tcp://application@172.17.0.4:2552/user/slickOffsetStorePrepare-singleton/singleton]
  407. 2019-10-21 15:29:13,297 INFO  akka.cluster.singleton.ClusterSingletonProxy - Singleton identified at [akka://application/user/slickOffsetStorePrepare-singleton/singleton]
  408. 2019-10-21 15:29:13,298 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Sending buffered messages to current singleton instance
  409. 2019-10-21 15:29:13,458 DEBUG akka.cluster.ddata.Replicator - Received Update for key [CartProcessorCoordinatorState]
  410. 2019-10-21 15:29:13,465 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardRegionRegistered(Actor[akka://application/system/sharding/CartProcessor#1718379659])
  411. 2019-10-21 15:29:13,465 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardRegionRegistered(Actor[akka://application/system/sharding/CartProcessor#1718379659])]: [State(Map())]
  412. 2019-10-21 15:29:13,465 DEBUG akka.cluster.sharding.ShardRegion - CartProcessor: Retry request for shard [eventworld.cart.impl.evt$CartEvent] homes from coordinator at [Actor[akka://application/system/sharding/CartProcessorCoordinator/singleton/coordinator#-643121230]]. [1] buffered messages.
  413. 2019-10-21 15:29:13,468 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  414. 2019-10-21 15:29:13,469 DEBUG akka.cluster.ddata.Replicator - Received Update for key [CartProcessorCoordinatorState]
  415. 2019-10-21 15:29:13,469 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardHomeAllocated(eventworld.cart.impl.evt$CartEvent,Actor[akka://application/system/sharding/CartProcessor#1718379659])
  416. 2019-10-21 15:29:13,469 DEBUG akka.cluster.sharding.DDataShardCoordinator - Shard [eventworld.cart.impl.evt$CartEvent] allocated at [Actor[akka://application/system/sharding/CartProcessor#1718379659]]
  417. 2019-10-21 15:29:13,470 DEBUG akka.cluster.sharding.ShardRegion - CartProcessor: Host Shard [eventworld.cart.impl.evt$CartEvent]
  418. 2019-10-21 15:29:13,472 DEBUG akka.cluster.sharding.ShardRegion - CartProcessor: Starting shard [eventworld.cart.impl.evt$CartEvent] in region
  419. 2019-10-21 15:29:13,472 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardHomeAllocated(eventworld.cart.impl.evt$CartEvent,Actor[akka://application/system/sharding/CartProcessor#1718379659])]: [State(Map(eventworld.cart.impl.evt$CartEvent -> Actor[akka://application/system/sharding/CartProcessor#1718379659]))]
  420. 2019-10-21 15:29:13,526 DEBUG akka.cluster.sharding.DDataShardCoordinator - ShardRegion registered: [Actor[akka://application/system/sharding/MappingAggregate#-596560817]]
  421. 2019-10-21 15:29:13,526 DEBUG akka.cluster.sharding.DDataShardCoordinator - ShardRegion registered: [Actor[akka://application/system/sharding/CartAggregate#2064450905]]
  422. 2019-10-21 15:29:13,526 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  423. 2019-10-21 15:29:13,526 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  424. 2019-10-21 15:29:13,526 DEBUG akka.cluster.ddata.Replicator - Received Update for key [MappingAggregateCoordinatorState]
  425. 2019-10-21 15:29:13,526 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardRegionRegistered(Actor[akka://application/system/sharding/MappingAggregate#-596560817])
  426. 2019-10-21 15:29:13,526 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardRegionRegistered(Actor[akka://application/system/sharding/MappingAggregate#-596560817])]: [State(Map())]
  427. 2019-10-21 15:29:13,526 DEBUG akka.cluster.ddata.Replicator - Received Update for key [CartAggregateCoordinatorState]
  428. 2019-10-21 15:29:13,526 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardRegionRegistered(Actor[akka://application/system/sharding/CartAggregate#2064450905])
  429. 2019-10-21 15:29:13,527 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardRegionRegistered(Actor[akka://application/system/sharding/CartAggregate#2064450905])]: [State(Map())]
  430. 2019-10-21 15:29:13,663 DEBUG akka.cluster.sharding.DDataShardCoordinator - ShardRegion registered: [Actor[akka://application/system/sharding/kafkaProducer-cart_reservation#-693563099]]
  431. 2019-10-21 15:29:13,664 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  432. 2019-10-21 15:29:13,665 DEBUG akka.cluster.ddata.Replicator - Received Update for key [kafkaProducer-cart_reservationCoordinatorState]
  433. 2019-10-21 15:29:13,739 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardRegionRegistered(Actor[akka://application/system/sharding/kafkaProducer-cart_reservation#-693563099])
  434. 2019-10-21 15:29:13,740 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardRegionRegistered(Actor[akka://application/system/sharding/kafkaProducer-cart_reservation#-693563099])]: [State(Map())]
  435. 2019-10-21 15:29:13,743 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_reservation: Retry request for shard [singleton] homes from coordinator at [Actor[akka://application/system/sharding/kafkaProducer-cart_reservationCoordinator/singleton/coordinator#438313495]]. [1] buffered messages.
  436. 2019-10-21 15:29:13,744 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  437. 2019-10-21 15:29:13,745 DEBUG akka.cluster.ddata.Replicator - Received Update for key [kafkaProducer-cart_reservationCoordinatorState]
  438. 2019-10-21 15:29:13,745 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardHomeAllocated(singleton,Actor[akka://application/system/sharding/kafkaProducer-cart_reservation#-693563099])
  439. 2019-10-21 15:29:13,745 DEBUG akka.cluster.sharding.DDataShardCoordinator - Shard [singleton] allocated at [Actor[akka://application/system/sharding/kafkaProducer-cart_reservation#-693563099]]
  440. 2019-10-21 15:29:13,745 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardHomeAllocated(singleton,Actor[akka://application/system/sharding/kafkaProducer-cart_reservation#-693563099])]: [State(Map(singleton -> Actor[akka://application/system/sharding/kafkaProducer-cart_reservation#-693563099]))]
  441. 2019-10-21 15:29:13,745 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_reservation: Host Shard [singleton]
  442. 2019-10-21 15:29:13,748 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_reservation: Starting shard [singleton] in region
  443. 2019-10-21 15:29:13,748 DEBUG akka.cluster.sharding.DDataShardCoordinator - ShardRegion registered: [Actor[akka://application/system/sharding/kafkaProducer-cart#578028258]]
  444. 2019-10-21 15:29:13,748 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  445. 2019-10-21 15:29:13,748 DEBUG akka.cluster.sharding.DDataShardCoordinator - ShardRegion registered: [Actor[akka://application/system/sharding/kafkaProducer-cart_price_offer#-1378843657]]
  446. 2019-10-21 15:29:13,749 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  447. 2019-10-21 15:29:13,749 DEBUG akka.cluster.ddata.Replicator - Received Update for key [kafkaProducer-cartCoordinatorState]
  448. 2019-10-21 15:29:13,749 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardRegionRegistered(Actor[akka://application/system/sharding/kafkaProducer-cart#578028258])
  449. 2019-10-21 15:29:13,750 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardRegionRegistered(Actor[akka://application/system/sharding/kafkaProducer-cart#578028258])]: [State(Map())]
  450. 2019-10-21 15:29:13,750 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart: Retry request for shard [singleton] homes from coordinator at [Actor[akka://application/system/sharding/kafkaProducer-cartCoordinator/singleton/coordinator#-556037128]]. [1] buffered messages.
  451. 2019-10-21 15:29:13,750 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  452. 2019-10-21 15:29:13,750 DEBUG akka.cluster.ddata.Replicator - Received Update for key [kafkaProducer-cart_price_offerCoordinatorState]
  453. 2019-10-21 15:29:13,750 DEBUG akka.cluster.ddata.Replicator - Received Update for key [kafkaProducer-cartCoordinatorState]
  454. 2019-10-21 15:29:13,751 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardRegionRegistered(Actor[akka://application/system/sharding/kafkaProducer-cart_price_offer#-1378843657])
  455. 2019-10-21 15:29:13,751 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardRegionRegistered(Actor[akka://application/system/sharding/kafkaProducer-cart_price_offer#-1378843657])]: [State(Map())]
  456. 2019-10-21 15:29:13,751 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardHomeAllocated(singleton,Actor[akka://application/system/sharding/kafkaProducer-cart#578028258])
  457. 2019-10-21 15:29:13,752 DEBUG akka.cluster.sharding.DDataShardCoordinator - Shard [singleton] allocated at [Actor[akka://application/system/sharding/kafkaProducer-cart#578028258]]
  458. 2019-10-21 15:29:13,752 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardHomeAllocated(singleton,Actor[akka://application/system/sharding/kafkaProducer-cart#578028258])]: [State(Map(singleton -> Actor[akka://application/system/sharding/kafkaProducer-cart#578028258]))]
  459. 2019-10-21 15:29:13,752 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_price_offer: Retry request for shard [singleton] homes from coordinator at [Actor[akka://application/system/sharding/kafkaProducer-cart_price_offerCoordinator/singleton/coordinator#931210753]]. [1] buffered messages.
  460. 2019-10-21 15:29:13,752 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart: Host Shard [singleton]
  461. 2019-10-21 15:29:13,752 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart: Starting shard [singleton] in region
  462. 2019-10-21 15:29:13,753 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  463. 2019-10-21 15:29:13,753 DEBUG akka.cluster.ddata.Replicator - Received Update for key [kafkaProducer-cart_price_offerCoordinatorState]
  464. 2019-10-21 15:29:13,753 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardHomeAllocated(singleton,Actor[akka://application/system/sharding/kafkaProducer-cart_price_offer#-1378843657])
  465. 2019-10-21 15:29:13,753 DEBUG akka.cluster.sharding.DDataShardCoordinator - Shard [singleton] allocated at [Actor[akka://application/system/sharding/kafkaProducer-cart_price_offer#-1378843657]]
  466. 2019-10-21 15:29:13,762 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardHomeAllocated(singleton,Actor[akka://application/system/sharding/kafkaProducer-cart_price_offer#-1378843657])]: [State(Map(singleton -> Actor[akka://application/system/sharding/kafkaProducer-cart_price_offer#-1378843657]))]
  467. 2019-10-21 15:29:13,762 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_price_offer: Host Shard [singleton]
  468. 2019-10-21 15:29:13,762 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_price_offer: Starting shard [singleton] in region
  469. 2019-10-21 15:29:13,762 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart: Shard [singleton] located at [Actor[akka://application/system/sharding/kafkaProducer-cart#578028258]]
  470. 2019-10-21 15:29:13,762 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_reservation: Shard [singleton] located at [Actor[akka://application/system/sharding/kafkaProducer-cart_reservation#-693563099]]
  471. 2019-10-21 15:29:13,762 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_price_offer: Shard [singleton] located at [Actor[akka://application/system/sharding/kafkaProducer-cart_price_offer#-1378843657]]
  472. 2019-10-21 15:29:13,762 DEBUG akka.cluster.sharding.ShardRegion - CartProcessor: Shard [eventworld.cart.impl.evt$CartEvent] located at [Actor[akka://application/system/sharding/CartProcessor#1718379659]]
  473. 2019-10-21 15:29:13,763 DEBUG akka.io.TcpListener - New connection accepted
  474. 2019-10-21 15:29:13,779 DEBUG akka.cluster.sharding.Shard - Shard initialized
  475. 2019-10-21 15:29:13,780 DEBUG akka.cluster.sharding.Shard - Shard initialized
  476. 2019-10-21 15:29:13,780 DEBUG akka.cluster.sharding.ShardRegion - CartProcessor: Shard was initialized eventworld.cart.impl.evt$CartEvent
  477. 2019-10-21 15:29:13,780 DEBUG akka.cluster.sharding.ShardRegion - CartProcessor: Deliver [1] buffered messages for shard [eventworld.cart.impl.evt$CartEvent]
  478. 2019-10-21 15:29:13,780 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_reservation: Shard was initialized singleton
  479. 2019-10-21 15:29:13,780 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_reservation: Deliver [1] buffered messages for shard [singleton]
  480. 2019-10-21 15:29:13,780 DEBUG akka.cluster.sharding.Shard - Shard initialized
  481. 2019-10-21 15:29:13,780 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart: Shard was initialized singleton
  482. 2019-10-21 15:29:13,780 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart: Deliver [1] buffered messages for shard [singleton]
  483. 2019-10-21 15:29:13,791 DEBUG akka.cluster.sharding.Shard - Shard initialized
  484. 2019-10-21 15:29:13,791 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_price_offer: Shard was initialized singleton
  485. 2019-10-21 15:29:13,791 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_price_offer: Deliver [1] buffered messages for shard [singleton]
  486. 2019-10-21 15:29:13,963 DEBUG akka.cluster.sharding.Shard - Starting entity [singleton] in shard [singleton]
  487. 2019-10-21 15:29:13,969 DEBUG akka.cluster.sharding.Shard - Starting entity [eventworld.cart.impl.evt$CartEvent] in shard [eventworld.cart.impl.evt$CartEvent]
  488. 2019-10-21 15:29:13,970 DEBUG akka.cluster.sharding.Shard - Starting entity [singleton] in shard [singleton]
  489. 2019-10-21 15:29:13,973 DEBUG akka.cluster.sharding.Shard - Starting entity [singleton] in shard [singleton]
  490. 2019-10-21 15:29:13,974 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Forwarding message of type [ClusterStartupTaskActor$Execute$] to current singleton instance at [akka://application/user/slickOffsetStorePrepare-singleton/singleton]
  491. 2019-10-21 15:29:13,974 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Forwarding message of type [ClusterStartupTaskActor$Execute$] to current singleton instance at [akka://application/user/slickOffsetStorePrepare-singleton/singleton]
  492. 2019-10-21 15:29:13,975 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Forwarding message of type [ClusterStartupTaskActor$Execute$] to current singleton instance at [akka://application/user/slickOffsetStorePrepare-singleton/singleton]
  493. 2019-10-21 15:29:14,061 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Forwarding message of type [ClusterStartupTaskActor$Execute$] to current singleton instance at [akka://application/user/readSideGlobalPrepare-CartProcessor-singleton/singleton]
  494. 2019-10-21 15:29:14,477 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Forwarding message of type [ClusterStartupTaskActor$Execute$] to current singleton instance at [akka://application/user/slickOffsetStorePrepare-singleton/singleton]
  495. 2019-10-21 15:29:14,567 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [2]
  496. 2019-10-21 15:29:14,568 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [2]
  497. 2019-10-21 15:29:14,568 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [2]
  498. 2019-10-21 15:29:15,730 DEBUG akka.io.TcpListener - New connection accepted
  499. 2019-10-21 15:29:15,931 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [3]
  500. 2019-10-21 15:29:15,933 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [3]
  501. 2019-10-21 15:29:16,026 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [3]
  502. 2019-10-21 15:29:17,096 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [4]
  503. 2019-10-21 15:29:17,123 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [4]
  504. 2019-10-21 15:29:17,320 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [4]
  505. 2019-10-21 15:29:18,181 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [5]
  506. 2019-10-21 15:29:18,242 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [5]
  507. 2019-10-21 15:29:18,333 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [5]
  508. 2019-10-21 15:29:19,250 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [6]
  509. 2019-10-21 15:29:19,276 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [6]
  510. 2019-10-21 15:29:19,354 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [6]
  511. 2019-10-21 15:29:19,666 DEBUG akka.stream.scaladsl.RestartWithBackoffSource - Last restart attempt was more than 3000 milliseconds ago, resetting restart count
  512. 2019-10-21 15:29:20,844 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [7]
  513. 2019-10-21 15:29:20,869 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [7]
  514. 2019-10-21 15:29:20,869 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [7]
  515. 2019-10-21 15:29:20,895 WARN  akka.stream.scaladsl.RestartWithBackoffSource - Restarting graph due to failure. stack_trace:
  516. java.util.concurrent.TimeoutException: The first element has not yet passed through in 5000 milliseconds.
  517.     at akka.stream.impl.Timers$Initial$$anon$1.onTimer(Timers.scala:62)
  518.     at akka.stream.stage.TimerGraphStageLogic.onInternalTimer(GraphStage.scala:1544)
  519.     at akka.stream.stage.TimerGraphStageLogic.$anonfun$getTimerAsyncCallback$1(GraphStage.scala:1533)
  520.     at akka.stream.stage.TimerGraphStageLogic.$anonfun$getTimerAsyncCallback$1$adapted(GraphStage.scala:1533)
  521.     at akka.stream.impl.fusing.GraphInterpreter.runAsyncInput(GraphInterpreter.scala:452)
  522.     at akka.stream.impl.fusing.GraphInterpreterShell$AsyncInput.execute(ActorGraphInterpreter.scala:481)
  523.     at akka.stream.impl.fusing.GraphInterpreterShell.processEvent(ActorGraphInterpreter.scala:581)
  524.     at akka.stream.impl.fusing.ActorGraphInterpreter.akka$stream$impl$fusing$ActorGraphInterpreter$$processEvent(ActorGraphInterpreter.scala:749)
  525.     at akka.stream.impl.fusing.ActorGraphInterpreter$$anonfun$receive$1.applyOrElse(ActorGraphInterpreter.scala:764)
  526.     at akka.actor.Actor.aroundReceive(Actor.scala:539)
  527.     at akka.actor.Actor.aroundReceive$(Actor.scala:537)
  528.     at akka.stream.impl.fusing.ActorGraphInterpreter.aroundReceive(ActorGraphInterpreter.scala:671)
  529.     at akka.actor.ActorCell.receiveMessage(ActorCell.scala:612)
  530.     at akka.actor.ActorCell.invoke(ActorCell.scala:581)
  531.     at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:268)
  532.     at akka.dispatch.Mailbox.run(Mailbox.scala:229)
  533.     at akka.dispatch.Mailbox.exec(Mailbox.scala:241)
  534.     at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
  535.     at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
  536.     at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
  537.     at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
  538.  
  539. 2019-10-21 15:29:20,896 DEBUG akka.stream.scaladsl.RestartWithBackoffSource - Restarting graph in 3092791454 nanoseconds
  540. 2019-10-21 15:29:21,084 DEBUG akka.persistence.query.PersistenceQuery - Create plugin: jdbc-read-journal akka.persistence.jdbc.query.JdbcReadJournalProvider
  541. 2019-10-21 15:29:21,401 DEBUG akka.persistence.Persistence(akka://application) - Create plugin: jdbc-journal akka.persistence.jdbc.journal.JdbcAsyncWriteJournal
  542. 2019-10-21 15:29:21,953 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [8]
  543. 2019-10-21 15:29:21,955 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [8]
  544. 2019-10-21 15:29:21,956 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [8]
  545. 2019-10-21 15:29:22,963 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [9]
  546. 2019-10-21 15:29:23,014 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [9]
  547. 2019-10-21 15:29:23,016 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [9]
  548. 2019-10-21 15:29:24,136 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [10]
  549. 2019-10-21 15:29:24,139 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [10]
  550. 2019-10-21 15:29:24,139 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [10]
  551. 2019-10-21 15:29:24,139 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Forwarding message of type [ClusterStartupTaskActor$Execute$] to current singleton instance at [akka://application/user/slickOffsetStorePrepare-singleton/singleton]
  552. 2019-10-21 15:29:24,645 DEBUG akka.io.TcpListener - New connection accepted
  553. 2019-10-21 15:29:26,759 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [11]
  554. 2019-10-21 15:29:26,765 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [11]
  555. 2019-10-21 15:29:26,765 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [11]
  556. 2019-10-21 15:29:26,765 WARN  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Scheduled sending of heartbeat was delayed. Previous heartbeat was sent [2572] ms ago, expected interval is [1000] ms. This may cause failure detection to mark members as unreachable. The reason can be thread starvation, e.g. by running blocking tasks on the default dispatcher, CPU overload, or GC.
  557. 2019-10-21 15:29:26,765 DEBUG akka.io.TcpListener - New connection accepted
  558. 2019-10-21 15:29:27,853 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [12]
  559. 2019-10-21 15:29:27,853 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [12]
  560. 2019-10-21 15:29:27,853 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [12]
  561. 2019-10-21 15:29:27,953 DEBUG akka.actor.TimerScheduler - Start timer [AssumeMaxOrderingIdTimerKey] with generation [1]
  562. 2019-10-21 15:29:27,965 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [2]
  563. 2019-10-21 15:29:29,007 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [13]
  564. 2019-10-21 15:29:29,075 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [13]
  565. 2019-10-21 15:29:29,075 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [13]
  566. 2019-10-21 15:29:29,176 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [3]
  567. 2019-10-21 15:29:30,077 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [14]
  568. 2019-10-21 15:29:30,077 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [14]
  569. 2019-10-21 15:29:30,077 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [14]
  570. 2019-10-21 15:29:30,250 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [4]
  571. 2019-10-21 15:29:31,116 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [15]
  572. 2019-10-21 15:29:31,128 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [15]
  573. 2019-10-21 15:29:31,129 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [15]
  574. 2019-10-21 15:29:31,566 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [5]
  575. 2019-10-21 15:29:32,200 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [16]
  576. 2019-10-21 15:29:32,201 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [16]
  577. 2019-10-21 15:29:32,201 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [16]
  578. 2019-10-21 15:29:32,744 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [6]
  579. 2019-10-21 15:29:33,327 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [17]
  580. 2019-10-21 15:29:33,334 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [17]
  581. 2019-10-21 15:29:33,353 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [17]
  582. 2019-10-21 15:29:33,486 DEBUG akka.io.TcpListener - New connection accepted
  583. 2019-10-21 15:29:33,872 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [7]
  584. 2019-10-21 15:29:34,388 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [18]
  585. 2019-10-21 15:29:34,389 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [18]
  586. 2019-10-21 15:29:34,452 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [18]
  587. 2019-10-21 15:29:34,938 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [8]
  588. 2019-10-21 15:29:35,367 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [19]
  589. 2019-10-21 15:29:35,369 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [19]
  590. 2019-10-21 15:29:35,467 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [19]
  591. 2019-10-21 15:29:35,792 DEBUG akka.io.TcpListener - New connection accepted
  592. 2019-10-21 15:29:36,254 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [9]
  593. 2019-10-21 15:29:36,386 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [20]
  594. 2019-10-21 15:29:36,386 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [20]
  595. 2019-10-21 15:29:36,499 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [20]
  596. 2019-10-21 15:29:37,373 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [10]
  597. 2019-10-21 15:29:37,482 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [21]
  598. 2019-10-21 15:29:37,483 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [21]
  599. 2019-10-21 15:29:37,529 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [21]
  600. 2019-10-21 15:29:38,493 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [22]
  601. 2019-10-21 15:29:38,574 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [22]
  602. 2019-10-21 15:29:38,574 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [22]
  603. 2019-10-21 15:29:38,596 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [11]
  604. 2019-10-21 15:29:39,554 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [23]
  605. 2019-10-21 15:29:39,602 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [23]
  606. 2019-10-21 15:29:39,602 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [23]
  607. 2019-10-21 15:29:39,681 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [12]
  608. 2019-10-21 15:29:40,636 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [24]
  609. 2019-10-21 15:29:40,699 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [24]
  610. 2019-10-21 15:29:40,699 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [24]
  611. 2019-10-21 15:29:40,883 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [13]
  612. 2019-10-21 15:29:41,408 DEBUG akka.http.impl.engine.client.PoolGateway - Shutting down host connection pool immediately
  613. 2019-10-21 15:29:41,410 DEBUG akka.http.impl.engine.client.PoolGateway - Pool upstream was completed
  614. 2019-10-21 15:29:41,411 DEBUG akka.http.impl.engine.client.PoolGateway - Pool stopped
  615. 2019-10-21 15:29:41,727 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [25]
  616. 2019-10-21 15:29:41,727 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [25]
  617. 2019-10-21 15:29:41,727 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [25]
  618. 2019-10-21 15:29:41,989 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [14]
  619. 2019-10-21 15:29:42,935 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [26]
  620. 2019-10-21 15:29:42,938 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [26]
  621. 2019-10-21 15:29:42,938 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [26]
  622. 2019-10-21 15:29:43,040 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [15]
  623. 2019-10-21 15:29:43,085 DEBUG akka.http.impl.engine.client.PoolGateway - Shutting down host connection pool immediately
  624. 2019-10-21 15:29:43,085 DEBUG akka.http.impl.engine.client.PoolGateway - Pool upstream was completed
  625. 2019-10-21 15:29:43,085 DEBUG akka.http.impl.engine.client.PoolGateway - Pool stopped
  626. 2019-10-21 15:29:43,857 DEBUG akka.io.TcpListener - New connection accepted
  627. 2019-10-21 15:29:43,858 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [27]
  628. 2019-10-21 15:29:43,859 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [27]
  629. 2019-10-21 15:29:43,867 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [27]
  630. 2019-10-21 15:29:44,153 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [16]
  631. 2019-10-21 15:29:44,874 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [28]
  632. 2019-10-21 15:29:44,880 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [28]
  633. 2019-10-21 15:29:44,882 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [28]
  634. 2019-10-21 15:29:45,406 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [17]
  635. 2019-10-21 15:29:45,795 DEBUG akka.io.TcpListener - New connection accepted
  636. 2019-10-21 15:29:45,894 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [29]
  637. 2019-10-21 15:29:45,894 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [29]
  638. 2019-10-21 15:29:45,904 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [29]
  639. 2019-10-21 15:29:46,442 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [18]
  640. 2019-10-21 15:29:46,965 WARN  org.apache.kafka.clients.NetworkClient - [Consumer clientId=cart-2, groupId=cart] Error while fetching metadata with correlation id 3 : {user_switch=INVALID_REPLICATION_FACTOR}
  641. 2019-10-21 15:29:46,965 WARN  org.apache.kafka.clients.NetworkClient - [Consumer clientId=cart-1, groupId=cart] Error while fetching metadata with correlation id 3 : {reservations=INVALID_REPLICATION_FACTOR}
  642. 2019-10-21 15:29:46,965 WARN  org.apache.kafka.clients.NetworkClient - [Consumer clientId=cart-3, groupId=cart] Error while fetching metadata with correlation id 3 : {price-offer-updated=INVALID_REPLICATION_FACTOR}
  643. 2019-10-21 15:29:46,965 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [30]
  644. 2019-10-21 15:29:46,966 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [30]
  645. 2019-10-21 15:29:46,966 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [30]
  646. 2019-10-21 15:29:47,614 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [19]
  647. 2019-10-21 15:29:48,172 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [31]
  648. 2019-10-21 15:29:48,258 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [31]
  649. 2019-10-21 15:29:48,258 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [31]
  650. 2019-10-21 15:29:48,765 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [20]
  651. 2019-10-21 15:29:49,395 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [32]
  652. 2019-10-21 15:29:49,401 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [32]
  653. 2019-10-21 15:29:49,414 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [32]
  654. 2019-10-21 15:29:49,840 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [21]
  655. 2019-10-21 15:29:50,664 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [33]
  656. 2019-10-21 15:29:51,086 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [33]
  657. 2019-10-21 15:29:51,088 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [33]
  658. 2019-10-21 15:29:51,095 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [22]
  659. 2019-10-21 15:29:51,732 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [34]
  660. 2019-10-21 15:29:51,734 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [34]
  661. 2019-10-21 15:29:51,828 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [34]
  662. 2019-10-21 15:29:52,298 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [23]
  663. 2019-10-21 15:29:52,886 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [35]
  664. 2019-10-21 15:29:52,887 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [35]
  665. 2019-10-21 15:29:52,888 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [35]
  666. 2019-10-21 15:29:53,569 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [24]
  667. 2019-10-21 15:29:53,932 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [36]
  668. 2019-10-21 15:29:53,932 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [36]
  669. 2019-10-21 15:29:53,934 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [36]
  670. 2019-10-21 15:29:55,246 DEBUG akka.io.TcpListener - New connection accepted
  671. 2019-10-21 15:29:55,386 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [37]
  672. 2019-10-21 15:29:55,415 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [37]
  673. 2019-10-21 15:29:55,427 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [37]
  674. 2019-10-21 15:29:55,655 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [25]
  675. 2019-10-21 15:29:56,521 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [38]
  676. 2019-10-21 15:29:56,525 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [38]
  677. 2019-10-21 15:29:56,564 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [38]
  678. 2019-10-21 15:29:56,904 DEBUG akka.io.TcpListener - New connection accepted
  679. 2019-10-21 15:29:56,921 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [26]
  680. 2019-10-21 15:29:57,729 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [39]
  681. 2019-10-21 15:29:57,783 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [39]
  682. 2019-10-21 15:29:57,783 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [39]
  683. 2019-10-21 15:29:58,028 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [27]
  684. 2019-10-21 15:29:58,677 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [40]
  685. 2019-10-21 15:29:58,744 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [40]
  686. 2019-10-21 15:29:58,746 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [40]
  687. 2019-10-21 15:29:59,733 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [41]
  688. 2019-10-21 15:29:59,914 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [41]
  689. 2019-10-21 15:30:00,049 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [41]
  690. 2019-10-21 15:30:00,050 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [28]
  691. 2019-10-21 15:30:00,820 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [42]
  692. 2019-10-21 15:30:00,851 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [42]
  693. 2019-10-21 15:30:00,907 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [42]
  694. 2019-10-21 15:30:00,940 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [29]
  695. 2019-10-21 15:30:01,879 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [43]
  696. 2019-10-21 15:30:01,880 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [43]
  697. 2019-10-21 15:30:02,018 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [30]
  698. 2019-10-21 15:30:02,027 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [43]
  699. 2019-10-21 15:30:02,894 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [44]
  700. 2019-10-21 15:30:02,895 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [44]
  701. 2019-10-21 15:30:03,145 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [44]
  702. 2019-10-21 15:30:03,247 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [31]
  703. 2019-10-21 15:30:03,618 DEBUG akka.io.TcpListener - New connection accepted
  704. 2019-10-21 15:30:03,975 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [45]
  705. 2019-10-21 15:30:03,988 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [45]
  706. 2019-10-21 15:30:04,173 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [45]
  707. 2019-10-21 15:30:04,411 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [32]
  708. 2019-10-21 15:30:05,218 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [46]
  709. 2019-10-21 15:30:05,221 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [46]
  710. 2019-10-21 15:30:05,221 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [46]
  711. 2019-10-21 15:30:05,435 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [33]
  712. 2019-10-21 15:30:06,254 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [47]
  713. 2019-10-21 15:30:06,254 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [47]
  714. 2019-10-21 15:30:06,270 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [47]
  715. 2019-10-21 15:30:07,155 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [34]
  716. 2019-10-21 15:30:09,062 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [48]
  717. 2019-10-21 15:30:09,063 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [48]
  718. 2019-10-21 15:30:09,091 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [48]
  719. 2019-10-21 15:30:10,080 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [49]
  720. 2019-10-21 15:30:10,082 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [49]
  721. 2019-10-21 15:30:11,344 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [49]
  722. 2019-10-21 15:30:11,786 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [50]
  723. 2019-10-21 15:30:13,968 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [50]
  724. 2019-10-21 15:30:14,343 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [50]
  725. 2019-10-21 15:30:14,355 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [51]
  726. 2019-10-21 15:30:14,409 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [51]
  727. 2019-10-21 15:30:14,409 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [35]
  728. 2019-10-21 15:30:20,655 WARN  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Scheduled sending of heartbeat was delayed. Previous heartbeat was sent [4141] ms ago, expected interval is [1000] ms. This may cause failure detection to mark members as unreachable. The reason can be thread starvation, e.g. by running blocking tasks on the default dispatcher, CPU overload, or GC.
  729. 2019-10-21 15:30:20,661 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [51]
  730. 2019-10-21 15:30:20,661 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [52]
  731. 2019-10-21 15:30:20,661 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [52]
  732. 2019-10-21 15:30:20,661 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [52]
  733. 2019-10-21 15:30:22,554 WARN  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Scheduled sending of heartbeat was delayed. Previous heartbeat was sent [7391] ms ago, expected interval is [1000] ms. This may cause failure detection to mark members as unreachable. The reason can be thread starvation, e.g. by running blocking tasks on the default dispatcher, CPU overload, or GC.
  734. 2019-10-21 15:30:25,224 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [36]
  735. 2019-10-21 15:30:28,024 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [37]
  736. 2019-10-21 15:30:30,166 WARN  org.apache.kafka.clients.NetworkClient - [Consumer clientId=cart-3, groupId=cart] Bootstrap broker kafka:9092 (id: -1 rack: null) disconnected
  737. 2019-10-21 15:30:30,171 WARN  org.apache.kafka.clients.NetworkClient - [Consumer clientId=cart-1, groupId=cart] Bootstrap broker kafka:9092 (id: -1 rack: null) disconnected
  738. 2019-10-21 15:30:30,325 WARN  org.apache.kafka.clients.NetworkClient - [Consumer clientId=cart-2, groupId=cart] Bootstrap broker kafka:9092 (id: -1 rack: null) disconnected
  739. 2019-10-21 15:30:32,533 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [38]
  740. 2019-10-21 15:30:32,546 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [53]
  741. 2019-10-21 15:30:32,546 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [53]
  742. 2019-10-21 15:30:32,546 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [53]
  743. 2019-10-21 15:30:33,456 DEBUG akka.io.TcpListener - New connection accepted
  744. 2019-10-21 15:30:33,629 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [54]
  745. 2019-10-21 15:30:33,630 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [54]
  746. 2019-10-21 15:30:33,630 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [54]
  747. 2019-10-21 15:30:33,747 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [39]
  748. 2019-10-21 15:30:34,593 DEBUG akka.io.TcpListener - New connection accepted
  749. 2019-10-21 15:30:34,839 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [55]
  750. 2019-10-21 15:30:34,983 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [55]
  751. 2019-10-21 15:30:35,026 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [55]
  752. 2019-10-21 15:30:35,497 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [40]
  753. 2019-10-21 15:30:35,555 DEBUG akka.io.TcpListener - New connection accepted
  754. 2019-10-21 15:30:35,681 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [56]
  755. 2019-10-21 15:30:36,544 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [56]
  756. 2019-10-21 15:30:36,546 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [56]
  757. 2019-10-21 15:30:37,458 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [41]
  758. 2019-10-21 15:30:37,665 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [57]
  759. 2019-10-21 15:30:37,673 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [57]
  760. 2019-10-21 15:30:37,737 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [57]
  761. 2019-10-21 15:30:38,282 DEBUG akka.io.TcpListener - New connection accepted
  762. 2019-10-21 15:30:38,935 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [58]
  763. 2019-10-21 15:30:38,954 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [58]
  764. 2019-10-21 15:30:38,954 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [58]
  765. 2019-10-21 15:30:39,622 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [42]
  766. 2019-10-21 15:30:39,868 DEBUG akka.io.TcpListener - New connection accepted
  767. 2019-10-21 15:30:39,966 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [59]
  768. 2019-10-21 15:30:39,968 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [59]
  769. 2019-10-21 15:30:39,968 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [59]
  770. 2019-10-21 15:30:40,767 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [43]
  771. 2019-10-21 15:30:41,211 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [60]
  772. 2019-10-21 15:30:41,212 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [60]
  773. 2019-10-21 15:30:41,212 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [60]
  774. 2019-10-21 15:30:42,255 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [61]
  775. 2019-10-21 15:30:42,255 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [61]
  776. 2019-10-21 15:30:42,255 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [61]
  777. 2019-10-21 15:30:42,339 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [44]
  778. 2019-10-21 15:30:43,275 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [62]
  779. 2019-10-21 15:30:43,286 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [62]
  780. 2019-10-21 15:30:43,377 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [45]
  781. 2019-10-21 15:30:43,378 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [62]
  782. 2019-10-21 15:30:44,348 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [63]
  783. 2019-10-21 15:30:44,481 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [46]
  784. 2019-10-21 15:30:44,514 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [63]
  785. 2019-10-21 15:30:44,551 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [63]
  786. 2019-10-21 15:30:45,565 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [64]
  787. 2019-10-21 15:30:45,582 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [64]
  788. 2019-10-21 15:30:45,598 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [64]
  789. 2019-10-21 15:30:46,484 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [47]
  790. 2019-10-21 15:30:46,687 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [65]
  791. 2019-10-21 15:30:46,896 DEBUG akka.io.TcpListener - New connection accepted
  792. 2019-10-21 15:30:46,972 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [65]
  793. 2019-10-21 15:30:47,672 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [48]
  794. 2019-10-21 15:30:47,750 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [65]
  795. 2019-10-21 15:30:48,064 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [66]
  796. 2019-10-21 15:30:48,246 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [66]
  797. 2019-10-21 15:30:48,379 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [66]
  798. 2019-10-21 15:30:49,081 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [67]
  799. 2019-10-21 15:30:49,083 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [49]
  800. 2019-10-21 15:30:49,259 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [67]
  801. 2019-10-21 15:30:49,453 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [67]
  802. 2019-10-21 15:30:50,156 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [68]
  803. 2019-10-21 15:30:50,281 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [68]
  804. 2019-10-21 15:30:50,286 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [50]
  805. 2019-10-21 15:30:50,512 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [68]
  806. 2019-10-21 15:30:51,231 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [69]
  807. 2019-10-21 15:30:51,685 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [69]
  808. 2019-10-21 15:30:51,736 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [69]
  809. 2019-10-21 15:30:51,872 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [51]
  810. 2019-10-21 15:30:52,796 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [70]
  811. 2019-10-21 15:30:52,804 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [70]
  812. 2019-10-21 15:30:52,804 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [70]
  813. 2019-10-21 15:30:52,973 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [52]
  814. 2019-10-21 15:30:53,040 DEBUG akka.io.TcpListener - New connection accepted
  815. 2019-10-21 15:30:53,952 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [71]
  816. 2019-10-21 15:30:53,953 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [71]
  817. 2019-10-21 15:30:53,962 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [71]
  818. 2019-10-21 15:30:54,237 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [53]
  819. 2019-10-21 15:30:54,982 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [72]
  820. 2019-10-21 15:30:54,984 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [72]
  821. 2019-10-21 15:30:54,985 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [72]
  822. 2019-10-21 15:30:55,829 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [54]
  823. 2019-10-21 15:30:56,027 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [73]
  824. 2019-10-21 15:30:56,028 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [73]
  825. 2019-10-21 15:30:56,028 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [73]
  826. 2019-10-21 15:30:56,971 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [55]
  827. 2019-10-21 15:30:57,199 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [74]
  828. 2019-10-21 15:30:57,205 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [74]
  829. 2019-10-21 15:30:57,215 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [74]
  830. 2019-10-21 15:30:57,427 DEBUG akka.io.TcpListener - New connection accepted
  831. 2019-10-21 15:30:58,217 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [56]
  832. 2019-10-21 15:30:58,245 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [75]
  833. 2019-10-21 15:30:58,299 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [75]
  834. 2019-10-21 15:30:58,300 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [75]
  835. 2019-10-21 15:30:58,494 DEBUG akka.io.TcpListener - New connection accepted
  836. 2019-10-21 15:30:59,595 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [76]
  837. 2019-10-21 15:30:59,659 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [76]
  838. 2019-10-21 15:30:59,661 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [76]
  839. 2019-10-21 15:30:59,898 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [57]
  840. ^C
  841. $ docker logs -f $(docker ps | grep "bin/cart" | awk '{ print $1 }')
  842. 15:28:55,633 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
  843. 15:28:55,633 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy]
  844. 15:28:55,633 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [jar:file:/opt/docker/lib/global.bright.cart-1.0.1.jar!/logback.xml]
  845. 15:28:55,645 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@4bf48f6 - URL [jar:file:/opt/docker/lib/global.bright.cart-1.0.1.jar!/logback.xml] is not of type file
  846. 15:28:55,825 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
  847. 15:28:55,826 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
  848. 15:28:55,832 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
  849. 15:28:55,839 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
  850. 15:28:55,964 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.FileAppender]
  851. 15:28:55,965 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
  852. 15:28:55,967 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
  853. 15:28:55,967 |-INFO in ch.qos.logback.core.FileAppender[FILE] - File property is set to [testFile.log]
  854. 15:28:55,968 |-ERROR in ch.qos.logback.core.FileAppender[FILE] - openFile(testFile.log,true) call failed. java.io.FileNotFoundException: testFile.log (Permission denied)
  855.     at java.io.FileNotFoundException: testFile.log (Permission denied)
  856.     at  at java.io.FileOutputStream.open0(Native Method)
  857.     at  at java.io.FileOutputStream.open(FileOutputStream.java:270)
  858.     at  at java.io.FileOutputStream.<init>(FileOutputStream.java:213)
  859.     at  at ch.qos.logback.core.recovery.ResilientFileOutputStream.<init>(ResilientFileOutputStream.java:26)
  860.     at  at ch.qos.logback.core.FileAppender.openFile(FileAppender.java:204)
  861.     at  at ch.qos.logback.core.FileAppender.start(FileAppender.java:127)
  862.     at  at ch.qos.logback.core.joran.action.AppenderAction.end(AppenderAction.java:90)
  863.     at  at ch.qos.logback.core.joran.spi.Interpreter.callEndAction(Interpreter.java:309)
  864.     at  at ch.qos.logback.core.joran.spi.Interpreter.endElement(Interpreter.java:193)
  865.     at  at ch.qos.logback.core.joran.spi.Interpreter.endElement(Interpreter.java:179)
  866.     at  at ch.qos.logback.core.joran.spi.EventPlayer.play(EventPlayer.java:62)
  867.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:165)
  868.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:152)
  869.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:110)
  870.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:53)
  871.     at  at ch.qos.logback.classic.util.ContextInitializer.configureByResource(ContextInitializer.java:75)
  872.     at  at ch.qos.logback.classic.util.ContextInitializer.autoConfig(ContextInitializer.java:150)
  873.     at  at org.slf4j.impl.StaticLoggerBinder.init(StaticLoggerBinder.java:84)
  874.     at  at org.slf4j.impl.StaticLoggerBinder.<clinit>(StaticLoggerBinder.java:55)
  875.     at  at org.slf4j.LoggerFactory.bind(LoggerFactory.java:150)
  876.     at  at org.slf4j.LoggerFactory.performInitialization(LoggerFactory.java:124)
  877.     at  at org.slf4j.LoggerFactory.getILoggerFactory(LoggerFactory.java:412)
  878.     at  at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:357)
  879.     at  at play.api.Logger$.<init>(Logger.scala:291)
  880.     at  at play.api.Logger$.<clinit>(Logger.scala)
  881.     at  at com.lightbend.lagom.scaladsl.server.LagomApplicationLoader.<init>(LagomApplicationLoader.scala:55)
  882.     at  at eventworld.cart.impl.CartLoader.<init>(CartLoader.scala:25)
  883.     at  at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
  884.     at  at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
  885.     at  at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  886.     at  at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
  887.     at  at play.api.ApplicationLoader$.apply(ApplicationLoader.scala:175)
  888.     at  at play.core.server.ProdServerStart$.start(ProdServerStart.scala:58)
  889.     at  at play.core.server.ProdServerStart$.main(ProdServerStart.scala:31)
  890.     at  at play.core.server.ProdServerStart.main(ProdServerStart.scala)
  891. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.datastax.driver] to DEBUG
  892. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [akka] to DEBUG
  893. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [eventworld.cart.impl.CartService] to DEBUG
  894. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
  895. 15:28:55,969 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
  896. 15:28:55,969 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
  897. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
  898. 15:28:55,972 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@62833051 - Registering current configuration as safe fallback point
  899.  
  900. 15:28:55,633 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
  901. 15:28:55,633 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy]
  902. 15:28:55,633 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [jar:file:/opt/docker/lib/global.bright.cart-1.0.1.jar!/logback.xml]
  903. 15:28:55,645 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@4bf48f6 - URL [jar:file:/opt/docker/lib/global.bright.cart-1.0.1.jar!/logback.xml] is not of type file
  904. 15:28:55,825 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
  905. 15:28:55,826 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
  906. 15:28:55,832 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
  907. 15:28:55,839 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
  908. 15:28:55,964 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.FileAppender]
  909. 15:28:55,965 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
  910. 15:28:55,967 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
  911. 15:28:55,967 |-INFO in ch.qos.logback.core.FileAppender[FILE] - File property is set to [testFile.log]
  912. 15:28:55,968 |-ERROR in ch.qos.logback.core.FileAppender[FILE] - openFile(testFile.log,true) call failed. java.io.FileNotFoundException: testFile.log (Permission denied)
  913.     at java.io.FileNotFoundException: testFile.log (Permission denied)
  914.     at  at java.io.FileOutputStream.open0(Native Method)
  915.     at  at java.io.FileOutputStream.open(FileOutputStream.java:270)
  916.     at  at java.io.FileOutputStream.<init>(FileOutputStream.java:213)
  917.     at  at ch.qos.logback.core.recovery.ResilientFileOutputStream.<init>(ResilientFileOutputStream.java:26)
  918.     at  at ch.qos.logback.core.FileAppender.openFile(FileAppender.java:204)
  919.     at  at ch.qos.logback.core.FileAppender.start(FileAppender.java:127)
  920.     at  at ch.qos.logback.core.joran.action.AppenderAction.end(AppenderAction.java:90)
  921.     at  at ch.qos.logback.core.joran.spi.Interpreter.callEndAction(Interpreter.java:309)
  922.     at  at ch.qos.logback.core.joran.spi.Interpreter.endElement(Interpreter.java:193)
  923.     at  at ch.qos.logback.core.joran.spi.Interpreter.endElement(Interpreter.java:179)
  924.     at  at ch.qos.logback.core.joran.spi.EventPlayer.play(EventPlayer.java:62)
  925.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:165)
  926.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:152)
  927.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:110)
  928.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:53)
  929.     at  at ch.qos.logback.classic.util.ContextInitializer.configureByResource(ContextInitializer.java:75)
  930.     at  at ch.qos.logback.classic.util.ContextInitializer.autoConfig(ContextInitializer.java:150)
  931.     at  at org.slf4j.impl.StaticLoggerBinder.init(StaticLoggerBinder.java:84)
  932.     at  at org.slf4j.impl.StaticLoggerBinder.<clinit>(StaticLoggerBinder.java:55)
  933.     at  at org.slf4j.LoggerFactory.bind(LoggerFactory.java:150)
  934.     at  at org.slf4j.LoggerFactory.performInitialization(LoggerFactory.java:124)
  935.     at  at org.slf4j.LoggerFactory.getILoggerFactory(LoggerFactory.java:412)
  936.     at  at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:357)
  937.     at  at play.api.Logger$.<init>(Logger.scala:291)
  938.     at  at play.api.Logger$.<clinit>(Logger.scala)
  939.     at  at com.lightbend.lagom.scaladsl.server.LagomApplicationLoader.<init>(LagomApplicationLoader.scala:55)
  940.     at  at eventworld.cart.impl.CartLoader.<init>(CartLoader.scala:25)
  941.     at  at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
  942.     at  at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
  943.     at  at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  944.     at  at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
  945.     at  at play.api.ApplicationLoader$.apply(ApplicationLoader.scala:175)
  946.     at  at play.core.server.ProdServerStart$.start(ProdServerStart.scala:58)
  947.     at  at play.core.server.ProdServerStart$.main(ProdServerStart.scala:31)
  948.     at  at play.core.server.ProdServerStart.main(ProdServerStart.scala)
  949. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.datastax.driver] to DEBUG
  950. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [akka] to DEBUG
  951. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [eventworld.cart.impl.CartService] to DEBUG
  952. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
  953. 15:28:55,969 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
  954. 15:28:55,969 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
  955. 15:28:55,969 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
  956. 15:28:55,972 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@62833051 - Registering current configuration as safe fallback point
  957. 15:28:56,834 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@24b6b8f6 - URL [jar:file:/opt/docker/lib/global.bright.cart-1.0.1.jar!/logback.xml] is not of type file
  958. 15:28:56,836 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
  959. 15:28:56,836 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
  960. 15:28:56,836 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
  961. 15:28:56,836 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
  962. 15:28:56,836 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.FileAppender]
  963. 15:28:56,836 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
  964. 15:28:56,836 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
  965. 15:28:56,837 |-INFO in ch.qos.logback.core.FileAppender[FILE] - File property is set to [testFile.log]
  966. 15:28:56,837 |-ERROR in ch.qos.logback.core.FileAppender[FILE] - openFile(testFile.log,true) call failed. java.io.FileNotFoundException: testFile.log (Permission denied)
  967.     at java.io.FileNotFoundException: testFile.log (Permission denied)
  968.     at  at java.io.FileOutputStream.open0(Native Method)
  969.     at  at java.io.FileOutputStream.open(FileOutputStream.java:270)
  970.     at  at java.io.FileOutputStream.<init>(FileOutputStream.java:213)
  971.     at  at ch.qos.logback.core.recovery.ResilientFileOutputStream.<init>(ResilientFileOutputStream.java:26)
  972.     at  at ch.qos.logback.core.FileAppender.openFile(FileAppender.java:204)
  973.     at  at ch.qos.logback.core.FileAppender.start(FileAppender.java:127)
  974.     at  at ch.qos.logback.core.joran.action.AppenderAction.end(AppenderAction.java:90)
  975.     at  at ch.qos.logback.core.joran.spi.Interpreter.callEndAction(Interpreter.java:309)
  976.     at  at ch.qos.logback.core.joran.spi.Interpreter.endElement(Interpreter.java:193)
  977.     at  at ch.qos.logback.core.joran.spi.Interpreter.endElement(Interpreter.java:179)
  978.     at  at ch.qos.logback.core.joran.spi.EventPlayer.play(EventPlayer.java:62)
  979.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:165)
  980.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:152)
  981.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:110)
  982.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:53)
  983.     at  at com.lightbend.lagom.internal.logback.LogbackLoggerConfigurator.configure(LogbackLoggerConfigurator.scala:121)
  984.     at  at com.lightbend.lagom.internal.logback.LogbackLoggerConfigurator.configure(LogbackLoggerConfigurator.scala:75)
  985.     at  at com.lightbend.lagom.internal.logback.LogbackLoggerConfigurator.configure(LogbackLoggerConfigurator.scala:40)
  986.     at  at com.lightbend.lagom.scaladsl.server.LagomApplicationLoader.$anonfun$loadCustomLoggerConfiguration$1(LagomApplicationLoader.scala:185)
  987.     at  at com.lightbend.lagom.scaladsl.server.LagomApplicationLoader.$anonfun$loadCustomLoggerConfiguration$1$adapted(LagomApplicationLoader.scala:185)
  988.     at  at scala.Option.foreach(Option.scala:274)
  989.     at  at com.lightbend.lagom.scaladsl.server.LagomApplicationLoader.loadCustomLoggerConfiguration(LagomApplicationLoader.scala:185)
  990.     at  at com.lightbend.lagom.scaladsl.server.LagomApplicationLoader.load(LagomApplicationLoader.scala:86)
  991.     at  at play.core.server.ProdServerStart$.start(ProdServerStart.scala:59)
  992.     at  at play.core.server.ProdServerStart$.main(ProdServerStart.scala:31)
  993.     at  at play.core.server.ProdServerStart.main(ProdServerStart.scala)
  994. 15:28:56,837 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.datastax.driver] to DEBUG
  995. 15:28:56,837 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [akka] to DEBUG
  996. 15:28:56,837 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [eventworld.cart.impl.CartService] to DEBUG
  997. 15:28:56,837 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
  998. 15:28:56,837 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
  999. 15:28:56,837 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
  1000. 15:28:56,837 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
  1001. 15:28:56,837 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@72cf2de5 - Registering current configuration as safe fallback point
  1002.  
  1003. 2019-10-21 15:28:58,087 INFO  akka.event.slf4j.Slf4jLogger - Slf4jLogger started
  1004. 2019-10-21 15:28:58,131 DEBUG akka.event.EventStream - logger log1-Slf4jLogger started
  1005. 2019-10-21 15:28:58,133 DEBUG akka.event.EventStream - Default Loggers started
  1006. 2019-10-21 15:28:58,155 INFO  akka.remote.Remoting - Starting remoting
  1007. 2019-10-21 15:28:58,647 INFO  akka.remote.Remoting - Remoting started; listening on addresses :[akka.tcp://application@172.17.0.4:2552]
  1008. 2019-10-21 15:28:58,650 INFO  akka.remote.Remoting - Remoting now listens on addresses: [akka.tcp://application@172.17.0.4:2552]
  1009. 2019-10-21 15:28:58,738 INFO  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Starting up, Akka version [2.5.25] ...
  1010. 2019-10-21 15:28:58,999 INFO  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Registered cluster JMX MBean [akka:type=Cluster]
  1011. 2019-10-21 15:28:58,999 INFO  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Started up successfully
  1012. 2019-10-21 15:28:59,135 INFO  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/cluster-usage.html#joining-to-seed-nodes
  1013. 2019-10-21 15:29:00,041 INFO  akka.management.cluster.bootstrap.ClusterBootstrap - Bootstrap using `akka.discovery` method: kubernetes-api
  1014. 2019-10-21 15:29:01,450 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Settings Settings(/var/run/secrets/kubernetes.io/serviceaccount/ca.crt, /var/run/secrets/kubernetes.io/serviceaccount/token, KUBERNETES_SERVICE_HOST, KUBERNETES_SERVICE_PORT, /var/run/secrets/kubernetes.io/serviceaccount/namespace, None, cluster.local)
  1015. 2019-10-21 15:29:01,549 INFO  akka.management.internal.HealthChecksImpl - Loading readiness checks List(NamedHealthCheck(cluster-membership,akka.management.cluster.scaladsl.ClusterMembershipCheck))
  1016. 2019-10-21 15:29:01,551 INFO  akka.management.internal.HealthChecksImpl - Loading liveness checks List()
  1017. 2019-10-21 15:29:01,664 INFO  akka.management.scaladsl.AkkaManagement - Binding Akka Management (HTTP) endpoint to: 172.17.0.4:8558
  1018. 2019-10-21 15:29:01,937 INFO  akka.management.scaladsl.AkkaManagement - Including HTTP management routes for ClusterHttpManagementRouteProvider
  1019. 2019-10-21 15:29:02,042 INFO  akka.management.scaladsl.AkkaManagement - Including HTTP management routes for ClusterBootstrap
  1020. 2019-10-21 15:29:02,046 INFO  akka.management.cluster.bootstrap.ClusterBootstrap - Using self contact point address: http://172.17.0.4:8558
  1021. 2019-10-21 15:29:02,060 INFO  akka.management.scaladsl.AkkaManagement - Including HTTP management routes for HealthCheckRoutes
  1022. 2019-10-21 15:29:02,526 DEBUG akka.io.TcpListener - Successfully bound to /172.17.0.4:8558
  1023. 2019-10-21 15:29:02,549 INFO  akka.management.scaladsl.AkkaManagement - Bound Akka Management (HTTP) endpoint to: 172.17.0.4:8558
  1024. 2019-10-21 15:29:02,648 INFO  akka.management.cluster.bootstrap.ClusterBootstrap - Initiating bootstrap procedure using kubernetes-api method...
  1025. 2019-10-21 15:29:02,666 DEBUG akka.actor.TimerScheduler - Start timer [resolve-key] with generation [1]
  1026. 2019-10-21 15:29:02,668 DEBUG akka.actor.TimerScheduler - Start timer [decide-key] with generation [2]
  1027. 2019-10-21 15:29:02,668 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Locating service members. Using discovery [akka.discovery.kubernetes.KubernetesApiServiceDiscovery], join decider [akka.management.cluster.bootstrap.LowestAddressJoinDecider]
  1028. 2019-10-21 15:29:02,668 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Looking up [Lookup(cart,None,Some(tcp))]
  1029. 2019-10-21 15:29:02,671 INFO  akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Querying for pods with label selector: [app=cart]. Namespace: [default]. Port: [None]
  1030. 2019-10-21 15:29:02,741 DEBUG akka.http.impl.engine.client.PoolGateway - (Re-)starting host connection pool to 10.96.0.1:443
  1031. 2019-10-21 15:29:03,530 DEBUG akka.http.impl.engine.client.PoolGateway - InputBuffer (max-open-requests = 32) now filled with 1 request after enqueuing GET /api/v1/namespaces/default/pods Empty
  1032. 2019-10-21 15:29:03,554 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Unconnected)] Dispatching request [GET /api/v1/namespaces/default/pods Empty]
  1033. 2019-10-21 15:29:03,626 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Unconnected)] Before event [onNewRequest] In state [Unconnected] for [132 ms]
  1034. 2019-10-21 15:29:03,630 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Unconnected)] Establishing connection
  1035. 2019-10-21 15:29:03,762 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Looking up [Lookup(cart,None,Some(tcp))]
  1036. 2019-10-21 15:29:03,762 INFO  akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Querying for pods with label selector: [app=cart]. Namespace: [default]. Port: [None]
  1037. 2019-10-21 15:29:03,777 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] After event [onNewRequest] State change [Unconnected] -> [Connecting]
  1038. 2019-10-21 15:29:03,832 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (Unconnected)] Dispatching request [GET /api/v1/namespaces/default/pods Empty]
  1039. 2019-10-21 15:29:03,833 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (Unconnected)] Before event [onNewRequest] In state [Unconnected] for [401 ms]
  1040. 2019-10-21 15:29:03,833 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (Unconnected)] Establishing connection
  1041. 2019-10-21 15:29:03,835 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (Connecting)] After event [onNewRequest] State change [Unconnected] -> [Connecting]
  1042. 2019-10-21 15:29:03,863 DEBUG akka.io.TcpOutgoingConnection - Resolving 10.96.0.1 before connecting
  1043. 2019-10-21 15:29:03,928 DEBUG akka.io.TcpOutgoingConnection - Resolving 10.96.0.1 before connecting
  1044. 2019-10-21 15:29:04,226 DEBUG akka.io.SimpleDnsManager - Resolution request for 10.96.0.1 from Actor[akka://application/system/IO-TCP/selectors/$a/2#399152651]
  1045. 2019-10-21 15:29:04,434 DEBUG akka.io.SimpleDnsManager - Resolution request for 10.96.0.1 from Actor[akka://application/system/IO-TCP/selectors/$a/1#-1041973935]
  1046. 2019-10-21 15:29:04,439 DEBUG akka.io.TcpOutgoingConnection - Attempting connection to [/10.96.0.1:443]
  1047. 2019-10-21 15:29:04,440 DEBUG akka.io.TcpOutgoingConnection - Connection established to [10.96.0.1:443]
  1048. 2019-10-21 15:29:04,445 DEBUG akka.io.TcpOutgoingConnection - Attempting connection to [/10.96.0.1:443]
  1049. 2019-10-21 15:29:04,526 DEBUG akka.io.TcpOutgoingConnection - Connection established to [10.96.0.1:443]
  1050. 2019-10-21 15:29:04,526 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (Connecting)] Connection attempt succeeded
  1051. 2019-10-21 15:29:04,527 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (Connecting)] Before event [onConnectionAttemptSucceeded] In state [Connecting] for [616 ms]
  1052. 2019-10-21 15:29:04,528 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (Connecting)] Slot connection was established
  1053. 2019-10-21 15:29:04,528 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (PushingRequestToConnection)] After event [onConnectionAttemptSucceeded] State change [Connecting] -> [PushingRequestToConnection]
  1054. 2019-10-21 15:29:04,528 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  1055. 2019-10-21 15:29:04,528 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  1056. 2019-10-21 15:29:04,633 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] Connection attempt succeeded
  1057. 2019-10-21 15:29:04,633 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] Before event [onConnectionAttemptSucceeded] In state [Connecting] for [855 ms]
  1058. 2019-10-21 15:29:04,633 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] Slot connection was established
  1059. 2019-10-21 15:29:04,633 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onConnectionAttemptSucceeded] State change [Connecting] -> [PushingRequestToConnection]
  1060. 2019-10-21 15:29:04,633 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  1061. 2019-10-21 15:29:04,638 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  1062. 2019-10-21 15:29:05,736 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  1063. 2019-10-21 15:29:05,743 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [1110 ms]
  1064. 2019-10-21 15:29:05,743 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  1065. 2019-10-21 15:29:05,744 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  1066. 2019-10-21 15:29:05,744 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  1067. 2019-10-21 15:29:05,745 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  1068. 2019-10-21 15:29:05,747 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForResponse)] Received response
  1069. 2019-10-21 15:29:05,748 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [1294 ms]
  1070. 2019-10-21 15:29:05,748 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  1071. 2019-10-21 15:29:05,748 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  1072. 2019-10-21 15:29:05,748 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  1073. 2019-10-21 15:29:05,748 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  1074. 2019-10-21 15:29:05,754 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [5 ms]
  1075. 2019-10-21 15:29:05,755 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  1076. 2019-10-21 15:29:05,755 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [10 ms]
  1077. 2019-10-21 15:29:05,825 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  1078. 2019-10-21 15:29:05,826 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [1 ms]
  1079. 2019-10-21 15:29:05,830 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  1080. 2019-10-21 15:29:05,834 DEBUG akka.http.impl.engine.client.PoolGateway - [1 (Idle)] Slot became idle... Trying to pull
  1081. 2019-10-21 15:29:05,835 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [2 ms]
  1082. 2019-10-21 15:29:05,836 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  1083. 2019-10-21 15:29:05,837 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  1084. 2019-10-21 15:29:05,837 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Kubernetes API entity: [{"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces/default/pods","resourceVersion":"42502"},"items":[{"metadata":{"name":"cart-5cc9dc46ff-vd4kx","generateName":"cart-5cc9dc46ff-","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/cart-5cc9dc46ff-vd4kx","uid":"80fda555-a4fb-477f-8813-f7c11b95d0b0","resourceVersion":"42487","creationTimestamp":"2019-10-21T15:28:52Z","labels":{"app":"cart","app.kubernetes.io/chartVersion":"0.1.0","app.kubernetes.io/imageTag":"97dd28b69615d2452a3ef11c1a4192d11523cb20","app.kubernetes.io/instance":"cart","app.kubernetes.io/managed-by":"Tiller","app.kubernetes.io/name":"cart","app.kubernetes.io/part-of":"backend","app.kubernetes.io/version":"97dd28b69615d2452a3ef11c1a4192d11523cb20","helm.sh/chart":"cart-0.1.0","pod-template-hash":"5cc9dc46ff"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"cart-5cc9dc46ff","uid":"ddc4d2f9-5f71-4f7d-99bf-83b39f929f76","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-s9gwc","secret":{"secretName":"default-token-s9gwc","defaultMode":420}}],"containers":[{"name":"cart","image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","ports":[{"name":"http","containerPort":9000,"protocol":"TCP"},{"name":"management","containerPort":8558,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"common-service-config"}},{"configMapRef":{"name":"cart-config"}}],"env":[{"name":"CLUSTER_BOOTSTRAP_SERVICE_NAME","value":"cart"},{"name":"CLUSTER_BOOTSTRAP_CONTACT_POINT_NR","value":"1"},{"name":"JAVA_OPTS","value":"-Xms256m -Xmx256m -Dconfig.resource=prod-application.conf"},{"name":"PLAY_HTTP_SECRET_KEY","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"http.play.secretKey"}}},{"name":"DB_USER","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.user"}}},{"name":"DB_PASS","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.password"}}}],"resources":{"limits":{"cpu":"500m"},"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"default-token-s9gwc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/alive","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"readinessProbe":{"httpGet":{"path":"/ready","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Never"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"minikube","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"}],"hostIP":"10.0.2.15","podIP":"172.17.0.4","startTime":"2019-10-21T15:28:52Z","containerStatuses":[{"name":"cart","state":{"running":{"startedAt":"2019-10-21T15:28:53Z"}},"lastState":{},"ready":false,"restartCount":0,"image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","imageID":"docker://sha256:738a509b000132c58685974f4474e1e63fb31ea980d1f7acfcbc02c4cb0c4db4","containerID":"docker://405c46b2f8d8e9ae28d82d321dabaf4e269f9badc854eca14690a2f4b0c90e18"}],"qosClass":"Burstable"}}]}
  1085. ]
  1086. 2019-10-21 15:29:05,838 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Kubernetes API entity: [{"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces/default/pods","resourceVersion":"42502"},"items":[{"metadata":{"name":"cart-5cc9dc46ff-vd4kx","generateName":"cart-5cc9dc46ff-","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/cart-5cc9dc46ff-vd4kx","uid":"80fda555-a4fb-477f-8813-f7c11b95d0b0","resourceVersion":"42487","creationTimestamp":"2019-10-21T15:28:52Z","labels":{"app":"cart","app.kubernetes.io/chartVersion":"0.1.0","app.kubernetes.io/imageTag":"97dd28b69615d2452a3ef11c1a4192d11523cb20","app.kubernetes.io/instance":"cart","app.kubernetes.io/managed-by":"Tiller","app.kubernetes.io/name":"cart","app.kubernetes.io/part-of":"backend","app.kubernetes.io/version":"97dd28b69615d2452a3ef11c1a4192d11523cb20","helm.sh/chart":"cart-0.1.0","pod-template-hash":"5cc9dc46ff"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"cart-5cc9dc46ff","uid":"ddc4d2f9-5f71-4f7d-99bf-83b39f929f76","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-s9gwc","secret":{"secretName":"default-token-s9gwc","defaultMode":420}}],"containers":[{"name":"cart","image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","ports":[{"name":"http","containerPort":9000,"protocol":"TCP"},{"name":"management","containerPort":8558,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"common-service-config"}},{"configMapRef":{"name":"cart-config"}}],"env":[{"name":"CLUSTER_BOOTSTRAP_SERVICE_NAME","value":"cart"},{"name":"CLUSTER_BOOTSTRAP_CONTACT_POINT_NR","value":"1"},{"name":"JAVA_OPTS","value":"-Xms256m -Xmx256m -Dconfig.resource=prod-application.conf"},{"name":"PLAY_HTTP_SECRET_KEY","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"http.play.secretKey"}}},{"name":"DB_USER","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.user"}}},{"name":"DB_PASS","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.password"}}}],"resources":{"limits":{"cpu":"500m"},"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"default-token-s9gwc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/alive","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"readinessProbe":{"httpGet":{"path":"/ready","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Never"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"minikube","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"}],"hostIP":"10.0.2.15","podIP":"172.17.0.4","startTime":"2019-10-21T15:28:52Z","containerStatuses":[{"name":"cart","state":{"running":{"startedAt":"2019-10-21T15:28:53Z"}},"lastState":{},"ready":false,"restartCount":0,"image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","imageID":"docker://sha256:738a509b000132c58685974f4474e1e63fb31ea980d1f7acfcbc02c4cb0c4db4","containerID":"docker://405c46b2f8d8e9ae28d82d321dabaf4e269f9badc854eca14690a2f4b0c90e18"}],"qosClass":"Burstable"}}]}
  1087. ]
  1088. 2019-10-21 15:29:06,502 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Located service members based on: [Lookup(cart,None,Some(tcp))]: [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))], filtered to [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))]
  1089. 2019-10-21 15:29:06,570 DEBUG akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Ensuring probing actor: contactPointProbe-172-17-0-4.default.pod.cluster.local-8558
  1090. 2019-10-21 15:29:06,624 DEBUG akka.actor.TimerScheduler - Start timer [resolve-key] with generation [3]
  1091. 2019-10-21 15:29:06,625 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Located service members based on: [Lookup(cart,None,Some(tcp))]: [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))], filtered to [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))]
  1092. 2019-10-21 15:29:06,625 DEBUG akka.management.cluster.bootstrap.internal.HttpContactPointBootstrap - Probing [http://172-17-0-4.default.pod.cluster.local:8558/bootstrap/seed-nodes] for seed nodes...
  1093. 2019-10-21 15:29:06,626 DEBUG akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Ensuring probing actor: contactPointProbe-172-17-0-4.default.pod.cluster.local-8558
  1094. 2019-10-21 15:29:06,627 DEBUG akka.actor.TimerScheduler - Cancel timer [resolve-key] with generation [3]
  1095. 2019-10-21 15:29:06,629 DEBUG akka.actor.TimerScheduler - Start timer [resolve-key] with generation [4]
  1096. 2019-10-21 15:29:06,634 DEBUG akka.http.impl.engine.client.PoolGateway - (Re-)starting host connection pool to 172-17-0-4.default.pod.cluster.local:8558
  1097. 2019-10-21 15:29:06,641 DEBUG akka.http.impl.engine.client.PoolGateway - InputBuffer (max-open-requests = 32) now filled with 1 request after enqueuing GET /bootstrap/seed-nodes Empty
  1098. 2019-10-21 15:29:06,642 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Unconnected)] Dispatching request [GET /bootstrap/seed-nodes Empty]
  1099. 2019-10-21 15:29:06,642 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Unconnected)] Before event [onNewRequest] In state [Unconnected] for [1 ms]
  1100. 2019-10-21 15:29:06,642 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Unconnected)] Establishing connection
  1101. 2019-10-21 15:29:06,643 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] After event [onNewRequest] State change [Unconnected] -> [Connecting]
  1102. 2019-10-21 15:29:06,646 DEBUG akka.io.TcpOutgoingConnection - Resolving 172-17-0-4.default.pod.cluster.local before connecting
  1103. 2019-10-21 15:29:06,646 DEBUG akka.io.SimpleDnsManager - Resolution request for 172-17-0-4.default.pod.cluster.local from Actor[akka://application/system/IO-TCP/selectors/$a/3#-1094176514]
  1104. 2019-10-21 15:29:06,801 INFO  akka.management.cluster.bootstrap.LowestAddressJoinDecider - Discovered [1] contact points, confirmed [0], which is less than the required [1], retrying
  1105. 2019-10-21 15:29:06,891 DEBUG akka.io.TcpOutgoingConnection - Attempting connection to [172-17-0-4.default.pod.cluster.local/172.17.0.4:8558]
  1106. 2019-10-21 15:29:06,893 DEBUG akka.io.TcpOutgoingConnection - Connection established to [172-17-0-4.default.pod.cluster.local:8558]
  1107. 2019-10-21 15:29:06,895 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] Connection attempt succeeded
  1108. 2019-10-21 15:29:06,895 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] Before event [onConnectionAttemptSucceeded] In state [Connecting] for [251 ms]
  1109. 2019-10-21 15:29:06,895 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] Slot connection was established
  1110. 2019-10-21 15:29:06,895 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onConnectionAttemptSucceeded] State change [Connecting] -> [PushingRequestToConnection]
  1111. 2019-10-21 15:29:06,895 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  1112. 2019-10-21 15:29:06,895 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  1113. 2019-10-21 15:29:06,903 DEBUG akka.io.TcpListener - New connection accepted
  1114. 2019-10-21 15:29:07,251 DEBUG akka.serialization.Serialization(akka://application) - Using serializer [akka.cluster.ddata.protobuf.ReplicatorMessageSerializer] for message [akka.cluster.ddata.Replicator$Internal$DataEnvelope]
  1115. 2019-10-21 15:29:07,256 DEBUG akka.cluster.sharding.ShardRegion - CartProcessor: Request shard [eventworld.cart.impl.evt$CartEvent] home. Coordinator [None]
  1116. 2019-10-21 15:29:07,413 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Singleton not available, buffering message type [com.lightbend.lagom.internal.persistence.cluster.ClusterStartupTaskActor$Execute$]
  1117. 2019-10-21 15:29:07,659 INFO  akka.management.cluster.bootstrap.contactpoint.HttpClusterBootstrapRoutes - Bootstrap request from 172.17.0.4:44046: Contact Point returning 0 seed-nodes ([TreeSet()])
  1118. 2019-10-21 15:29:07,683 INFO  akka.management.cluster.bootstrap.LowestAddressJoinDecider - Discovered [1] contact points, confirmed [0], which is less than the required [1], retrying
  1119. 2019-10-21 15:29:07,828 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  1120. 2019-10-21 15:29:07,834 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [934 ms]
  1121. 2019-10-21 15:29:07,834 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  1122. 2019-10-21 15:29:07,834 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  1123. 2019-10-21 15:29:07,835 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  1124. 2019-10-21 15:29:07,835 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  1125. 2019-10-21 15:29:07,835 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [0 ms]
  1126. 2019-10-21 15:29:07,836 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  1127. 2019-10-21 15:29:07,836 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  1128. 2019-10-21 15:29:07,836 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  1129. 2019-10-21 15:29:07,836 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  1130. 2019-10-21 15:29:07,837 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Looking up [Lookup(cart,None,Some(tcp))]
  1131. 2019-10-21 15:29:07,837 INFO  akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Querying for pods with label selector: [app=cart]. Namespace: [default]. Port: [None]
  1132. 2019-10-21 15:29:07,842 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /api/v1/namespaces/default/pods Empty]
  1133. 2019-10-21 15:29:07,842 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [2084 ms]
  1134. 2019-10-21 15:29:07,842 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  1135. 2019-10-21 15:29:07,843 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  1136. 2019-10-21 15:29:07,843 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  1137. 2019-10-21 15:29:07,847 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Contact point [akka.tcp://application@172.17.0.4:2552] returned [0] seed-nodes []
  1138. 2019-10-21 15:29:07,849 DEBUG akka.actor.TimerScheduler - Start timer [probing-key] with generation [1]
  1139. 2019-10-21 15:29:07,851 DEBUG akka.discovery.dns.DnsServiceDiscovery - system resolver is not async-dns. Loading isolated resolver
  1140. 2019-10-21 15:29:07,853 INFO  akka.actor.ActorSystemImpl - Creating async dns resolver async-dns with manager name SD-DNS
  1141. 2019-10-21 15:29:07,953 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  1142. 2019-10-21 15:29:07,954 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [111 ms]
  1143. 2019-10-21 15:29:07,954 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  1144. 2019-10-21 15:29:07,954 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  1145. 2019-10-21 15:29:07,954 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  1146. 2019-10-21 15:29:07,955 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  1147. 2019-10-21 15:29:07,956 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [1 ms]
  1148. 2019-10-21 15:29:07,956 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  1149. 2019-10-21 15:29:07,957 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  1150. 2019-10-21 15:29:07,957 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  1151. 2019-10-21 15:29:07,957 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  1152. 2019-10-21 15:29:07,957 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Kubernetes API entity: [{"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces/default/pods","resourceVersion":"42506"},"items":[{"metadata":{"name":"cart-5cc9dc46ff-vd4kx","generateName":"cart-5cc9dc46ff-","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/cart-5cc9dc46ff-vd4kx","uid":"80fda555-a4fb-477f-8813-f7c11b95d0b0","resourceVersion":"42487","creationTimestamp":"2019-10-21T15:28:52Z","labels":{"app":"cart","app.kubernetes.io/chartVersion":"0.1.0","app.kubernetes.io/imageTag":"97dd28b69615d2452a3ef11c1a4192d11523cb20","app.kubernetes.io/instance":"cart","app.kubernetes.io/managed-by":"Tiller","app.kubernetes.io/name":"cart","app.kubernetes.io/part-of":"backend","app.kubernetes.io/version":"97dd28b69615d2452a3ef11c1a4192d11523cb20","helm.sh/chart":"cart-0.1.0","pod-template-hash":"5cc9dc46ff"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"cart-5cc9dc46ff","uid":"ddc4d2f9-5f71-4f7d-99bf-83b39f929f76","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-s9gwc","secret":{"secretName":"default-token-s9gwc","defaultMode":420}}],"containers":[{"name":"cart","image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","ports":[{"name":"http","containerPort":9000,"protocol":"TCP"},{"name":"management","containerPort":8558,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"common-service-config"}},{"configMapRef":{"name":"cart-config"}}],"env":[{"name":"CLUSTER_BOOTSTRAP_SERVICE_NAME","value":"cart"},{"name":"CLUSTER_BOOTSTRAP_CONTACT_POINT_NR","value":"1"},{"name":"JAVA_OPTS","value":"-Xms256m -Xmx256m -Dconfig.resource=prod-application.conf"},{"name":"PLAY_HTTP_SECRET_KEY","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"http.play.secretKey"}}},{"name":"DB_USER","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.user"}}},{"name":"DB_PASS","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.password"}}}],"resources":{"limits":{"cpu":"500m"},"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"default-token-s9gwc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/alive","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"readinessProbe":{"httpGet":{"path":"/ready","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Never"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"minikube","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"}],"hostIP":"10.0.2.15","podIP":"172.17.0.4","startTime":"2019-10-21T15:28:52Z","containerStatuses":[{"name":"cart","state":{"running":{"startedAt":"2019-10-21T15:28:53Z"}},"lastState":{},"ready":false,"restartCount":0,"image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","imageID":"docker://sha256:738a509b000132c58685974f4474e1e63fb31ea980d1f7acfcbc02c4cb0c4db4","containerID":"docker://405c46b2f8d8e9ae28d82d321dabaf4e269f9badc854eca14690a2f4b0c90e18"}],"qosClass":"Burstable"}}]}
  1153. ]
  1154. 2019-10-21 15:29:07,958 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Located service members based on: [Lookup(cart,None,Some(tcp))]: [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))], filtered to [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))]
  1155. 2019-10-21 15:29:07,958 DEBUG akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Ensuring probing actor: contactPointProbe-172-17-0-4.default.pod.cluster.local-8558
  1156. 2019-10-21 15:29:07,958 DEBUG akka.actor.TimerScheduler - Start timer [resolve-key] with generation [5]
  1157. 2019-10-21 15:29:08,030 DEBUG akka.io.dns.internal.AsyncDnsResolver - Using name servers [List(/10.96.0.10:53)] and search domains [List(default.svc.cluster.local, svc.cluster.local, cluster.local)] with ndots=5
  1158. 2019-10-21 15:29:08,081 DEBUG akka.actor.TimerScheduler - Start timer [CacheCleanup] with generation [1]
  1159. 2019-10-21 15:29:08,211 DEBUG akka.io.UdpListener - Successfully bound to [/0.0.0.0:37169]
  1160. 2019-10-21 15:29:08,219 DEBUG akka.io.dns.internal.DnsClient - Bound to UDP address [/0.0.0.0:37169]
  1161. 2019-10-21 15:29:08,684 DEBUG akka.management.cluster.bootstrap.LowestAddressJoinDecider - Contact points observations have changed more recently than the stable-margin [5000 milliseconds], changed at [2019-10-21T15:29:06.501], not joining myself. This process will be retried.
  1162. 2019-10-21 15:29:09,023 DEBUG akka.management.cluster.bootstrap.internal.HttpContactPointBootstrap - Probing [http://172-17-0-4.default.pod.cluster.local:8558/bootstrap/seed-nodes] for seed nodes...
  1163. 2019-10-21 15:29:09,055 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /bootstrap/seed-nodes Empty]
  1164. 2019-10-21 15:29:09,055 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1224 ms]
  1165. 2019-10-21 15:29:09,056 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  1166. 2019-10-21 15:29:09,056 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  1167. 2019-10-21 15:29:09,056 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  1168. 2019-10-21 15:29:09,163 INFO  akka.management.cluster.bootstrap.contactpoint.HttpClusterBootstrapRoutes - Bootstrap request from 172.17.0.4:44046: Contact Point returning 0 seed-nodes ([TreeSet()])
  1169. 2019-10-21 15:29:09,171 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  1170. 2019-10-21 15:29:09,172 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [116 ms]
  1171. 2019-10-21 15:29:09,172 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  1172. 2019-10-21 15:29:09,172 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  1173. 2019-10-21 15:29:09,172 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  1174. 2019-10-21 15:29:09,172 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  1175. 2019-10-21 15:29:09,173 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [0 ms]
  1176. 2019-10-21 15:29:09,173 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  1177. 2019-10-21 15:29:09,173 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  1178. 2019-10-21 15:29:09,173 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  1179. 2019-10-21 15:29:09,173 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  1180. 2019-10-21 15:29:09,174 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Looking up [Lookup(cart,None,Some(tcp))]
  1181. 2019-10-21 15:29:09,174 INFO  akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Querying for pods with label selector: [app=cart]. Namespace: [default]. Port: [None]
  1182. 2019-10-21 15:29:09,175 DEBUG akka.actor.TimerScheduler - Start timer [probing-key] with generation [2]
  1183. 2019-10-21 15:29:09,175 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Contact point [akka.tcp://application@172.17.0.4:2552] returned [0] seed-nodes []
  1184. 2019-10-21 15:29:09,182 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /api/v1/namespaces/default/pods Empty]
  1185. 2019-10-21 15:29:09,183 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1224 ms]
  1186. 2019-10-21 15:29:09,183 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  1187. 2019-10-21 15:29:09,183 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  1188. 2019-10-21 15:29:09,183 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  1189. 2019-10-21 15:29:09,309 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  1190. 2019-10-21 15:29:09,309 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [127 ms]
  1191. 2019-10-21 15:29:09,309 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  1192. 2019-10-21 15:29:09,309 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  1193. 2019-10-21 15:29:09,313 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  1194. 2019-10-21 15:29:09,313 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  1195. 2019-10-21 15:29:09,320 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [11 ms]
  1196. 2019-10-21 15:29:09,320 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  1197. 2019-10-21 15:29:09,321 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  1198. 2019-10-21 15:29:09,321 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  1199. 2019-10-21 15:29:09,322 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  1200. 2019-10-21 15:29:09,322 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Kubernetes API entity: [{"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces/default/pods","resourceVersion":"42508"},"items":[{"metadata":{"name":"cart-5cc9dc46ff-vd4kx","generateName":"cart-5cc9dc46ff-","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/cart-5cc9dc46ff-vd4kx","uid":"80fda555-a4fb-477f-8813-f7c11b95d0b0","resourceVersion":"42487","creationTimestamp":"2019-10-21T15:28:52Z","labels":{"app":"cart","app.kubernetes.io/chartVersion":"0.1.0","app.kubernetes.io/imageTag":"97dd28b69615d2452a3ef11c1a4192d11523cb20","app.kubernetes.io/instance":"cart","app.kubernetes.io/managed-by":"Tiller","app.kubernetes.io/name":"cart","app.kubernetes.io/part-of":"backend","app.kubernetes.io/version":"97dd28b69615d2452a3ef11c1a4192d11523cb20","helm.sh/chart":"cart-0.1.0","pod-template-hash":"5cc9dc46ff"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"cart-5cc9dc46ff","uid":"ddc4d2f9-5f71-4f7d-99bf-83b39f929f76","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-s9gwc","secret":{"secretName":"default-token-s9gwc","defaultMode":420}}],"containers":[{"name":"cart","image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","ports":[{"name":"http","containerPort":9000,"protocol":"TCP"},{"name":"management","containerPort":8558,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"common-service-config"}},{"configMapRef":{"name":"cart-config"}}],"env":[{"name":"CLUSTER_BOOTSTRAP_SERVICE_NAME","value":"cart"},{"name":"CLUSTER_BOOTSTRAP_CONTACT_POINT_NR","value":"1"},{"name":"JAVA_OPTS","value":"-Xms256m -Xmx256m -Dconfig.resource=prod-application.conf"},{"name":"PLAY_HTTP_SECRET_KEY","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"http.play.secretKey"}}},{"name":"DB_USER","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.user"}}},{"name":"DB_PASS","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.password"}}}],"resources":{"limits":{"cpu":"500m"},"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"default-token-s9gwc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/alive","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"readinessProbe":{"httpGet":{"path":"/ready","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Never"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"minikube","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"}],"hostIP":"10.0.2.15","podIP":"172.17.0.4","startTime":"2019-10-21T15:28:52Z","containerStatuses":[{"name":"cart","state":{"running":{"startedAt":"2019-10-21T15:28:53Z"}},"lastState":{},"ready":false,"restartCount":0,"image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","imageID":"docker://sha256:738a509b000132c58685974f4474e1e63fb31ea980d1f7acfcbc02c4cb0c4db4","containerID":"docker://405c46b2f8d8e9ae28d82d321dabaf4e269f9badc854eca14690a2f4b0c90e18"}],"qosClass":"Burstable"}}]}
  1201. ]
  1202. 2019-10-21 15:29:09,323 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Located service members based on: [Lookup(cart,None,Some(tcp))]: [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))], filtered to [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))]
  1203. 2019-10-21 15:29:09,323 DEBUG akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Ensuring probing actor: contactPointProbe-172-17-0-4.default.pod.cluster.local-8558
  1204. 2019-10-21 15:29:09,323 DEBUG akka.actor.TimerScheduler - Start timer [resolve-key] with generation [6]
  1205. 2019-10-21 15:29:09,657 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart: Request shard [singleton] home. Coordinator [None]
  1206. 2019-10-21 15:29:09,660 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_reservation: Request shard [singleton] home. Coordinator [None]
  1207. 2019-10-21 15:29:09,662 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_price_offer: Request shard [singleton] home. Coordinator [None]
  1208. 2019-10-21 15:29:09,683 DEBUG akka.management.cluster.bootstrap.LowestAddressJoinDecider - Contact points observations have changed more recently than the stable-margin [5000 milliseconds], changed at [2019-10-21T15:29:06.501], not joining myself. This process will be retried.
  1209. 2019-10-21 15:29:10,030 DEBUG akka.kafka.internal.KafkaConsumerActor - Creating Kafka consumer with akka.kafka.ConsumerSettings(properties=auto.offset.reset -> earliest,group.id -> cart,bootstrap.servers -> kafka:9092,enable.auto.commit -> false,client.id -> cart-2,keyDeserializer=Some(org.apache.kafka.common.serialization.StringDeserializer@7ee2f76f),valueDeserializer=Some(com.lightbend.lagom.internal.scaladsl.broker.kafka.ScaladslKafkaDeserializer@702516c3),pollInterval=1 second,pollTimeout=50 milliseconds,stopTimeout=30 seconds,closeTimeout=20 seconds,commitTimeout=15 seconds,commitRefreshInterval=Duration.Inf,dispatcher=akka.kafka.default-dispatcher,commitTimeWarning=1 second,waitClosePartition=500 milliseconds,metadataRequestTimeout=5 seconds)
  1210. 2019-10-21 15:29:10,031 DEBUG akka.kafka.internal.KafkaConsumerActor - Creating Kafka consumer with akka.kafka.ConsumerSettings(properties=auto.offset.reset -> earliest,group.id -> cart,bootstrap.servers -> kafka:9092,enable.auto.commit -> false,client.id -> cart-3,keyDeserializer=Some(org.apache.kafka.common.serialization.StringDeserializer@25a17c5b),valueDeserializer=Some(com.lightbend.lagom.internal.scaladsl.broker.kafka.ScaladslKafkaDeserializer@2b66969f),pollInterval=1 second,pollTimeout=50 milliseconds,stopTimeout=30 seconds,closeTimeout=20 seconds,commitTimeout=15 seconds,commitRefreshInterval=Duration.Inf,dispatcher=akka.kafka.default-dispatcher,commitTimeWarning=1 second,waitClosePartition=500 milliseconds,metadataRequestTimeout=5 seconds)
  1211. 2019-10-21 15:29:10,033 DEBUG akka.kafka.internal.KafkaConsumerActor - Creating Kafka consumer with akka.kafka.ConsumerSettings(properties=auto.offset.reset -> earliest,group.id -> cart,bootstrap.servers -> kafka:9092,enable.auto.commit -> false,client.id -> cart-1,keyDeserializer=Some(org.apache.kafka.common.serialization.StringDeserializer@11171e5),valueDeserializer=Some(com.lightbend.lagom.internal.scaladsl.broker.kafka.ScaladslKafkaDeserializer@2acddaaf),pollInterval=1 second,pollTimeout=50 milliseconds,stopTimeout=30 seconds,closeTimeout=20 seconds,commitTimeout=15 seconds,commitRefreshInterval=Duration.Inf,dispatcher=akka.kafka.default-dispatcher,commitTimeWarning=1 second,waitClosePartition=500 milliseconds,metadataRequestTimeout=5 seconds)
  1212. 2019-10-21 15:29:10,204 DEBUG akka.management.cluster.bootstrap.internal.HttpContactPointBootstrap - Probing [http://172-17-0-4.default.pod.cluster.local:8558/bootstrap/seed-nodes] for seed nodes...
  1213. 2019-10-21 15:29:10,206 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /bootstrap/seed-nodes Empty]
  1214. 2019-10-21 15:29:10,206 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1031 ms]
  1215. 2019-10-21 15:29:10,206 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  1216. 2019-10-21 15:29:10,206 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  1217. 2019-10-21 15:29:10,206 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  1218. 2019-10-21 15:29:10,225 INFO  akka.management.cluster.bootstrap.contactpoint.HttpClusterBootstrapRoutes - Bootstrap request from 172.17.0.4:44046: Contact Point returning 0 seed-nodes ([TreeSet()])
  1219. 2019-10-21 15:29:10,228 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  1220. 2019-10-21 15:29:10,228 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [21 ms]
  1221. 2019-10-21 15:29:10,228 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  1222. 2019-10-21 15:29:10,228 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  1223. 2019-10-21 15:29:10,228 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  1224. 2019-10-21 15:29:10,236 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  1225. 2019-10-21 15:29:10,236 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [0 ms]
  1226. 2019-10-21 15:29:10,236 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  1227. 2019-10-21 15:29:10,236 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  1228. 2019-10-21 15:29:10,236 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  1229. 2019-10-21 15:29:10,237 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  1230. 2019-10-21 15:29:10,237 DEBUG akka.actor.TimerScheduler - Start timer [probing-key] with generation [3]
  1231. 2019-10-21 15:29:10,237 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Contact point [akka.tcp://application@172.17.0.4:2552] returned [0] seed-nodes []
  1232. 2019-10-21 15:29:10,486 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Looking up [Lookup(cart,None,Some(tcp))]
  1233. 2019-10-21 15:29:10,486 INFO  akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Querying for pods with label selector: [app=cart]. Namespace: [default]. Port: [None]
  1234. 2019-10-21 15:29:10,487 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /api/v1/namespaces/default/pods Empty]
  1235. 2019-10-21 15:29:10,487 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1166 ms]
  1236. 2019-10-21 15:29:10,488 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  1237. 2019-10-21 15:29:10,488 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  1238. 2019-10-21 15:29:10,496 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  1239. 2019-10-21 15:29:10,683 DEBUG akka.management.cluster.bootstrap.LowestAddressJoinDecider - Contact points observations have changed more recently than the stable-margin [5000 milliseconds], changed at [2019-10-21T15:29:06.501], not joining myself. This process will be retried.
  1240. 2019-10-21 15:29:10,739 DEBUG akka.io.TcpListener - Successfully bound to /0.0.0.0:9000
  1241. 2019-10-21 15:29:10,761 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  1242. 2019-10-21 15:29:10,763 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [273 ms]
  1243. 2019-10-21 15:29:10,764 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  1244. 2019-10-21 15:29:10,766 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  1245. 2019-10-21 15:29:10,766 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [1 ms]
  1246. 2019-10-21 15:29:10,787 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  1247. 2019-10-21 15:29:10,788 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [4 ms]
  1248. 2019-10-21 15:29:10,789 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  1249. 2019-10-21 15:29:10,790 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Kubernetes API entity: [{"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces/default/pods","resourceVersion":"42508"},"items":[{"metadata":{"name":"cart-5cc9dc46ff-vd4kx","generateName":"cart-5cc9dc46ff-","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/cart-5cc9dc46ff-vd4kx","uid":"80fda555-a4fb-477f-8813-f7c11b95d0b0","resourceVersion":"42487","creationTimestamp":"2019-10-21T15:28:52Z","labels":{"app":"cart","app.kubernetes.io/chartVersion":"0.1.0","app.kubernetes.io/imageTag":"97dd28b69615d2452a3ef11c1a4192d11523cb20","app.kubernetes.io/instance":"cart","app.kubernetes.io/managed-by":"Tiller","app.kubernetes.io/name":"cart","app.kubernetes.io/part-of":"backend","app.kubernetes.io/version":"97dd28b69615d2452a3ef11c1a4192d11523cb20","helm.sh/chart":"cart-0.1.0","pod-template-hash":"5cc9dc46ff"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"cart-5cc9dc46ff","uid":"ddc4d2f9-5f71-4f7d-99bf-83b39f929f76","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-s9gwc","secret":{"secretName":"default-token-s9gwc","defaultMode":420}}],"containers":[{"name":"cart","image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","ports":[{"name":"http","containerPort":9000,"protocol":"TCP"},{"name":"management","containerPort":8558,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"common-service-config"}},{"configMapRef":{"name":"cart-config"}}],"env":[{"name":"CLUSTER_BOOTSTRAP_SERVICE_NAME","value":"cart"},{"name":"CLUSTER_BOOTSTRAP_CONTACT_POINT_NR","value":"1"},{"name":"JAVA_OPTS","value":"-Xms256m -Xmx256m -Dconfig.resource=prod-application.conf"},{"name":"PLAY_HTTP_SECRET_KEY","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"http.play.secretKey"}}},{"name":"DB_USER","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.user"}}},{"name":"DB_PASS","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.password"}}}],"resources":{"limits":{"cpu":"500m"},"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"default-token-s9gwc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/alive","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"readinessProbe":{"httpGet":{"path":"/ready","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Never"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"minikube","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"}],"hostIP":"10.0.2.15","podIP":"172.17.0.4","startTime":"2019-10-21T15:28:52Z","containerStatuses":[{"name":"cart","state":{"running":{"startedAt":"2019-10-21T15:28:53Z"}},"lastState":{},"ready":false,"restartCount":0,"image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","imageID":"docker://sha256:738a509b000132c58685974f4474e1e63fb31ea980d1f7acfcbc02c4cb0c4db4","containerID":"docker://405c46b2f8d8e9ae28d82d321dabaf4e269f9badc854eca14690a2f4b0c90e18"}],"qosClass":"Burstable"}}]}
  1250. ]
  1251. 2019-10-21 15:29:10,793 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [3 ms]
  1252. 2019-10-21 15:29:10,803 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  1253. 2019-10-21 15:29:10,803 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Located service members based on: [Lookup(cart,None,Some(tcp))]: [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))], filtered to [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))]
  1254. 2019-10-21 15:29:10,808 DEBUG akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Ensuring probing actor: contactPointProbe-172-17-0-4.default.pod.cluster.local-8558
  1255. 2019-10-21 15:29:10,808 DEBUG akka.actor.TimerScheduler - Start timer [resolve-key] with generation [7]
  1256. 2019-10-21 15:29:10,808 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  1257. 2019-10-21 15:29:11,304 DEBUG akka.management.cluster.bootstrap.internal.HttpContactPointBootstrap - Probing [http://172-17-0-4.default.pod.cluster.local:8558/bootstrap/seed-nodes] for seed nodes...
  1258. 2019-10-21 15:29:11,310 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /bootstrap/seed-nodes Empty]
  1259. 2019-10-21 15:29:11,310 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1078 ms]
  1260. 2019-10-21 15:29:11,310 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  1261. 2019-10-21 15:29:11,310 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  1262. 2019-10-21 15:29:11,310 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  1263. 2019-10-21 15:29:11,348 INFO  akka.management.cluster.bootstrap.contactpoint.HttpClusterBootstrapRoutes - Bootstrap request from 172.17.0.4:44046: Contact Point returning 0 seed-nodes ([TreeSet()])
  1264. 2019-10-21 15:29:11,358 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  1265. 2019-10-21 15:29:11,358 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [44 ms]
  1266. 2019-10-21 15:29:11,359 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  1267. 2019-10-21 15:29:11,359 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  1268. 2019-10-21 15:29:11,359 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  1269. 2019-10-21 15:29:11,361 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  1270. 2019-10-21 15:29:11,363 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [0 ms]
  1271. 2019-10-21 15:29:11,363 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  1272. 2019-10-21 15:29:11,364 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  1273. 2019-10-21 15:29:11,364 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  1274. 2019-10-21 15:29:11,364 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  1275. 2019-10-21 15:29:11,365 DEBUG akka.actor.TimerScheduler - Start timer [probing-key] with generation [4]
  1276. 2019-10-21 15:29:11,365 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Contact point [akka.tcp://application@172.17.0.4:2552] returned [0] seed-nodes []
  1277. 2019-10-21 15:29:11,491 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [1]
  1278. 2019-10-21 15:29:11,498 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [1]
  1279. 2019-10-21 15:29:11,500 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [1]
  1280. 2019-10-21 15:29:12,033 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Looking up [Lookup(cart,None,Some(tcp))]
  1281. 2019-10-21 15:29:12,034 INFO  akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Querying for pods with label selector: [app=cart]. Namespace: [default]. Port: [None]
  1282. 2019-10-21 15:29:12,036 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /api/v1/namespaces/default/pods Empty]
  1283. 2019-10-21 15:29:12,036 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1263 ms]
  1284. 2019-10-21 15:29:12,036 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  1285. 2019-10-21 15:29:12,036 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  1286. 2019-10-21 15:29:12,036 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  1287. 2019-10-21 15:29:12,045 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Initiating new cluster, self-joining [akka.tcp://application@172.17.0.4:2552]. Other nodes are expected to locate this cluster via continued contact-point probing.
  1288. 2019-10-21 15:29:12,118 DEBUG akka.actor.TimerScheduler - Cancel all timers
  1289. 2019-10-21 15:29:12,120 DEBUG akka.actor.TimerScheduler - Cancel all timers
  1290. 2019-10-21 15:29:12,122 INFO  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Node [akka.tcp://application@172.17.0.4:2552] is JOINING itself (with roles [dc-default]) and forming new cluster
  1291. 2019-10-21 15:29:12,127 INFO  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - is the new leader among reachable nodes (more leaders may exist)
  1292. 2019-10-21 15:29:12,266 INFO  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Leader is moving node [akka.tcp://application@172.17.0.4:2552] to [Up]
  1293. 2019-10-21 15:29:12,269 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Creating singleton identification timer...
  1294. 2019-10-21 15:29:12,271 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_reservation: Coordinator moved from [] to [akka.tcp://application@172.17.0.4:2552]
  1295. 2019-10-21 15:29:12,272 DEBUG akka.cluster.sharding.ShardRegion - CartProcessor: Coordinator moved from [] to [akka.tcp://application@172.17.0.4:2552]
  1296. 2019-10-21 15:29:12,276 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Trying to identify singleton at [akka.tcp://application@172.17.0.4:2552/user/jdbcCreateTables-singleton/singleton]
  1297. 2019-10-21 15:29:12,277 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Creating singleton identification timer...
  1298. 2019-10-21 15:29:12,279 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_price_offer: Coordinator moved from [] to [akka.tcp://application@172.17.0.4:2552]
  1299. 2019-10-21 15:29:12,281 DEBUG akka.cluster.sharding.ShardRegion - CartAggregate: Coordinator moved from [] to [akka.tcp://application@172.17.0.4:2552]
  1300. 2019-10-21 15:29:12,282 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Creating singleton identification timer...
  1301. 2019-10-21 15:29:12,283 DEBUG akka.cluster.sharding.ShardRegion - MappingAggregate: Coordinator moved from [] to [akka.tcp://application@172.17.0.4:2552]
  1302. 2019-10-21 15:29:12,285 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart: Coordinator moved from [] to [akka.tcp://application@172.17.0.4:2552]
  1303. 2019-10-21 15:29:12,285 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Trying to identify singleton at [akka.tcp://application@172.17.0.4:2552/user/slickOffsetStorePrepare-singleton/singleton]
  1304. 2019-10-21 15:29:12,285 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Trying to identify singleton at [akka.tcp://application@172.17.0.4:2552/user/readSideGlobalPrepare-CartProcessor-singleton/singleton]
  1305. 2019-10-21 15:29:12,344 INFO  akka.cluster.singleton.ClusterSingletonManager - Singleton manager starting singleton actor [akka://application/user/slickOffsetStorePrepare-singleton/singleton]
  1306. 2019-10-21 15:29:12,370 INFO  akka.cluster.singleton.ClusterSingletonManager - Singleton manager starting singleton actor [akka://application/system/sharding/kafkaProducer-cartCoordinator/singleton]
  1307. 2019-10-21 15:29:12,391 INFO  akka.cluster.singleton.ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest]
  1308. 2019-10-21 15:29:12,392 INFO  akka.cluster.singleton.ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest]
  1309. 2019-10-21 15:29:12,398 INFO  akka.cluster.singleton.ClusterSingletonManager - Singleton manager starting singleton actor [akka://application/user/jdbcCreateTables-singleton/singleton]
  1310. 2019-10-21 15:29:12,398 INFO  akka.cluster.singleton.ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest]
  1311. 2019-10-21 15:29:12,399 INFO  akka.cluster.singleton.ClusterSingletonManager - Singleton manager starting singleton actor [akka://application/system/sharding/CartProcessorCoordinator/singleton]
  1312. 2019-10-21 15:29:12,400 INFO  akka.cluster.singleton.ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest]
  1313. 2019-10-21 15:29:12,400 INFO  akka.cluster.singleton.ClusterSingletonManager - Singleton manager starting singleton actor [akka://application/system/sharding/kafkaProducer-cart_price_offerCoordinator/singleton]
  1314. 2019-10-21 15:29:12,400 INFO  akka.cluster.singleton.ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest]
  1315. 2019-10-21 15:29:12,402 INFO  akka.cluster.singleton.ClusterSingletonManager - Singleton manager starting singleton actor [akka://application/system/sharding/MappingAggregateCoordinator/singleton]
  1316. 2019-10-21 15:29:12,403 INFO  akka.cluster.singleton.ClusterSingletonManager - Singleton manager starting singleton actor [akka://application/user/readSideGlobalPrepare-CartProcessor-singleton/singleton]
  1317. 2019-10-21 15:29:12,403 INFO  akka.cluster.singleton.ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest]
  1318. 2019-10-21 15:29:12,403 INFO  akka.cluster.singleton.ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest]
  1319. 2019-10-21 15:29:12,405 INFO  akka.cluster.singleton.ClusterSingletonManager - Singleton manager starting singleton actor [akka://application/system/sharding/CartAggregateCoordinator/singleton]
  1320. 2019-10-21 15:29:12,405 INFO  akka.cluster.singleton.ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest]
  1321. 2019-10-21 15:29:12,405 INFO  akka.cluster.singleton.ClusterSingletonManager - Singleton manager starting singleton actor [akka://application/system/sharding/kafkaProducer-cart_reservationCoordinator/singleton]
  1322. 2019-10-21 15:29:12,406 INFO  akka.cluster.singleton.ClusterSingletonManager - ClusterSingletonManager state change [Start -> Oldest]
  1323. 2019-10-21 15:29:12,527 DEBUG akka.cluster.ddata.Replicator - Received Get for key [MappingAggregateCoordinatorState]
  1324. 2019-10-21 15:29:12,544 DEBUG akka.cluster.ddata.Replicator - Received Get for key [kafkaProducer-cart_price_offerCoordinatorState]
  1325. 2019-10-21 15:29:12,545 DEBUG akka.cluster.ddata.Replicator - Received Get for key [CartProcessorCoordinatorState]
  1326. 2019-10-21 15:29:12,545 DEBUG akka.cluster.ddata.Replicator - Received Get for key [CartAggregateCoordinatorState]
  1327. 2019-10-21 15:29:12,545 DEBUG akka.cluster.ddata.Replicator - Received Get for key [kafkaProducer-cartCoordinatorState]
  1328. 2019-10-21 15:29:12,549 INFO  akka.cluster.sharding.DDataShardCoordinator - ShardCoordinator was moved to the active state State(Map())
  1329. 2019-10-21 15:29:12,552 INFO  akka.cluster.sharding.DDataShardCoordinator - ShardCoordinator was moved to the active state State(Map())
  1330. 2019-10-21 15:29:12,552 INFO  akka.cluster.sharding.DDataShardCoordinator - ShardCoordinator was moved to the active state State(Map())
  1331. 2019-10-21 15:29:12,552 DEBUG akka.cluster.ddata.Replicator - Received Get for key [kafkaProducer-cart_reservationCoordinatorState]
  1332. 2019-10-21 15:29:12,552 INFO  akka.cluster.sharding.DDataShardCoordinator - ShardCoordinator was moved to the active state State(Map())
  1333. 2019-10-21 15:29:12,552 INFO  akka.cluster.sharding.DDataShardCoordinator - ShardCoordinator was moved to the active state State(Map())
  1334. 2019-10-21 15:29:12,552 INFO  akka.cluster.sharding.DDataShardCoordinator - ShardCoordinator was moved to the active state State(Map())
  1335. 2019-10-21 15:29:12,560 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Singleton not available, buffering message type [com.lightbend.lagom.internal.persistence.cluster.ClusterStartupTaskActor$Execute$]
  1336. 2019-10-21 15:29:13,069 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  1337. 2019-10-21 15:29:13,071 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [1033 ms]
  1338. 2019-10-21 15:29:13,072 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  1339. 2019-10-21 15:29:13,072 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  1340. 2019-10-21 15:29:13,072 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  1341. 2019-10-21 15:29:13,073 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  1342. 2019-10-21 15:29:13,073 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [0 ms]
  1343. 2019-10-21 15:29:13,073 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  1344. 2019-10-21 15:29:13,073 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  1345. 2019-10-21 15:29:13,073 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  1346. 2019-10-21 15:29:13,073 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  1347. 2019-10-21 15:29:13,073 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Kubernetes API entity: [{"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces/default/pods","resourceVersion":"42510"},"items":[{"metadata":{"name":"cart-5cc9dc46ff-vd4kx","generateName":"cart-5cc9dc46ff-","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/cart-5cc9dc46ff-vd4kx","uid":"80fda555-a4fb-477f-8813-f7c11b95d0b0","resourceVersion":"42487","creationTimestamp":"2019-10-21T15:28:52Z","labels":{"app":"cart","app.kubernetes.io/chartVersion":"0.1.0","app.kubernetes.io/imageTag":"97dd28b69615d2452a3ef11c1a4192d11523cb20","app.kubernetes.io/instance":"cart","app.kubernetes.io/managed-by":"Tiller","app.kubernetes.io/name":"cart","app.kubernetes.io/part-of":"backend","app.kubernetes.io/version":"97dd28b69615d2452a3ef11c1a4192d11523cb20","helm.sh/chart":"cart-0.1.0","pod-template-hash":"5cc9dc46ff"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"cart-5cc9dc46ff","uid":"ddc4d2f9-5f71-4f7d-99bf-83b39f929f76","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-s9gwc","secret":{"secretName":"default-token-s9gwc","defaultMode":420}}],"containers":[{"name":"cart","image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","ports":[{"name":"http","containerPort":9000,"protocol":"TCP"},{"name":"management","containerPort":8558,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"common-service-config"}},{"configMapRef":{"name":"cart-config"}}],"env":[{"name":"CLUSTER_BOOTSTRAP_SERVICE_NAME","value":"cart"},{"name":"CLUSTER_BOOTSTRAP_CONTACT_POINT_NR","value":"1"},{"name":"JAVA_OPTS","value":"-Xms256m -Xmx256m -Dconfig.resource=prod-application.conf"},{"name":"PLAY_HTTP_SECRET_KEY","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"http.play.secretKey"}}},{"name":"DB_USER","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.user"}}},{"name":"DB_PASS","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.password"}}}],"resources":{"limits":{"cpu":"500m"},"requests":{"cpu":"100m"}},"volumeMounts":[{"name":"default-token-s9gwc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/alive","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"readinessProbe":{"httpGet":{"path":"/ready","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Never"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"minikube","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:28:52Z"}],"hostIP":"10.0.2.15","podIP":"172.17.0.4","startTime":"2019-10-21T15:28:52Z","containerStatuses":[{"name":"cart","state":{"running":{"startedAt":"2019-10-21T15:28:53Z"}},"lastState":{},"ready":false,"restartCount":0,"image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","imageID":"docker://sha256:738a509b000132c58685974f4474e1e63fb31ea980d1f7acfcbc02c4cb0c4db4","containerID":"docker://405c46b2f8d8e9ae28d82d321dabaf4e269f9badc854eca14690a2f4b0c90e18"}],"qosClass":"Burstable"}}]}
  1348. ]
  1349. 2019-10-21 15:29:13,183 DEBUG akka.cluster.sharding.DDataShardCoordinator - ShardRegion registered: [Actor[akka://application/system/sharding/CartProcessor#1718379659]]
  1350. 2019-10-21 15:29:13,226 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  1351. 2019-10-21 15:29:13,277 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Trying to identify singleton at [akka.tcp://application@172.17.0.4:2552/user/jdbcCreateTables-singleton/singleton]
  1352. 2019-10-21 15:29:13,278 INFO  akka.cluster.singleton.ClusterSingletonProxy - Singleton identified at [akka://application/user/jdbcCreateTables-singleton/singleton]
  1353. 2019-10-21 15:29:13,279 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Sending buffered messages to current singleton instance
  1354. 2019-10-21 15:29:13,283 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Trying to identify singleton at [akka.tcp://application@172.17.0.4:2552/user/readSideGlobalPrepare-CartProcessor-singleton/singleton]
  1355. 2019-10-21 15:29:13,297 INFO  akka.cluster.singleton.ClusterSingletonProxy - Singleton identified at [akka://application/user/readSideGlobalPrepare-CartProcessor-singleton/singleton]
  1356. 2019-10-21 15:29:13,297 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Sending buffered messages to current singleton instance
  1357. 2019-10-21 15:29:13,297 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Trying to identify singleton at [akka.tcp://application@172.17.0.4:2552/user/slickOffsetStorePrepare-singleton/singleton]
  1358. 2019-10-21 15:29:13,297 INFO  akka.cluster.singleton.ClusterSingletonProxy - Singleton identified at [akka://application/user/slickOffsetStorePrepare-singleton/singleton]
  1359. 2019-10-21 15:29:13,298 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Sending buffered messages to current singleton instance
  1360. 2019-10-21 15:29:13,458 DEBUG akka.cluster.ddata.Replicator - Received Update for key [CartProcessorCoordinatorState]
  1361. 2019-10-21 15:29:13,465 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardRegionRegistered(Actor[akka://application/system/sharding/CartProcessor#1718379659])
  1362. 2019-10-21 15:29:13,465 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardRegionRegistered(Actor[akka://application/system/sharding/CartProcessor#1718379659])]: [State(Map())]
  1363. 2019-10-21 15:29:13,465 DEBUG akka.cluster.sharding.ShardRegion - CartProcessor: Retry request for shard [eventworld.cart.impl.evt$CartEvent] homes from coordinator at [Actor[akka://application/system/sharding/CartProcessorCoordinator/singleton/coordinator#-643121230]]. [1] buffered messages.
  1364. 2019-10-21 15:29:13,468 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  1365. 2019-10-21 15:29:13,469 DEBUG akka.cluster.ddata.Replicator - Received Update for key [CartProcessorCoordinatorState]
  1366. 2019-10-21 15:29:13,469 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardHomeAllocated(eventworld.cart.impl.evt$CartEvent,Actor[akka://application/system/sharding/CartProcessor#1718379659])
  1367. 2019-10-21 15:29:13,469 DEBUG akka.cluster.sharding.DDataShardCoordinator - Shard [eventworld.cart.impl.evt$CartEvent] allocated at [Actor[akka://application/system/sharding/CartProcessor#1718379659]]
  1368. 2019-10-21 15:29:13,470 DEBUG akka.cluster.sharding.ShardRegion - CartProcessor: Host Shard [eventworld.cart.impl.evt$CartEvent]
  1369. 2019-10-21 15:29:13,472 DEBUG akka.cluster.sharding.ShardRegion - CartProcessor: Starting shard [eventworld.cart.impl.evt$CartEvent] in region
  1370. 2019-10-21 15:29:13,472 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardHomeAllocated(eventworld.cart.impl.evt$CartEvent,Actor[akka://application/system/sharding/CartProcessor#1718379659])]: [State(Map(eventworld.cart.impl.evt$CartEvent -> Actor[akka://application/system/sharding/CartProcessor#1718379659]))]
  1371. 2019-10-21 15:29:13,526 DEBUG akka.cluster.sharding.DDataShardCoordinator - ShardRegion registered: [Actor[akka://application/system/sharding/MappingAggregate#-596560817]]
  1372. 2019-10-21 15:29:13,526 DEBUG akka.cluster.sharding.DDataShardCoordinator - ShardRegion registered: [Actor[akka://application/system/sharding/CartAggregate#2064450905]]
  1373. 2019-10-21 15:29:13,526 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  1374. 2019-10-21 15:29:13,526 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  1375. 2019-10-21 15:29:13,526 DEBUG akka.cluster.ddata.Replicator - Received Update for key [MappingAggregateCoordinatorState]
  1376. 2019-10-21 15:29:13,526 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardRegionRegistered(Actor[akka://application/system/sharding/MappingAggregate#-596560817])
  1377. 2019-10-21 15:29:13,526 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardRegionRegistered(Actor[akka://application/system/sharding/MappingAggregate#-596560817])]: [State(Map())]
  1378. 2019-10-21 15:29:13,526 DEBUG akka.cluster.ddata.Replicator - Received Update for key [CartAggregateCoordinatorState]
  1379. 2019-10-21 15:29:13,526 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardRegionRegistered(Actor[akka://application/system/sharding/CartAggregate#2064450905])
  1380. 2019-10-21 15:29:13,527 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardRegionRegistered(Actor[akka://application/system/sharding/CartAggregate#2064450905])]: [State(Map())]
  1381. 2019-10-21 15:29:13,663 DEBUG akka.cluster.sharding.DDataShardCoordinator - ShardRegion registered: [Actor[akka://application/system/sharding/kafkaProducer-cart_reservation#-693563099]]
  1382. 2019-10-21 15:29:13,664 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  1383. 2019-10-21 15:29:13,665 DEBUG akka.cluster.ddata.Replicator - Received Update for key [kafkaProducer-cart_reservationCoordinatorState]
  1384. 2019-10-21 15:29:13,739 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardRegionRegistered(Actor[akka://application/system/sharding/kafkaProducer-cart_reservation#-693563099])
  1385. 2019-10-21 15:29:13,740 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardRegionRegistered(Actor[akka://application/system/sharding/kafkaProducer-cart_reservation#-693563099])]: [State(Map())]
  1386. 2019-10-21 15:29:13,743 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_reservation: Retry request for shard [singleton] homes from coordinator at [Actor[akka://application/system/sharding/kafkaProducer-cart_reservationCoordinator/singleton/coordinator#438313495]]. [1] buffered messages.
  1387. 2019-10-21 15:29:13,744 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  1388. 2019-10-21 15:29:13,745 DEBUG akka.cluster.ddata.Replicator - Received Update for key [kafkaProducer-cart_reservationCoordinatorState]
  1389. 2019-10-21 15:29:13,745 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardHomeAllocated(singleton,Actor[akka://application/system/sharding/kafkaProducer-cart_reservation#-693563099])
  1390. 2019-10-21 15:29:13,745 DEBUG akka.cluster.sharding.DDataShardCoordinator - Shard [singleton] allocated at [Actor[akka://application/system/sharding/kafkaProducer-cart_reservation#-693563099]]
  1391. 2019-10-21 15:29:13,745 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardHomeAllocated(singleton,Actor[akka://application/system/sharding/kafkaProducer-cart_reservation#-693563099])]: [State(Map(singleton -> Actor[akka://application/system/sharding/kafkaProducer-cart_reservation#-693563099]))]
  1392. 2019-10-21 15:29:13,745 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_reservation: Host Shard [singleton]
  1393. 2019-10-21 15:29:13,748 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_reservation: Starting shard [singleton] in region
  1394. 2019-10-21 15:29:13,748 DEBUG akka.cluster.sharding.DDataShardCoordinator - ShardRegion registered: [Actor[akka://application/system/sharding/kafkaProducer-cart#578028258]]
  1395. 2019-10-21 15:29:13,748 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  1396. 2019-10-21 15:29:13,748 DEBUG akka.cluster.sharding.DDataShardCoordinator - ShardRegion registered: [Actor[akka://application/system/sharding/kafkaProducer-cart_price_offer#-1378843657]]
  1397. 2019-10-21 15:29:13,749 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  1398. 2019-10-21 15:29:13,749 DEBUG akka.cluster.ddata.Replicator - Received Update for key [kafkaProducer-cartCoordinatorState]
  1399. 2019-10-21 15:29:13,749 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardRegionRegistered(Actor[akka://application/system/sharding/kafkaProducer-cart#578028258])
  1400. 2019-10-21 15:29:13,750 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardRegionRegistered(Actor[akka://application/system/sharding/kafkaProducer-cart#578028258])]: [State(Map())]
  1401. 2019-10-21 15:29:13,750 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart: Retry request for shard [singleton] homes from coordinator at [Actor[akka://application/system/sharding/kafkaProducer-cartCoordinator/singleton/coordinator#-556037128]]. [1] buffered messages.
  1402. 2019-10-21 15:29:13,750 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  1403. 2019-10-21 15:29:13,750 DEBUG akka.cluster.ddata.Replicator - Received Update for key [kafkaProducer-cart_price_offerCoordinatorState]
  1404. 2019-10-21 15:29:13,750 DEBUG akka.cluster.ddata.Replicator - Received Update for key [kafkaProducer-cartCoordinatorState]
  1405. 2019-10-21 15:29:13,751 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardRegionRegistered(Actor[akka://application/system/sharding/kafkaProducer-cart_price_offer#-1378843657])
  1406. 2019-10-21 15:29:13,751 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardRegionRegistered(Actor[akka://application/system/sharding/kafkaProducer-cart_price_offer#-1378843657])]: [State(Map())]
  1407. 2019-10-21 15:29:13,751 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardHomeAllocated(singleton,Actor[akka://application/system/sharding/kafkaProducer-cart#578028258])
  1408. 2019-10-21 15:29:13,752 DEBUG akka.cluster.sharding.DDataShardCoordinator - Shard [singleton] allocated at [Actor[akka://application/system/sharding/kafkaProducer-cart#578028258]]
  1409. 2019-10-21 15:29:13,752 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardHomeAllocated(singleton,Actor[akka://application/system/sharding/kafkaProducer-cart#578028258])]: [State(Map(singleton -> Actor[akka://application/system/sharding/kafkaProducer-cart#578028258]))]
  1410. 2019-10-21 15:29:13,752 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_price_offer: Retry request for shard [singleton] homes from coordinator at [Actor[akka://application/system/sharding/kafkaProducer-cart_price_offerCoordinator/singleton/coordinator#931210753]]. [1] buffered messages.
  1411. 2019-10-21 15:29:13,752 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart: Host Shard [singleton]
  1412. 2019-10-21 15:29:13,752 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart: Starting shard [singleton] in region
  1413. 2019-10-21 15:29:13,753 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  1414. 2019-10-21 15:29:13,753 DEBUG akka.cluster.ddata.Replicator - Received Update for key [kafkaProducer-cart_price_offerCoordinatorState]
  1415. 2019-10-21 15:29:13,753 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardHomeAllocated(singleton,Actor[akka://application/system/sharding/kafkaProducer-cart_price_offer#-1378843657])
  1416. 2019-10-21 15:29:13,753 DEBUG akka.cluster.sharding.DDataShardCoordinator - Shard [singleton] allocated at [Actor[akka://application/system/sharding/kafkaProducer-cart_price_offer#-1378843657]]
  1417. 2019-10-21 15:29:13,762 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardHomeAllocated(singleton,Actor[akka://application/system/sharding/kafkaProducer-cart_price_offer#-1378843657])]: [State(Map(singleton -> Actor[akka://application/system/sharding/kafkaProducer-cart_price_offer#-1378843657]))]
  1418. 2019-10-21 15:29:13,762 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_price_offer: Host Shard [singleton]
  1419. 2019-10-21 15:29:13,762 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_price_offer: Starting shard [singleton] in region
  1420. 2019-10-21 15:29:13,762 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart: Shard [singleton] located at [Actor[akka://application/system/sharding/kafkaProducer-cart#578028258]]
  1421. 2019-10-21 15:29:13,762 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_reservation: Shard [singleton] located at [Actor[akka://application/system/sharding/kafkaProducer-cart_reservation#-693563099]]
  1422. 2019-10-21 15:29:13,762 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_price_offer: Shard [singleton] located at [Actor[akka://application/system/sharding/kafkaProducer-cart_price_offer#-1378843657]]
  1423. 2019-10-21 15:29:13,762 DEBUG akka.cluster.sharding.ShardRegion - CartProcessor: Shard [eventworld.cart.impl.evt$CartEvent] located at [Actor[akka://application/system/sharding/CartProcessor#1718379659]]
  1424. 2019-10-21 15:29:13,763 DEBUG akka.io.TcpListener - New connection accepted
  1425. 2019-10-21 15:29:13,779 DEBUG akka.cluster.sharding.Shard - Shard initialized
  1426. 2019-10-21 15:29:13,780 DEBUG akka.cluster.sharding.Shard - Shard initialized
  1427. 2019-10-21 15:29:13,780 DEBUG akka.cluster.sharding.ShardRegion - CartProcessor: Shard was initialized eventworld.cart.impl.evt$CartEvent
  1428. 2019-10-21 15:29:13,780 DEBUG akka.cluster.sharding.ShardRegion - CartProcessor: Deliver [1] buffered messages for shard [eventworld.cart.impl.evt$CartEvent]
  1429. 2019-10-21 15:29:13,780 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_reservation: Shard was initialized singleton
  1430. 2019-10-21 15:29:13,780 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_reservation: Deliver [1] buffered messages for shard [singleton]
  1431. 2019-10-21 15:29:13,780 DEBUG akka.cluster.sharding.Shard - Shard initialized
  1432. 2019-10-21 15:29:13,780 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart: Shard was initialized singleton
  1433. 2019-10-21 15:29:13,780 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart: Deliver [1] buffered messages for shard [singleton]
  1434. 2019-10-21 15:29:13,791 DEBUG akka.cluster.sharding.Shard - Shard initialized
  1435. 2019-10-21 15:29:13,791 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_price_offer: Shard was initialized singleton
  1436. 2019-10-21 15:29:13,791 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_price_offer: Deliver [1] buffered messages for shard [singleton]
  1437. 2019-10-21 15:29:13,963 DEBUG akka.cluster.sharding.Shard - Starting entity [singleton] in shard [singleton]
  1438. 2019-10-21 15:29:13,969 DEBUG akka.cluster.sharding.Shard - Starting entity [eventworld.cart.impl.evt$CartEvent] in shard [eventworld.cart.impl.evt$CartEvent]
  1439. 2019-10-21 15:29:13,970 DEBUG akka.cluster.sharding.Shard - Starting entity [singleton] in shard [singleton]
  1440. 2019-10-21 15:29:13,973 DEBUG akka.cluster.sharding.Shard - Starting entity [singleton] in shard [singleton]
  1441. 2019-10-21 15:29:13,974 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Forwarding message of type [ClusterStartupTaskActor$Execute$] to current singleton instance at [akka://application/user/slickOffsetStorePrepare-singleton/singleton]
  1442. 2019-10-21 15:29:13,974 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Forwarding message of type [ClusterStartupTaskActor$Execute$] to current singleton instance at [akka://application/user/slickOffsetStorePrepare-singleton/singleton]
  1443. 2019-10-21 15:29:13,975 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Forwarding message of type [ClusterStartupTaskActor$Execute$] to current singleton instance at [akka://application/user/slickOffsetStorePrepare-singleton/singleton]
  1444. 2019-10-21 15:29:14,061 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Forwarding message of type [ClusterStartupTaskActor$Execute$] to current singleton instance at [akka://application/user/readSideGlobalPrepare-CartProcessor-singleton/singleton]
  1445. 2019-10-21 15:29:14,477 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Forwarding message of type [ClusterStartupTaskActor$Execute$] to current singleton instance at [akka://application/user/slickOffsetStorePrepare-singleton/singleton]
  1446. 2019-10-21 15:29:14,567 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [2]
  1447. 2019-10-21 15:29:14,568 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [2]
  1448. 2019-10-21 15:29:14,568 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [2]
  1449. 2019-10-21 15:29:15,730 DEBUG akka.io.TcpListener - New connection accepted
  1450. 2019-10-21 15:29:15,931 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [3]
  1451. 2019-10-21 15:29:15,933 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [3]
  1452. 2019-10-21 15:29:16,026 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [3]
  1453. 2019-10-21 15:29:17,096 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [4]
  1454. 2019-10-21 15:29:17,123 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [4]
  1455. 2019-10-21 15:29:17,320 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [4]
  1456. 2019-10-21 15:29:18,181 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [5]
  1457. 2019-10-21 15:29:18,242 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [5]
  1458. 2019-10-21 15:29:18,333 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [5]
  1459. 2019-10-21 15:29:19,250 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [6]
  1460. 2019-10-21 15:29:19,276 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [6]
  1461. 2019-10-21 15:29:19,354 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [6]
  1462. 2019-10-21 15:29:19,666 DEBUG akka.stream.scaladsl.RestartWithBackoffSource - Last restart attempt was more than 3000 milliseconds ago, resetting restart count
  1463. 2019-10-21 15:29:20,844 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [7]
  1464. 2019-10-21 15:29:20,869 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [7]
  1465. 2019-10-21 15:29:20,869 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [7]
  1466. 2019-10-21 15:29:20,895 WARN  akka.stream.scaladsl.RestartWithBackoffSource - Restarting graph due to failure. stack_trace:
  1467. java.util.concurrent.TimeoutException: The first element has not yet passed through in 5000 milliseconds.
  1468.     at akka.stream.impl.Timers$Initial$$anon$1.onTimer(Timers.scala:62)
  1469.     at akka.stream.stage.TimerGraphStageLogic.onInternalTimer(GraphStage.scala:1544)
  1470.     at akka.stream.stage.TimerGraphStageLogic.$anonfun$getTimerAsyncCallback$1(GraphStage.scala:1533)
  1471.     at akka.stream.stage.TimerGraphStageLogic.$anonfun$getTimerAsyncCallback$1$adapted(GraphStage.scala:1533)
  1472.     at akka.stream.impl.fusing.GraphInterpreter.runAsyncInput(GraphInterpreter.scala:452)
  1473.     at akka.stream.impl.fusing.GraphInterpreterShell$AsyncInput.execute(ActorGraphInterpreter.scala:481)
  1474.     at akka.stream.impl.fusing.GraphInterpreterShell.processEvent(ActorGraphInterpreter.scala:581)
  1475.     at akka.stream.impl.fusing.ActorGraphInterpreter.akka$stream$impl$fusing$ActorGraphInterpreter$$processEvent(ActorGraphInterpreter.scala:749)
  1476.     at akka.stream.impl.fusing.ActorGraphInterpreter$$anonfun$receive$1.applyOrElse(ActorGraphInterpreter.scala:764)
  1477.     at akka.actor.Actor.aroundReceive(Actor.scala:539)
  1478.     at akka.actor.Actor.aroundReceive$(Actor.scala:537)
  1479.     at akka.stream.impl.fusing.ActorGraphInterpreter.aroundReceive(ActorGraphInterpreter.scala:671)
  1480.     at akka.actor.ActorCell.receiveMessage(ActorCell.scala:612)
  1481.     at akka.actor.ActorCell.invoke(ActorCell.scala:581)
  1482.     at akka.dispatch.Mailbox.processMailbox(Mailbox.scala:268)
  1483.     at akka.dispatch.Mailbox.run(Mailbox.scala:229)
  1484.     at akka.dispatch.Mailbox.exec(Mailbox.scala:241)
  1485.     at akka.dispatch.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
  1486.     at akka.dispatch.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
  1487.     at akka.dispatch.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
  1488.     at akka.dispatch.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
  1489.  
  1490. 2019-10-21 15:29:20,896 DEBUG akka.stream.scaladsl.RestartWithBackoffSource - Restarting graph in 3092791454 nanoseconds
  1491. 2019-10-21 15:29:21,084 DEBUG akka.persistence.query.PersistenceQuery - Create plugin: jdbc-read-journal akka.persistence.jdbc.query.JdbcReadJournalProvider
  1492. 2019-10-21 15:29:21,401 DEBUG akka.persistence.Persistence(akka://application) - Create plugin: jdbc-journal akka.persistence.jdbc.journal.JdbcAsyncWriteJournal
  1493. 2019-10-21 15:29:21,953 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [8]
  1494. 2019-10-21 15:29:21,955 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [8]
  1495. 2019-10-21 15:29:21,956 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [8]
  1496. 2019-10-21 15:29:22,963 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [9]
  1497. 2019-10-21 15:29:23,014 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [9]
  1498. 2019-10-21 15:29:23,016 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [9]
  1499. 2019-10-21 15:29:24,136 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [10]
  1500. 2019-10-21 15:29:24,139 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [10]
  1501. 2019-10-21 15:29:24,139 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [10]
  1502. 2019-10-21 15:29:24,139 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Forwarding message of type [ClusterStartupTaskActor$Execute$] to current singleton instance at [akka://application/user/slickOffsetStorePrepare-singleton/singleton]
  1503. 2019-10-21 15:29:24,645 DEBUG akka.io.TcpListener - New connection accepted
  1504. 2019-10-21 15:29:26,759 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [11]
  1505. 2019-10-21 15:29:26,765 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [11]
  1506. 2019-10-21 15:29:26,765 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [11]
  1507. 2019-10-21 15:29:26,765 WARN  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Scheduled sending of heartbeat was delayed. Previous heartbeat was sent [2572] ms ago, expected interval is [1000] ms. This may cause failure detection to mark members as unreachable. The reason can be thread starvation, e.g. by running blocking tasks on the default dispatcher, CPU overload, or GC.
  1508. 2019-10-21 15:29:26,765 DEBUG akka.io.TcpListener - New connection accepted
  1509. 2019-10-21 15:29:27,853 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [12]
  1510. 2019-10-21 15:29:27,853 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [12]
  1511. 2019-10-21 15:29:27,853 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [12]
  1512. 2019-10-21 15:29:27,953 DEBUG akka.actor.TimerScheduler - Start timer [AssumeMaxOrderingIdTimerKey] with generation [1]
  1513. 2019-10-21 15:29:27,965 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [2]
  1514. 2019-10-21 15:29:29,007 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [13]
  1515. 2019-10-21 15:29:29,075 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [13]
  1516. 2019-10-21 15:29:29,075 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [13]
  1517. 2019-10-21 15:29:29,176 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [3]
  1518. 2019-10-21 15:29:30,077 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [14]
  1519. 2019-10-21 15:29:30,077 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [14]
  1520. 2019-10-21 15:29:30,077 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [14]
  1521. 2019-10-21 15:29:30,250 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [4]
  1522. 2019-10-21 15:29:31,116 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [15]
  1523. 2019-10-21 15:29:31,128 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [15]
  1524. 2019-10-21 15:29:31,129 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [15]
  1525. 2019-10-21 15:29:31,566 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [5]
  1526. 2019-10-21 15:29:32,200 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [16]
  1527. 2019-10-21 15:29:32,201 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [16]
  1528. 2019-10-21 15:29:32,201 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [16]
  1529. 2019-10-21 15:29:32,744 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [6]
  1530. 2019-10-21 15:29:33,327 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [17]
  1531. 2019-10-21 15:29:33,334 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [17]
  1532. 2019-10-21 15:29:33,353 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [17]
  1533. 2019-10-21 15:29:33,486 DEBUG akka.io.TcpListener - New connection accepted
  1534. 2019-10-21 15:29:33,872 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [7]
  1535. 2019-10-21 15:29:34,388 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [18]
  1536. 2019-10-21 15:29:34,389 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [18]
  1537. 2019-10-21 15:29:34,452 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [18]
  1538. 2019-10-21 15:29:34,938 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [8]
  1539. 2019-10-21 15:29:35,367 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [19]
  1540. 2019-10-21 15:29:35,369 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [19]
  1541. 2019-10-21 15:29:35,467 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [19]
  1542. 2019-10-21 15:29:35,792 DEBUG akka.io.TcpListener - New connection accepted
  1543. 2019-10-21 15:29:36,254 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [9]
  1544. 2019-10-21 15:29:36,386 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [20]
  1545. 2019-10-21 15:29:36,386 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [20]
  1546. 2019-10-21 15:29:36,499 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [20]
  1547. 2019-10-21 15:29:37,373 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [10]
  1548. 2019-10-21 15:29:37,482 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [21]
  1549. 2019-10-21 15:29:37,483 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [21]
  1550. 2019-10-21 15:29:37,529 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [21]
  1551. 2019-10-21 15:29:38,493 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [22]
  1552. 2019-10-21 15:29:38,574 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [22]
  1553. 2019-10-21 15:29:38,574 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [22]
  1554. 2019-10-21 15:29:38,596 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [11]
  1555. 2019-10-21 15:29:39,554 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [23]
  1556. 2019-10-21 15:29:39,602 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [23]
  1557. 2019-10-21 15:29:39,602 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [23]
  1558. 2019-10-21 15:29:39,681 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [12]
  1559. 2019-10-21 15:29:40,636 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [24]
  1560. 2019-10-21 15:29:40,699 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [24]
  1561. 2019-10-21 15:29:40,699 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [24]
  1562. 2019-10-21 15:29:40,883 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [13]
  1563. 2019-10-21 15:29:41,408 DEBUG akka.http.impl.engine.client.PoolGateway - Shutting down host connection pool immediately
  1564. 2019-10-21 15:29:41,410 DEBUG akka.http.impl.engine.client.PoolGateway - Pool upstream was completed
  1565. 2019-10-21 15:29:41,411 DEBUG akka.http.impl.engine.client.PoolGateway - Pool stopped
  1566. 2019-10-21 15:29:41,727 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [25]
  1567. 2019-10-21 15:29:41,727 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [25]
  1568. 2019-10-21 15:29:41,727 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [25]
  1569. 2019-10-21 15:29:41,989 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [14]
  1570. 2019-10-21 15:29:42,935 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [26]
  1571. 2019-10-21 15:29:42,938 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [26]
  1572. 2019-10-21 15:29:42,938 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [26]
  1573. 2019-10-21 15:29:43,040 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [15]
  1574. 2019-10-21 15:29:43,085 DEBUG akka.http.impl.engine.client.PoolGateway - Shutting down host connection pool immediately
  1575. 2019-10-21 15:29:43,085 DEBUG akka.http.impl.engine.client.PoolGateway - Pool upstream was completed
  1576. 2019-10-21 15:29:43,085 DEBUG akka.http.impl.engine.client.PoolGateway - Pool stopped
  1577. 2019-10-21 15:29:43,857 DEBUG akka.io.TcpListener - New connection accepted
  1578. 2019-10-21 15:29:43,858 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [27]
  1579. 2019-10-21 15:29:43,859 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [27]
  1580. 2019-10-21 15:29:43,867 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [27]
  1581. 2019-10-21 15:29:44,153 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [16]
  1582. 2019-10-21 15:29:44,874 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [28]
  1583. 2019-10-21 15:29:44,880 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [28]
  1584. 2019-10-21 15:29:44,882 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [28]
  1585. 2019-10-21 15:29:45,406 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [17]
  1586. 2019-10-21 15:29:45,795 DEBUG akka.io.TcpListener - New connection accepted
  1587. 2019-10-21 15:29:45,894 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [29]
  1588. 2019-10-21 15:29:45,894 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [29]
  1589. 2019-10-21 15:29:45,904 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [29]
  1590. 2019-10-21 15:29:46,442 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [18]
  1591. 2019-10-21 15:29:46,965 WARN  org.apache.kafka.clients.NetworkClient - [Consumer clientId=cart-2, groupId=cart] Error while fetching metadata with correlation id 3 : {user_switch=INVALID_REPLICATION_FACTOR}
  1592. 2019-10-21 15:29:46,965 WARN  org.apache.kafka.clients.NetworkClient - [Consumer clientId=cart-1, groupId=cart] Error while fetching metadata with correlation id 3 : {reservations=INVALID_REPLICATION_FACTOR}
  1593. 2019-10-21 15:29:46,965 WARN  org.apache.kafka.clients.NetworkClient - [Consumer clientId=cart-3, groupId=cart] Error while fetching metadata with correlation id 3 : {price-offer-updated=INVALID_REPLICATION_FACTOR}
  1594. 2019-10-21 15:29:46,965 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [30]
  1595. 2019-10-21 15:29:46,966 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [30]
  1596. 2019-10-21 15:29:46,966 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [30]
  1597. 2019-10-21 15:29:47,614 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [19]
  1598. 2019-10-21 15:29:48,172 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [31]
  1599. 2019-10-21 15:29:48,258 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [31]
  1600. 2019-10-21 15:29:48,258 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [31]
  1601. 2019-10-21 15:29:48,765 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [20]
  1602. 2019-10-21 15:29:49,395 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [32]
  1603. 2019-10-21 15:29:49,401 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [32]
  1604. 2019-10-21 15:29:49,414 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [32]
  1605. 2019-10-21 15:29:49,840 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [21]
  1606. 2019-10-21 15:29:50,664 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [33]
  1607. 2019-10-21 15:29:51,086 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [33]
  1608. 2019-10-21 15:29:51,088 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [33]
  1609. 2019-10-21 15:29:51,095 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [22]
  1610. 2019-10-21 15:29:51,732 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [34]
  1611. 2019-10-21 15:29:51,734 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [34]
  1612. 2019-10-21 15:29:51,828 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [34]
  1613. 2019-10-21 15:29:52,298 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [23]
  1614. 2019-10-21 15:29:52,886 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [35]
  1615. 2019-10-21 15:29:52,887 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [35]
  1616. 2019-10-21 15:29:52,888 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [35]
  1617. 2019-10-21 15:29:53,569 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [24]
  1618. 2019-10-21 15:29:53,932 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [36]
  1619. 2019-10-21 15:29:53,932 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [36]
  1620. 2019-10-21 15:29:53,934 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [36]
  1621. 2019-10-21 15:29:55,246 DEBUG akka.io.TcpListener - New connection accepted
  1622. 2019-10-21 15:29:55,386 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [37]
  1623. 2019-10-21 15:29:55,415 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [37]
  1624. 2019-10-21 15:29:55,427 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [37]
  1625. 2019-10-21 15:29:55,655 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [25]
  1626. 2019-10-21 15:29:56,521 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [38]
  1627. 2019-10-21 15:29:56,525 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [38]
  1628. 2019-10-21 15:29:56,564 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [38]
  1629. 2019-10-21 15:29:56,904 DEBUG akka.io.TcpListener - New connection accepted
  1630. 2019-10-21 15:29:56,921 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [26]
  1631. 2019-10-21 15:29:57,729 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [39]
  1632. 2019-10-21 15:29:57,783 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [39]
  1633. 2019-10-21 15:29:57,783 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [39]
  1634. 2019-10-21 15:29:58,028 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [27]
  1635. 2019-10-21 15:29:58,677 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [40]
  1636. 2019-10-21 15:29:58,744 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [40]
  1637. 2019-10-21 15:29:58,746 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [40]
  1638. 2019-10-21 15:29:59,733 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [41]
  1639. 2019-10-21 15:29:59,914 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [41]
  1640. 2019-10-21 15:30:00,049 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [41]
  1641. 2019-10-21 15:30:00,050 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [28]
  1642. 2019-10-21 15:30:00,820 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [42]
  1643. 2019-10-21 15:30:00,851 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [42]
  1644. 2019-10-21 15:30:00,907 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [42]
  1645. 2019-10-21 15:30:00,940 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [29]
  1646. 2019-10-21 15:30:01,879 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [43]
  1647. 2019-10-21 15:30:01,880 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [43]
  1648. 2019-10-21 15:30:02,018 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [30]
  1649. 2019-10-21 15:30:02,027 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [43]
  1650. 2019-10-21 15:30:02,894 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [44]
  1651. 2019-10-21 15:30:02,895 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [44]
  1652. 2019-10-21 15:30:03,145 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [44]
  1653. 2019-10-21 15:30:03,247 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [31]
  1654. 2019-10-21 15:30:03,618 DEBUG akka.io.TcpListener - New connection accepted
  1655. 2019-10-21 15:30:03,975 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [45]
  1656. 2019-10-21 15:30:03,988 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [45]
  1657. 2019-10-21 15:30:04,173 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [45]
  1658. 2019-10-21 15:30:04,411 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [32]
  1659. 2019-10-21 15:30:05,218 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [46]
  1660. 2019-10-21 15:30:05,221 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [46]
  1661. 2019-10-21 15:30:05,221 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [46]
  1662. 2019-10-21 15:30:05,435 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [33]
  1663. 2019-10-21 15:30:06,254 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [47]
  1664. 2019-10-21 15:30:06,254 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [47]
  1665. 2019-10-21 15:30:06,270 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [47]
  1666. 2019-10-21 15:30:07,155 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [34]
  1667. 2019-10-21 15:30:09,062 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [48]
  1668. 2019-10-21 15:30:09,063 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [48]
  1669. 2019-10-21 15:30:09,091 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [48]
  1670. 2019-10-21 15:30:10,080 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [49]
  1671. 2019-10-21 15:30:10,082 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [49]
  1672. 2019-10-21 15:30:11,344 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [49]
  1673. 2019-10-21 15:30:11,786 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [50]
  1674. 2019-10-21 15:30:13,968 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [50]
  1675. 2019-10-21 15:30:14,343 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [50]
  1676. 2019-10-21 15:30:14,355 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [51]
  1677. 2019-10-21 15:30:14,409 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [51]
  1678. 2019-10-21 15:30:14,409 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [35]
  1679. 2019-10-21 15:30:20,655 WARN  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Scheduled sending of heartbeat was delayed. Previous heartbeat was sent [4141] ms ago, expected interval is [1000] ms. This may cause failure detection to mark members as unreachable. The reason can be thread starvation, e.g. by running blocking tasks on the default dispatcher, CPU overload, or GC.
  1680. 2019-10-21 15:30:20,661 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [51]
  1681. 2019-10-21 15:30:20,661 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [52]
  1682. 2019-10-21 15:30:20,661 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [52]
  1683. 2019-10-21 15:30:20,661 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [52]
  1684. 2019-10-21 15:30:22,554 WARN  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Scheduled sending of heartbeat was delayed. Previous heartbeat was sent [7391] ms ago, expected interval is [1000] ms. This may cause failure detection to mark members as unreachable. The reason can be thread starvation, e.g. by running blocking tasks on the default dispatcher, CPU overload, or GC.
  1685. 2019-10-21 15:30:25,224 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [36]
  1686. 2019-10-21 15:30:28,024 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [37]
  1687. 2019-10-21 15:30:30,166 WARN  org.apache.kafka.clients.NetworkClient - [Consumer clientId=cart-3, groupId=cart] Bootstrap broker kafka:9092 (id: -1 rack: null) disconnected
  1688. 2019-10-21 15:30:30,171 WARN  org.apache.kafka.clients.NetworkClient - [Consumer clientId=cart-1, groupId=cart] Bootstrap broker kafka:9092 (id: -1 rack: null) disconnected
  1689. 2019-10-21 15:30:30,325 WARN  org.apache.kafka.clients.NetworkClient - [Consumer clientId=cart-2, groupId=cart] Bootstrap broker kafka:9092 (id: -1 rack: null) disconnected
  1690. 2019-10-21 15:30:32,533 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [38]
  1691. 2019-10-21 15:30:32,546 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [53]
  1692. 2019-10-21 15:30:32,546 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [53]
  1693. 2019-10-21 15:30:32,546 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [53]
  1694. 2019-10-21 15:30:33,456 DEBUG akka.io.TcpListener - New connection accepted
  1695. 2019-10-21 15:30:33,629 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [54]
  1696. 2019-10-21 15:30:33,630 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [54]
  1697. 2019-10-21 15:30:33,630 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [54]
  1698. 2019-10-21 15:30:33,747 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [39]
  1699. 2019-10-21 15:30:34,593 DEBUG akka.io.TcpListener - New connection accepted
  1700. 2019-10-21 15:30:34,839 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [55]
  1701. 2019-10-21 15:30:34,983 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [55]
  1702. 2019-10-21 15:30:35,026 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [55]
  1703. 2019-10-21 15:30:35,497 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [40]
  1704. 2019-10-21 15:30:35,555 DEBUG akka.io.TcpListener - New connection accepted
  1705. 2019-10-21 15:30:35,681 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [56]
  1706. 2019-10-21 15:30:36,544 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [56]
  1707. 2019-10-21 15:30:36,546 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [56]
  1708. 2019-10-21 15:30:37,458 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [41]
  1709. 2019-10-21 15:30:37,665 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [57]
  1710. 2019-10-21 15:30:37,673 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [57]
  1711. 2019-10-21 15:30:37,737 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [57]
  1712. 2019-10-21 15:30:38,282 DEBUG akka.io.TcpListener - New connection accepted
  1713. 2019-10-21 15:30:38,935 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [58]
  1714. 2019-10-21 15:30:38,954 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [58]
  1715. 2019-10-21 15:30:38,954 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [58]
  1716. 2019-10-21 15:30:39,622 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [42]
  1717. 2019-10-21 15:30:39,868 DEBUG akka.io.TcpListener - New connection accepted
  1718. 2019-10-21 15:30:39,966 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [59]
  1719. 2019-10-21 15:30:39,968 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [59]
  1720. 2019-10-21 15:30:39,968 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [59]
  1721. 2019-10-21 15:30:40,767 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [43]
  1722. 2019-10-21 15:30:41,211 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [60]
  1723. 2019-10-21 15:30:41,212 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [60]
  1724. 2019-10-21 15:30:41,212 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [60]
  1725. 2019-10-21 15:30:42,255 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [61]
  1726. 2019-10-21 15:30:42,255 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [61]
  1727. 2019-10-21 15:30:42,255 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [61]
  1728. 2019-10-21 15:30:42,339 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [44]
  1729. 2019-10-21 15:30:43,275 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [62]
  1730. 2019-10-21 15:30:43,286 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [62]
  1731. 2019-10-21 15:30:43,377 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [45]
  1732. 2019-10-21 15:30:43,378 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [62]
  1733. 2019-10-21 15:30:44,348 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [63]
  1734. 2019-10-21 15:30:44,481 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [46]
  1735. 2019-10-21 15:30:44,514 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [63]
  1736. 2019-10-21 15:30:44,551 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [63]
  1737. 2019-10-21 15:30:45,565 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [64]
  1738. 2019-10-21 15:30:45,582 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [64]
  1739. 2019-10-21 15:30:45,598 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [64]
  1740. 2019-10-21 15:30:46,484 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [47]
  1741. 2019-10-21 15:30:46,687 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [65]
  1742. 2019-10-21 15:30:46,896 DEBUG akka.io.TcpListener - New connection accepted
  1743. 2019-10-21 15:30:46,972 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [65]
  1744. 2019-10-21 15:30:47,672 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [48]
  1745. 2019-10-21 15:30:47,750 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [65]
  1746. 2019-10-21 15:30:48,064 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [66]
  1747. 2019-10-21 15:30:48,246 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [66]
  1748. 2019-10-21 15:30:48,379 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [66]
  1749. 2019-10-21 15:30:49,081 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [67]
  1750. 2019-10-21 15:30:49,083 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [49]
  1751. 2019-10-21 15:30:49,259 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [67]
  1752. 2019-10-21 15:30:49,453 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [67]
  1753. 2019-10-21 15:30:50,156 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [68]
  1754. 2019-10-21 15:30:50,281 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [68]
  1755. 2019-10-21 15:30:50,286 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [50]
  1756. 2019-10-21 15:30:50,512 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [68]
  1757. 2019-10-21 15:30:51,231 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [69]
  1758. 2019-10-21 15:30:51,685 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [69]
  1759. 2019-10-21 15:30:51,736 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [69]
  1760. 2019-10-21 15:30:51,872 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [51]
  1761. 2019-10-21 15:30:52,796 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [70]
  1762. 2019-10-21 15:30:52,804 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [70]
  1763. 2019-10-21 15:30:52,804 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [70]
  1764. 2019-10-21 15:30:52,973 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [52]
  1765. 2019-10-21 15:30:53,040 DEBUG akka.io.TcpListener - New connection accepted
  1766. 2019-10-21 15:30:53,952 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [71]
  1767. 2019-10-21 15:30:53,953 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [71]
  1768. 2019-10-21 15:30:53,962 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [71]
  1769. 2019-10-21 15:30:54,237 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [53]
  1770. 2019-10-21 15:30:54,982 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [72]
  1771. 2019-10-21 15:30:54,984 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [72]
  1772. 2019-10-21 15:30:54,985 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [72]
  1773. 2019-10-21 15:30:55,829 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [54]
  1774. 2019-10-21 15:30:56,027 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [73]
  1775. 2019-10-21 15:30:56,028 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [73]
  1776. 2019-10-21 15:30:56,028 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [73]
  1777. 2019-10-21 15:30:56,971 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [55]
  1778. 2019-10-21 15:30:57,199 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [74]
  1779. 2019-10-21 15:30:57,205 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [74]
  1780. 2019-10-21 15:30:57,215 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [74]
  1781. 2019-10-21 15:30:57,427 DEBUG akka.io.TcpListener - New connection accepted
  1782. 2019-10-21 15:30:58,217 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [56]
  1783. 2019-10-21 15:30:58,245 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [75]
  1784. 2019-10-21 15:30:58,299 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [75]
  1785. 2019-10-21 15:30:58,300 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [75]
  1786. 2019-10-21 15:30:58,494 DEBUG akka.io.TcpListener - New connection accepted
  1787. 2019-10-21 15:30:59,595 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [76]
  1788. 2019-10-21 15:30:59,659 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [76]
  1789. 2019-10-21 15:30:59,661 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [76]
  1790. 2019-10-21 15:30:59,898 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [57]
  1791. 2019-10-21 15:31:00,906 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [77]
  1792. 2019-10-21 15:31:00,907 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [77]
  1793. 2019-10-21 15:31:00,912 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [77]
  1794. 2019-10-21 15:31:02,975 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [58]
  1795. 2019-10-21 15:31:03,609 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [78]
  1796. 2019-10-21 15:31:03,609 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [78]
  1797. 2019-10-21 15:31:03,648 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [78]
  1798. 2019-10-21 15:31:04,134 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [59]
  1799. 2019-10-21 15:31:04,245 DEBUG akka.io.TcpListener - New connection accepted
  1800. 2019-10-21 15:31:05,408 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [79]
  1801. 2019-10-21 15:31:05,498 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [79]
  1802. 2019-10-21 15:31:05,498 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [79]
  1803. 2019-10-21 15:31:05,498 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [60]
  1804. 2019-10-21 15:31:05,894 DEBUG akka.io.TcpListener - New connection accepted
  1805. 2019-10-21 15:31:06,432 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [80]
  1806. 2019-10-21 15:31:06,432 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [80]
  1807. 2019-10-21 15:31:06,478 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [80]
  1808. 2019-10-21 15:31:06,670 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [61]
  1809. 2019-10-21 15:31:07,469 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [81]
  1810. 2019-10-21 15:31:07,487 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [81]
  1811. 2019-10-21 15:31:07,497 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [81]
  1812. 2019-10-21 15:31:08,008 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [62]
  1813. 2019-10-21 15:31:08,538 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [82]
  1814. 2019-10-21 15:31:08,550 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [82]
  1815. 2019-10-21 15:31:08,550 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [82]
  1816. 2019-10-21 15:31:09,354 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [63]
  1817. 2019-10-21 15:31:09,607 DEBUG akka.cluster.sharding.ShardRegion - MappingAggregate: Request shard [30] home. Coordinator [Some(Actor[akka://application/system/sharding/MappingAggregateCoordinator/singleton/coordinator#2008986604])]
  1818. 2019-10-21 15:31:09,612 DEBUG akka.cluster.sharding.DDataShardCoordinator - Publishing new coordinator state [State(Map())]
  1819. 2019-10-21 15:31:09,614 DEBUG akka.cluster.ddata.Replicator - Received Update for key [MappingAggregateCoordinatorState]
  1820. 2019-10-21 15:31:09,616 DEBUG akka.cluster.sharding.DDataShardCoordinator - The coordinator state was successfully updated with ShardHomeAllocated(30,Actor[akka://application/system/sharding/MappingAggregate#-596560817])
  1821. 2019-10-21 15:31:09,616 DEBUG akka.cluster.sharding.DDataShardCoordinator - Shard [30] allocated at [Actor[akka://application/system/sharding/MappingAggregate#-596560817]]
  1822. 2019-10-21 15:31:09,616 DEBUG akka.cluster.sharding.DDataShardCoordinator - New coordinator state after [ShardHomeAllocated(30,Actor[akka://application/system/sharding/MappingAggregate#-596560817])]: [State(Map(30 -> Actor[akka://application/system/sharding/MappingAggregate#-596560817]))]
  1823. 2019-10-21 15:31:09,616 DEBUG akka.cluster.sharding.ShardRegion - MappingAggregate: Host Shard [30]
  1824. 2019-10-21 15:31:09,616 DEBUG akka.cluster.sharding.ShardRegion - MappingAggregate: Starting shard [30] in region
  1825. 2019-10-21 15:31:09,616 DEBUG akka.cluster.sharding.ShardRegion - MappingAggregate: Shard [30] located at [Actor[akka://application/system/sharding/MappingAggregate#-596560817]]
  1826. 2019-10-21 15:31:09,616 DEBUG akka.cluster.sharding.Shard - Shard initialized
  1827. 2019-10-21 15:31:09,616 DEBUG akka.cluster.sharding.ShardRegion - MappingAggregate: Shard was initialized 30
  1828. 2019-10-21 15:31:09,616 DEBUG akka.cluster.sharding.ShardRegion - MappingAggregate: Deliver [1] buffered messages for shard [30]
  1829. 2019-10-21 15:31:09,616 DEBUG akka.cluster.sharding.Shard - Starting entity [mapping] in shard [30]
  1830. 2019-10-21 15:31:09,617 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [83]
  1831. 2019-10-21 15:31:09,621 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [83]
  1832. 2019-10-21 15:31:09,628 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [83]
  1833. 2019-10-21 15:31:09,678 DEBUG akka.persistence.Persistence(akka://application) - Create plugin: jdbc-snapshot-store akka.persistence.jdbc.snapshot.JdbcSnapshotStore
  1834. 2019-10-21 15:31:10,661 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [84]
  1835. 2019-10-21 15:31:10,662 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [84]
  1836. 2019-10-21 15:31:10,664 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [64]
  1837. 2019-10-21 15:31:10,722 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [84]
  1838. 2019-10-21 15:31:10,867 DEBUG eventworld.cart.impl.CartService - Cleaning expired cart invoked
  1839. 2019-10-21 15:31:11,710 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [85]
  1840. 2019-10-21 15:31:11,757 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [85]
  1841. 2019-10-21 15:31:11,905 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [65]
  1842. 2019-10-21 15:31:11,949 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [85]
  1843. 2019-10-21 15:31:12,924 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [66]
  1844. 2019-10-21 15:31:13,018 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [86]
  1845. 2019-10-21 15:31:13,024 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [86]
  1846. 2019-10-21 15:31:13,040 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [86]
  1847. 2019-10-21 15:31:14,043 DEBUG akka.io.TcpListener - New connection accepted
  1848. 2019-10-21 15:31:14,062 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [87]
  1849. 2019-10-21 15:31:14,062 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [87]
  1850. 2019-10-21 15:31:14,062 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [87]
  1851. 2019-10-21 15:31:14,135 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [67]
  1852. 2019-10-21 15:31:15,106 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [88]
  1853. 2019-10-21 15:31:15,148 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [88]
  1854. 2019-10-21 15:31:15,220 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [88]
  1855. 2019-10-21 15:31:15,362 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [68]
  1856. 2019-10-21 15:31:16,164 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [89]
  1857. 2019-10-21 15:31:16,166 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [89]
  1858. 2019-10-21 15:31:16,241 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [89]
  1859. 2019-10-21 15:31:16,768 DEBUG akka.io.TcpListener - New connection accepted
  1860. 2019-10-21 15:31:16,894 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [69]
  1861. 2019-10-21 15:31:17,254 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [90]
  1862. 2019-10-21 15:31:17,271 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [90]
  1863. 2019-10-21 15:31:17,271 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [90]
  1864. 2019-10-21 15:31:18,098 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [70]
  1865. 2019-10-21 15:31:18,278 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [91]
  1866. 2019-10-21 15:31:18,313 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [91]
  1867. 2019-10-21 15:31:18,313 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [91]
  1868. 2019-10-21 15:31:19,205 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [71]
  1869. 2019-10-21 15:31:19,305 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [92]
  1870. 2019-10-21 15:31:19,305 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [92]
  1871. 2019-10-21 15:31:19,305 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [92]
  1872. 2019-10-21 15:31:20,277 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [72]
  1873. 2019-10-21 15:31:20,323 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [93]
  1874. 2019-10-21 15:31:20,323 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [93]
  1875. 2019-10-21 15:31:20,364 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [93]
  1876. 2019-10-21 15:31:21,547 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [94]
  1877. 2019-10-21 15:31:21,584 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [94]
  1878. 2019-10-21 15:31:21,597 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [94]
  1879. 2019-10-21 15:31:21,817 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [73]
  1880. 2019-10-21 15:31:22,985 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [95]
  1881. 2019-10-21 15:31:22,987 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [95]
  1882. 2019-10-21 15:31:22,987 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [95]
  1883. 2019-10-21 15:31:23,021 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [74]
  1884. 2019-10-21 15:31:23,836 DEBUG akka.io.TcpListener - New connection accepted
  1885. 2019-10-21 15:31:24,006 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [96]
  1886. 2019-10-21 15:31:24,006 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [96]
  1887. 2019-10-21 15:31:24,006 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [96]
  1888. 2019-10-21 15:31:24,053 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [75]
  1889. 2019-10-21 15:31:25,261 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [97]
  1890. 2019-10-21 15:31:25,314 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [97]
  1891. 2019-10-21 15:31:25,314 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [97]
  1892. 2019-10-21 15:31:25,392 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [76]
  1893. 2019-10-21 15:31:26,395 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [98]
  1894. 2019-10-21 15:31:26,446 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [98]
  1895. 2019-10-21 15:31:26,484 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [77]
  1896. 2019-10-21 15:31:26,565 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [98]
  1897. 2019-10-21 15:31:27,419 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [99]
  1898. 2019-10-21 15:31:27,421 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [99]
  1899. 2019-10-21 15:31:27,594 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [99]
  1900. 2019-10-21 15:31:27,606 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [78]
  1901. 2019-10-21 15:31:28,444 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [100]
  1902. 2019-10-21 15:31:28,445 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [100]
  1903. 2019-10-21 15:31:28,813 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [100]
  1904. 2019-10-21 15:31:28,893 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [79]
  1905. 2019-10-21 15:31:29,482 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [101]
  1906. 2019-10-21 15:31:29,525 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [101]
  1907. 2019-10-21 15:31:29,639 DEBUG akka.io.TcpListener - New connection accepted
  1908. 2019-10-21 15:31:29,851 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [101]
  1909. 2019-10-21 15:31:30,264 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [80]
  1910. 2019-10-21 15:31:30,484 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [102]
  1911. 2019-10-21 15:31:30,507 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [102]
  1912. 2019-10-21 15:31:31,410 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [81]
  1913. 2019-10-21 15:31:31,433 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [102]
  1914. 2019-10-21 15:31:31,513 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [103]
  1915. 2019-10-21 15:31:31,536 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [103]
  1916. 2019-10-21 15:31:32,699 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [103]
  1917. 2019-10-21 15:31:32,814 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [104]
  1918. 2019-10-21 15:31:32,815 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [104]
  1919. 2019-10-21 15:31:32,920 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [82]
  1920. 2019-10-21 15:31:33,812 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [104]
  1921. 2019-10-21 15:31:33,853 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [105]
  1922. 2019-10-21 15:31:33,853 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [105]
  1923. 2019-10-21 15:31:34,068 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [83]
  1924. 2019-10-21 15:31:34,835 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [106]
  1925. 2019-10-21 15:31:34,835 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [106]
  1926. 2019-10-21 15:31:34,837 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [105]
  1927. 2019-10-21 15:31:35,339 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [84]
  1928. 2019-10-21 15:31:35,525 DEBUG akka.io.TcpListener - New connection accepted
  1929. 2019-10-21 15:31:36,241 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [107]
  1930. 2019-10-21 15:31:36,363 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [107]
  1931. 2019-10-21 15:31:36,363 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [106]
  1932. 2019-10-21 15:31:36,718 DEBUG akka.io.TcpListener - New connection accepted
  1933. 2019-10-21 15:31:37,063 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [85]
  1934. 2019-10-21 15:31:37,378 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [108]
  1935. 2019-10-21 15:31:37,405 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [107]
  1936. 2019-10-21 15:31:37,437 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [108]
  1937. 2019-10-21 15:31:38,426 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [109]
  1938. 2019-10-21 15:31:38,960 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [109]
  1939. 2019-10-21 15:31:38,999 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [108]
  1940. 2019-10-21 15:31:39,717 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [109]
  1941. 2019-10-21 15:31:39,742 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [110]
  1942. 2019-10-21 15:31:39,742 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [110]
  1943. 2019-10-21 15:31:40,864 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [86]
  1944. 2019-10-21 15:31:42,206 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [111]
  1945. 2019-10-21 15:31:42,249 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [111]
  1946. 2019-10-21 15:31:42,249 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [110]
  1947. 2019-10-21 15:31:42,249 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [112]
  1948. 2019-10-21 15:31:42,263 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [112]
  1949. 2019-10-21 15:31:42,264 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [111]
  1950. 2019-10-21 15:31:44,713 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [113]
  1951. 2019-10-21 15:31:44,749 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [113]
  1952. 2019-10-21 15:31:46,970 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [112]
  1953. 2019-10-21 15:31:48,864 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [114]
  1954. 2019-10-21 15:31:48,949 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [113]
  1955. 2019-10-21 15:31:48,950 WARN  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Scheduled sending of heartbeat was delayed. Previous heartbeat was sent [3621] ms ago, expected interval is [1000] ms. This may cause failure detection to mark members as unreachable. The reason can be thread starvation, e.g. by running blocking tasks on the default dispatcher, CPU overload, or GC.
  1956. 2019-10-21 15:31:48,950 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [114]
  1957. 2019-10-21 15:31:48,950 WARN  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Scheduled sending of heartbeat was delayed. Previous heartbeat was sent [2075] ms ago, expected interval is [1000] ms. This may cause failure detection to mark members as unreachable. The reason can be thread starvation, e.g. by running blocking tasks on the default dispatcher, CPU overload, or GC.
  1958. 2019-10-21 15:31:48,950 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [114]
  1959. 2019-10-21 15:31:48,950 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [115]
  1960. 2019-10-21 15:31:49,851 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [115]
  1961. 2019-10-21 15:31:49,925 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [116]
  1962. 2019-10-21 15:31:49,948 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [115]
  1963. 2019-10-21 15:31:50,593 WARN  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Scheduled sending of heartbeat was delayed. Previous heartbeat was sent [2197] ms ago, expected interval is [1000] ms. This may cause failure detection to mark members as unreachable. The reason can be thread starvation, e.g. by running blocking tasks on the default dispatcher, CPU overload, or GC.
  1964. 2019-10-21 15:31:52,135 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [87]
  1965. 2019-10-21 15:31:54,718 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [116]
  1966. 2019-10-21 15:31:54,929 WARN  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Scheduled sending of heartbeat was delayed. Previous heartbeat was sent [2775] ms ago, expected interval is [1000] ms. This may cause failure detection to mark members as unreachable. The reason can be thread starvation, e.g. by running blocking tasks on the default dispatcher, CPU overload, or GC.
  1967. 2019-10-21 15:31:55,794 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [116]
  1968. 2019-10-21 15:31:59,366 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [117]
  1969. 2019-10-21 15:32:02,950 WARN  org.apache.kafka.clients.NetworkClient - [Consumer clientId=cart-1, groupId=cart] Bootstrap broker kafka:9092 (id: -1 rack: null) disconnected
  1970. 2019-10-21 15:32:03,348 WARN  org.apache.kafka.clients.NetworkClient - [Consumer clientId=cart-3, groupId=cart] Bootstrap broker kafka:9092 (id: -1 rack: null) disconnected
  1971. 2019-10-21 15:32:03,405 DEBUG akka.io.TcpListener - New connection accepted
  1972. 2019-10-21 15:32:03,465 WARN  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Scheduled sending of heartbeat was delayed. Previous heartbeat was sent [3643] ms ago, expected interval is [1000] ms. This may cause failure detection to mark members as unreachable. The reason can be thread starvation, e.g. by running blocking tasks on the default dispatcher, CPU overload, or GC.
  1973. 2019-10-21 15:32:03,468 WARN  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Scheduled sending of heartbeat was delayed. Previous heartbeat was sent [3954] ms ago, expected interval is [1000] ms. This may cause failure detection to mark members as unreachable. The reason can be thread starvation, e.g. by running blocking tasks on the default dispatcher, CPU overload, or GC.
  1974. 2019-10-21 15:32:03,508 WARN  org.apache.kafka.clients.NetworkClient - [Consumer clientId=cart-2, groupId=cart] Bootstrap broker kafka:9092 (id: -1 rack: null) disconnected
  1975. 2019-10-21 15:32:03,748 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [88]
  1976. 2019-10-21 15:32:04,326 DEBUG akka.io.TcpListener - New connection accepted
  1977. 2019-10-21 15:32:04,504 DEBUG akka.io.TcpListener - New connection accepted
  1978. 2019-10-21 15:32:06,716 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [118]
  1979. 2019-10-21 15:32:06,716 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [117]
  1980. 2019-10-21 15:32:06,716 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [117]
  1981. 2019-10-21 15:32:06,977 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [89]
  1982. 2019-10-21 15:32:07,953 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [119]
  1983. 2019-10-21 15:32:07,984 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [118]
  1984. 2019-10-21 15:32:08,007 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [118]
  1985. 2019-10-21 15:32:08,101 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [90]
  1986. 2019-10-21 15:32:08,207 DEBUG akka.io.TcpListener - New connection accepted
  1987. 2019-10-21 15:32:08,959 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [120]
  1988. 2019-10-21 15:32:09,649 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [119]
  1989. 2019-10-21 15:32:10,558 DEBUG akka.io.TcpListener - New connection accepted
  1990. 2019-10-21 15:32:10,696 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [120]
  1991. 2019-10-21 15:32:11,881 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [121]
  1992. 2019-10-21 15:32:11,881 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [119]
  1993. 2019-10-21 15:32:11,904 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [120]
  1994. 2019-10-21 15:32:12,323 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [91]
  1995. 2019-10-21 15:32:12,713 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [122]
  1996. 2019-10-21 15:32:13,238 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [121]
  1997. 2019-10-21 15:32:13,816 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [122]
  1998. 2019-10-21 15:32:14,919 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [121]
  1999. 2019-10-21 15:32:17,126 DEBUG akka.actor.TimerScheduler - Start timer [QueryOrderingIdsTimerKey] with generation [92]
  2000. 2019-10-21 15:32:17,130 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [123]
  2001. 2019-10-21 15:32:17,130 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [124]
  2002. 2019-10-21 15:32:17,130 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [123]
  2003. 2019-10-21 15:32:17,141 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [124]
  2004. 2019-10-21 15:32:17,145 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [122]
  2005. 2019-10-21 15:32:18,300 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [125]
  2006. 2019-10-21 15:32:19,848 DEBUG akka.io.TcpListener - New connection accepted
  2007. 2019-10-21 15:32:20,967 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [123]
  2008. 2019-10-21 15:32:20,967 WARN  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Scheduled sending of heartbeat was delayed. Previous heartbeat was sent [3825] ms ago, expected interval is [1000] ms. This may cause failure detection to mark members as unreachable. The reason can be thread starvation, e.g. by running blocking tasks on the default dispatcher, CPU overload, or GC.
  2009. 2019-10-21 15:32:20,979 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [126]
  2010. 2019-10-21 15:32:20,979 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [125]
  2011. ^C
  2012. $ docker kill $(docker ps | grep "bin/cart" | awk '{ print $1 }')
  2013. 44c91689c519
  2014. $ docker logs -f $(docker ps | grep "bin/cart" | awk '{ print $1 }')
  2015. 15:33:17,577 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
  2016. 15:33:17,577 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy]
  2017. 15:33:17,577 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [jar:file:/opt/docker/lib/global.bright.cart-1.0.1.jar!/logback.xml]
  2018. 15:33:17,585 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@4bf48f6 - URL [jar:file:/opt/docker/lib/global.bright.cart-1.0.1.jar!/logback.xml] is not of type file
  2019. 15:33:17,675 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
  2020. 15:33:17,676 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
  2021. 15:33:17,679 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
  2022. 15:33:17,684 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
  2023. 15:33:17,709 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.FileAppender]
  2024. 15:33:17,710 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
  2025. 15:33:17,712 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
  2026. 15:33:17,712 |-INFO in ch.qos.logback.core.FileAppender[FILE] - File property is set to [testFile.log]
  2027. 15:33:17,713 |-ERROR in ch.qos.logback.core.FileAppender[FILE] - openFile(testFile.log,true) call failed. java.io.FileNotFoundException: testFile.log (Permission denied)
  2028.     at java.io.FileNotFoundException: testFile.log (Permission denied)
  2029.     at  at java.io.FileOutputStream.open0(Native Method)
  2030.     at  at java.io.FileOutputStream.open(FileOutputStream.java:270)
  2031.     at  at java.io.FileOutputStream.<init>(FileOutputStream.java:213)
  2032.     at  at ch.qos.logback.core.recovery.ResilientFileOutputStream.<init>(ResilientFileOutputStream.java:26)
  2033.     at  at ch.qos.logback.core.FileAppender.openFile(FileAppender.java:204)
  2034.     at  at ch.qos.logback.core.FileAppender.start(FileAppender.java:127)
  2035.     at  at ch.qos.logback.core.joran.action.AppenderAction.end(AppenderAction.java:90)
  2036.     at  at ch.qos.logback.core.joran.spi.Interpreter.callEndAction(Interpreter.java:309)
  2037.     at  at ch.qos.logback.core.joran.spi.Interpreter.endElement(Interpreter.java:193)
  2038.     at  at ch.qos.logback.core.joran.spi.Interpreter.endElement(Interpreter.java:179)
  2039.     at  at ch.qos.logback.core.joran.spi.EventPlayer.play(EventPlayer.java:62)
  2040.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:165)
  2041.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:152)
  2042.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:110)
  2043.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:53)
  2044.     at  at ch.qos.logback.classic.util.ContextInitializer.configureByResource(ContextInitializer.java:75)
  2045.     at  at ch.qos.logback.classic.util.ContextInitializer.autoConfig(ContextInitializer.java:150)
  2046.     at  at org.slf4j.impl.StaticLoggerBinder.init(StaticLoggerBinder.java:84)
  2047.     at  at org.slf4j.impl.StaticLoggerBinder.<clinit>(StaticLoggerBinder.java:55)
  2048.     at  at org.slf4j.LoggerFactory.bind(LoggerFactory.java:150)
  2049.     at  at org.slf4j.LoggerFactory.performInitialization(LoggerFactory.java:124)
  2050.     at  at org.slf4j.LoggerFactory.getILoggerFactory(LoggerFactory.java:412)
  2051.     at  at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:357)
  2052.     at  at play.api.Logger$.<init>(Logger.scala:291)
  2053.     at  at play.api.Logger$.<clinit>(Logger.scala)
  2054.     at  at com.lightbend.lagom.scaladsl.server.LagomApplicationLoader.<init>(LagomApplicationLoader.scala:55)
  2055.     at  at eventworld.cart.impl.CartLoader.<init>(CartLoader.scala:25)
  2056.     at  at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
  2057.     at  at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
  2058.     at  at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  2059.     at  at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
  2060.     at  at play.api.ApplicationLoader$.apply(ApplicationLoader.scala:175)
  2061.     at  at play.core.server.ProdServerStart$.start(ProdServerStart.scala:58)
  2062.     at  at play.core.server.ProdServerStart$.main(ProdServerStart.scala:31)
  2063.     at  at play.core.server.ProdServerStart.main(ProdServerStart.scala)
  2064. 15:33:17,713 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.datastax.driver] to DEBUG
  2065. 15:33:17,713 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [akka] to DEBUG
  2066. 15:33:17,713 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [eventworld.cart.impl.CartService] to DEBUG
  2067. 15:33:17,713 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
  2068. 15:33:17,713 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
  2069. 15:33:17,713 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
  2070. 15:33:17,713 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
  2071. 15:33:17,714 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@62833051 - Registering current configuration as safe fallback point
  2072.  
  2073. 15:33:17,577 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback-test.xml]
  2074. 15:33:17,577 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Could NOT find resource [logback.groovy]
  2075. 15:33:17,577 |-INFO in ch.qos.logback.classic.LoggerContext[default] - Found resource [logback.xml] at [jar:file:/opt/docker/lib/global.bright.cart-1.0.1.jar!/logback.xml]
  2076. 15:33:17,585 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@4bf48f6 - URL [jar:file:/opt/docker/lib/global.bright.cart-1.0.1.jar!/logback.xml] is not of type file
  2077. 15:33:17,675 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
  2078. 15:33:17,676 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
  2079. 15:33:17,679 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
  2080. 15:33:17,684 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
  2081. 15:33:17,709 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.FileAppender]
  2082. 15:33:17,710 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
  2083. 15:33:17,712 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
  2084. 15:33:17,712 |-INFO in ch.qos.logback.core.FileAppender[FILE] - File property is set to [testFile.log]
  2085. 15:33:17,713 |-ERROR in ch.qos.logback.core.FileAppender[FILE] - openFile(testFile.log,true) call failed. java.io.FileNotFoundException: testFile.log (Permission denied)
  2086.     at java.io.FileNotFoundException: testFile.log (Permission denied)
  2087.     at  at java.io.FileOutputStream.open0(Native Method)
  2088.     at  at java.io.FileOutputStream.open(FileOutputStream.java:270)
  2089.     at  at java.io.FileOutputStream.<init>(FileOutputStream.java:213)
  2090.     at  at ch.qos.logback.core.recovery.ResilientFileOutputStream.<init>(ResilientFileOutputStream.java:26)
  2091.     at  at ch.qos.logback.core.FileAppender.openFile(FileAppender.java:204)
  2092.     at  at ch.qos.logback.core.FileAppender.start(FileAppender.java:127)
  2093.     at  at ch.qos.logback.core.joran.action.AppenderAction.end(AppenderAction.java:90)
  2094.     at  at ch.qos.logback.core.joran.spi.Interpreter.callEndAction(Interpreter.java:309)
  2095.     at  at ch.qos.logback.core.joran.spi.Interpreter.endElement(Interpreter.java:193)
  2096.     at  at ch.qos.logback.core.joran.spi.Interpreter.endElement(Interpreter.java:179)
  2097.     at  at ch.qos.logback.core.joran.spi.EventPlayer.play(EventPlayer.java:62)
  2098.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:165)
  2099.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:152)
  2100.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:110)
  2101.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:53)
  2102.     at  at ch.qos.logback.classic.util.ContextInitializer.configureByResource(ContextInitializer.java:75)
  2103.     at  at ch.qos.logback.classic.util.ContextInitializer.autoConfig(ContextInitializer.java:150)
  2104.     at  at org.slf4j.impl.StaticLoggerBinder.init(StaticLoggerBinder.java:84)
  2105.     at  at org.slf4j.impl.StaticLoggerBinder.<clinit>(StaticLoggerBinder.java:55)
  2106.     at  at org.slf4j.LoggerFactory.bind(LoggerFactory.java:150)
  2107.     at  at org.slf4j.LoggerFactory.performInitialization(LoggerFactory.java:124)
  2108.     at  at org.slf4j.LoggerFactory.getILoggerFactory(LoggerFactory.java:412)
  2109.     at  at org.slf4j.LoggerFactory.getLogger(LoggerFactory.java:357)
  2110.     at  at play.api.Logger$.<init>(Logger.scala:291)
  2111.     at  at play.api.Logger$.<clinit>(Logger.scala)
  2112.     at  at com.lightbend.lagom.scaladsl.server.LagomApplicationLoader.<init>(LagomApplicationLoader.scala:55)
  2113.     at  at eventworld.cart.impl.CartLoader.<init>(CartLoader.scala:25)
  2114.     at  at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
  2115.     at  at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
  2116.     at  at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
  2117.     at  at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
  2118.     at  at play.api.ApplicationLoader$.apply(ApplicationLoader.scala:175)
  2119.     at  at play.core.server.ProdServerStart$.start(ProdServerStart.scala:58)
  2120.     at  at play.core.server.ProdServerStart$.main(ProdServerStart.scala:31)
  2121.     at  at play.core.server.ProdServerStart.main(ProdServerStart.scala)
  2122. 15:33:17,713 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.datastax.driver] to DEBUG
  2123. 15:33:17,713 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [akka] to DEBUG
  2124. 15:33:17,713 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [eventworld.cart.impl.CartService] to DEBUG
  2125. 15:33:17,713 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
  2126. 15:33:17,713 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
  2127. 15:33:17,713 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
  2128. 15:33:17,713 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
  2129. 15:33:17,714 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@62833051 - Registering current configuration as safe fallback point
  2130. 15:33:18,068 |-INFO in ch.qos.logback.core.joran.spi.ConfigurationWatchList@24b6b8f6 - URL [jar:file:/opt/docker/lib/global.bright.cart-1.0.1.jar!/logback.xml] is not of type file
  2131. 15:33:18,069 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - debug attribute not set
  2132. 15:33:18,069 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.ConsoleAppender]
  2133. 15:33:18,069 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [STDOUT]
  2134. 15:33:18,069 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
  2135. 15:33:18,070 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - About to instantiate appender of type [ch.qos.logback.core.FileAppender]
  2136. 15:33:18,070 |-INFO in ch.qos.logback.core.joran.action.AppenderAction - Naming appender as [FILE]
  2137. 15:33:18,072 |-INFO in ch.qos.logback.core.joran.action.NestedComplexPropertyIA - Assuming default type [ch.qos.logback.classic.encoder.PatternLayoutEncoder] for [encoder] property
  2138. 15:33:18,072 |-INFO in ch.qos.logback.core.FileAppender[FILE] - File property is set to [testFile.log]
  2139. 15:33:18,073 |-ERROR in ch.qos.logback.core.FileAppender[FILE] - openFile(testFile.log,true) call failed. java.io.FileNotFoundException: testFile.log (Permission denied)
  2140.     at java.io.FileNotFoundException: testFile.log (Permission denied)
  2141.     at  at java.io.FileOutputStream.open0(Native Method)
  2142.     at  at java.io.FileOutputStream.open(FileOutputStream.java:270)
  2143.     at  at java.io.FileOutputStream.<init>(FileOutputStream.java:213)
  2144.     at  at ch.qos.logback.core.recovery.ResilientFileOutputStream.<init>(ResilientFileOutputStream.java:26)
  2145.     at  at ch.qos.logback.core.FileAppender.openFile(FileAppender.java:204)
  2146.     at  at ch.qos.logback.core.FileAppender.start(FileAppender.java:127)
  2147.     at  at ch.qos.logback.core.joran.action.AppenderAction.end(AppenderAction.java:90)
  2148.     at  at ch.qos.logback.core.joran.spi.Interpreter.callEndAction(Interpreter.java:309)
  2149.     at  at ch.qos.logback.core.joran.spi.Interpreter.endElement(Interpreter.java:193)
  2150.     at  at ch.qos.logback.core.joran.spi.Interpreter.endElement(Interpreter.java:179)
  2151.     at  at ch.qos.logback.core.joran.spi.EventPlayer.play(EventPlayer.java:62)
  2152.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:165)
  2153.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:152)
  2154.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:110)
  2155.     at  at ch.qos.logback.core.joran.GenericConfigurator.doConfigure(GenericConfigurator.java:53)
  2156.     at  at com.lightbend.lagom.internal.logback.LogbackLoggerConfigurator.configure(LogbackLoggerConfigurator.scala:121)
  2157.     at  at com.lightbend.lagom.internal.logback.LogbackLoggerConfigurator.configure(LogbackLoggerConfigurator.scala:75)
  2158.     at  at com.lightbend.lagom.internal.logback.LogbackLoggerConfigurator.configure(LogbackLoggerConfigurator.scala:40)
  2159.     at  at com.lightbend.lagom.scaladsl.server.LagomApplicationLoader.$anonfun$loadCustomLoggerConfiguration$1(LagomApplicationLoader.scala:185)
  2160.     at  at com.lightbend.lagom.scaladsl.server.LagomApplicationLoader.$anonfun$loadCustomLoggerConfiguration$1$adapted(LagomApplicationLoader.scala:185)
  2161.     at  at scala.Option.foreach(Option.scala:274)
  2162.     at  at com.lightbend.lagom.scaladsl.server.LagomApplicationLoader.loadCustomLoggerConfiguration(LagomApplicationLoader.scala:185)
  2163.     at  at com.lightbend.lagom.scaladsl.server.LagomApplicationLoader.load(LagomApplicationLoader.scala:86)
  2164.     at  at play.core.server.ProdServerStart$.start(ProdServerStart.scala:59)
  2165.     at  at play.core.server.ProdServerStart$.main(ProdServerStart.scala:31)
  2166.     at  at play.core.server.ProdServerStart.main(ProdServerStart.scala)
  2167. 15:33:18,073 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [com.datastax.driver] to DEBUG
  2168. 15:33:18,073 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [akka] to DEBUG
  2169. 15:33:18,073 |-INFO in ch.qos.logback.classic.joran.action.LoggerAction - Setting level of logger [eventworld.cart.impl.CartService] to DEBUG
  2170. 15:33:18,073 |-INFO in ch.qos.logback.classic.joran.action.RootLoggerAction - Setting level of ROOT logger to WARN
  2171. 15:33:18,073 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [STDOUT] to Logger[ROOT]
  2172. 15:33:18,073 |-INFO in ch.qos.logback.core.joran.action.AppenderRefAction - Attaching appender named [FILE] to Logger[ROOT]
  2173. 15:33:18,073 |-INFO in ch.qos.logback.classic.joran.action.ConfigurationAction - End of configuration.
  2174. 15:33:18,073 |-INFO in ch.qos.logback.classic.joran.JoranConfigurator@72cf2de5 - Registering current configuration as safe fallback point
  2175.  
  2176. 2019-10-21 15:33:18,768 INFO  akka.event.slf4j.Slf4jLogger - Slf4jLogger started
  2177. 2019-10-21 15:33:18,804 DEBUG akka.event.EventStream - logger log1-Slf4jLogger started
  2178. 2019-10-21 15:33:18,809 DEBUG akka.event.EventStream - Default Loggers started
  2179. 2019-10-21 15:33:18,840 INFO  akka.remote.Remoting - Starting remoting
  2180. 2019-10-21 15:33:19,063 INFO  akka.remote.Remoting - Remoting started; listening on addresses :[akka.tcp://application@172.17.0.4:2552]
  2181. 2019-10-21 15:33:19,064 INFO  akka.remote.Remoting - Remoting now listens on addresses: [akka.tcp://application@172.17.0.4:2552]
  2182. 2019-10-21 15:33:19,079 INFO  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Starting up, Akka version [2.5.25] ...
  2183. 2019-10-21 15:33:19,219 INFO  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Registered cluster JMX MBean [akka:type=Cluster]
  2184. 2019-10-21 15:33:19,242 INFO  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - Started up successfully
  2185. 2019-10-21 15:33:19,439 INFO  akka.cluster.Cluster(akka://application) - Cluster Node [akka.tcp://application@172.17.0.4:2552] - No seed-nodes configured, manual cluster join required, see https://doc.akka.io/docs/akka/current/cluster-usage.html#joining-to-seed-nodes
  2186. 2019-10-21 15:33:19,763 INFO  akka.management.cluster.bootstrap.ClusterBootstrap - Bootstrap using `akka.discovery` method: kubernetes-api
  2187. 2019-10-21 15:33:20,167 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Settings Settings(/var/run/secrets/kubernetes.io/serviceaccount/ca.crt, /var/run/secrets/kubernetes.io/serviceaccount/token, KUBERNETES_SERVICE_HOST, KUBERNETES_SERVICE_PORT, /var/run/secrets/kubernetes.io/serviceaccount/namespace, None, cluster.local)
  2188. 2019-10-21 15:33:20,176 INFO  akka.management.internal.HealthChecksImpl - Loading readiness checks List(NamedHealthCheck(cluster-membership,akka.management.cluster.scaladsl.ClusterMembershipCheck))
  2189. 2019-10-21 15:33:20,176 INFO  akka.management.internal.HealthChecksImpl - Loading liveness checks List()
  2190. 2019-10-21 15:33:20,199 INFO  akka.management.scaladsl.AkkaManagement - Binding Akka Management (HTTP) endpoint to: 172.17.0.4:8558
  2191. 2019-10-21 15:33:20,242 INFO  akka.management.scaladsl.AkkaManagement - Including HTTP management routes for ClusterHttpManagementRouteProvider
  2192. 2019-10-21 15:33:20,292 INFO  akka.management.scaladsl.AkkaManagement - Including HTTP management routes for ClusterBootstrap
  2193. 2019-10-21 15:33:20,296 INFO  akka.management.cluster.bootstrap.ClusterBootstrap - Using self contact point address: http://172.17.0.4:8558
  2194. 2019-10-21 15:33:20,313 INFO  akka.management.scaladsl.AkkaManagement - Including HTTP management routes for HealthCheckRoutes
  2195. 2019-10-21 15:33:20,650 DEBUG akka.io.TcpListener - Successfully bound to /172.17.0.4:8558
  2196. 2019-10-21 15:33:20,654 INFO  akka.management.scaladsl.AkkaManagement - Bound Akka Management (HTTP) endpoint to: 172.17.0.4:8558
  2197. 2019-10-21 15:33:20,699 INFO  akka.management.cluster.bootstrap.ClusterBootstrap - Initiating bootstrap procedure using kubernetes-api method...
  2198. 2019-10-21 15:33:20,707 DEBUG akka.actor.TimerScheduler - Start timer [resolve-key] with generation [1]
  2199. 2019-10-21 15:33:20,713 DEBUG akka.actor.TimerScheduler - Start timer [decide-key] with generation [2]
  2200. 2019-10-21 15:33:20,714 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Locating service members. Using discovery [akka.discovery.kubernetes.KubernetesApiServiceDiscovery], join decider [akka.management.cluster.bootstrap.LowestAddressJoinDecider]
  2201. 2019-10-21 15:33:20,714 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Looking up [Lookup(cart,None,Some(tcp))]
  2202. 2019-10-21 15:33:20,714 INFO  akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Querying for pods with label selector: [app=cart]. Namespace: [default]. Port: [None]
  2203. 2019-10-21 15:33:20,755 DEBUG akka.http.impl.engine.client.PoolGateway - (Re-)starting host connection pool to 10.96.0.1:443
  2204. 2019-10-21 15:33:20,838 DEBUG akka.http.impl.engine.client.PoolGateway - InputBuffer (max-open-requests = 32) now filled with 1 request after enqueuing GET /api/v1/namespaces/default/pods Empty
  2205. 2019-10-21 15:33:20,843 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Unconnected)] Dispatching request [GET /api/v1/namespaces/default/pods Empty]
  2206. 2019-10-21 15:33:20,854 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Unconnected)] Before event [onNewRequest] In state [Unconnected] for [27 ms]
  2207. 2019-10-21 15:33:20,857 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Unconnected)] Establishing connection
  2208. 2019-10-21 15:33:20,892 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] After event [onNewRequest] State change [Unconnected] -> [Connecting]
  2209. 2019-10-21 15:33:20,944 DEBUG akka.io.TcpOutgoingConnection - Resolving 10.96.0.1 before connecting
  2210. 2019-10-21 15:33:20,972 DEBUG akka.io.SimpleDnsManager - Resolution request for 10.96.0.1 from Actor[akka://application/system/IO-TCP/selectors/$a/1#-1292034448]
  2211. 2019-10-21 15:33:20,987 DEBUG akka.io.TcpOutgoingConnection - Attempting connection to [/10.96.0.1:443]
  2212. 2019-10-21 15:33:20,989 DEBUG akka.io.TcpOutgoingConnection - Connection established to [10.96.0.1:443]
  2213. 2019-10-21 15:33:21,004 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] Connection attempt succeeded
  2214. 2019-10-21 15:33:21,005 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] Before event [onConnectionAttemptSucceeded] In state [Connecting] for [112 ms]
  2215. 2019-10-21 15:33:21,005 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] Slot connection was established
  2216. 2019-10-21 15:33:21,006 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onConnectionAttemptSucceeded] State change [Connecting] -> [PushingRequestToConnection]
  2217. 2019-10-21 15:33:21,020 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [13 ms]
  2218. 2019-10-21 15:33:21,030 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  2219. 2019-10-21 15:33:21,859 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  2220. 2019-10-21 15:33:21,864 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [833 ms]
  2221. 2019-10-21 15:33:21,865 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  2222. 2019-10-21 15:33:21,865 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  2223. 2019-10-21 15:33:21,865 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  2224. 2019-10-21 15:33:21,866 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  2225. 2019-10-21 15:33:21,875 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [9 ms]
  2226. 2019-10-21 15:33:21,876 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  2227. 2019-10-21 15:33:21,879 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [1 ms]
  2228. 2019-10-21 15:33:21,879 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Kubernetes API entity: [{"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces/default/pods","resourceVersion":"42754"},"items":[{"metadata":{"name":"cart-6588c46d86-cn69x","generateName":"cart-6588c46d86-","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/cart-6588c46d86-cn69x","uid":"d055b3ce-e9e0-4fb6-914d-f8669b8f2542","resourceVersion":"42737","creationTimestamp":"2019-10-21T15:33:15Z","labels":{"app":"cart","app.kubernetes.io/chartVersion":"0.1.0","app.kubernetes.io/imageTag":"97dd28b69615d2452a3ef11c1a4192d11523cb20","app.kubernetes.io/instance":"cart","app.kubernetes.io/managed-by":"Tiller","app.kubernetes.io/name":"cart","app.kubernetes.io/part-of":"backend","app.kubernetes.io/version":"97dd28b69615d2452a3ef11c1a4192d11523cb20","helm.sh/chart":"cart-0.1.0","pod-template-hash":"6588c46d86"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"cart-6588c46d86","uid":"7af461f6-e716-4a3c-b6ea-1b941e470f5e","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-s9gwc","secret":{"secretName":"default-token-s9gwc","defaultMode":420}}],"containers":[{"name":"cart","image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","ports":[{"name":"http","containerPort":9000,"protocol":"TCP"},{"name":"remoting","containerPort":2552,"protocol":"TCP"},{"name":"management","containerPort":8558,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"common-service-config"}},{"configMapRef":{"name":"cart-config"}}],"env":[{"name":"CLUSTER_BOOTSTRAP_SERVICE_NAME","value":"cart"},{"name":"CLUSTER_BOOTSTRAP_CONTACT_POINT_NR","value":"1"},{"name":"JAVA_OPTS","value":"-Xms256m -Xmx256m -Dconfig.resource=prod-application.conf"},{"name":"PLAY_HTTP_SECRET_KEY","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"http.play.secretKey"}}},{"name":"DB_USER","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.user"}}},{"name":"DB_PASS","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-s9gwc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/alive","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"readinessProbe":{"httpGet":{"path":"/ready","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Never"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"minikube","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z"}],"hostIP":"10.0.2.15","podIP":"172.17.0.4","startTime":"2019-10-21T15:33:15Z","containerStatuses":[{"name":"cart","state":{"running":{"startedAt":"2019-10-21T15:33:16Z"}},"lastState":{},"ready":false,"restartCount":0,"image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","imageID":"docker://sha256:738a509b000132c58685974f4474e1e63fb31ea980d1f7acfcbc02c4cb0c4db4","containerID":"docker://50bf3895a995269b138bc0ad56a95b90853f27d5c3f9167139af3722e1f8d7cd"}],"qosClass":"BestEffort"}}]}
  2229. ]
  2230. 2019-10-21 15:33:21,879 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  2231. 2019-10-21 15:33:21,880 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  2232. 2019-10-21 15:33:21,890 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Looking up [Lookup(cart,None,Some(tcp))]
  2233. 2019-10-21 15:33:21,890 INFO  akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Querying for pods with label selector: [app=cart]. Namespace: [default]. Port: [None]
  2234. 2019-10-21 15:33:21,892 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /api/v1/namespaces/default/pods Empty]
  2235. 2019-10-21 15:33:21,893 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [13 ms]
  2236. 2019-10-21 15:33:21,893 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  2237. 2019-10-21 15:33:21,893 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  2238. 2019-10-21 15:33:21,894 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  2239. 2019-10-21 15:33:22,116 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Located service members based on: [Lookup(cart,None,Some(tcp))]: [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))], filtered to [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))]
  2240. 2019-10-21 15:33:22,117 DEBUG akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Ensuring probing actor: contactPointProbe-172-17-0-4.default.pod.cluster.local-8558
  2241. 2019-10-21 15:33:22,122 DEBUG akka.actor.TimerScheduler - Start timer [resolve-key] with generation [3]
  2242. 2019-10-21 15:33:22,132 DEBUG akka.management.cluster.bootstrap.internal.HttpContactPointBootstrap - Probing [http://172-17-0-4.default.pod.cluster.local:8558/bootstrap/seed-nodes] for seed nodes...
  2243. 2019-10-21 15:33:22,134 DEBUG akka.http.impl.engine.client.PoolGateway - (Re-)starting host connection pool to 172-17-0-4.default.pod.cluster.local:8558
  2244. 2019-10-21 15:33:22,140 DEBUG akka.http.impl.engine.client.PoolGateway - InputBuffer (max-open-requests = 32) now filled with 1 request after enqueuing GET /bootstrap/seed-nodes Empty
  2245. 2019-10-21 15:33:22,141 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Unconnected)] Dispatching request [GET /bootstrap/seed-nodes Empty]
  2246. 2019-10-21 15:33:22,141 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Unconnected)] Before event [onNewRequest] In state [Unconnected] for [1 ms]
  2247. 2019-10-21 15:33:22,141 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Unconnected)] Establishing connection
  2248. 2019-10-21 15:33:22,143 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] After event [onNewRequest] State change [Unconnected] -> [Connecting]
  2249. 2019-10-21 15:33:22,144 DEBUG akka.io.TcpOutgoingConnection - Resolving 172-17-0-4.default.pod.cluster.local before connecting
  2250. 2019-10-21 15:33:22,145 DEBUG akka.io.SimpleDnsManager - Resolution request for 172-17-0-4.default.pod.cluster.local from Actor[akka://application/system/IO-TCP/selectors/$a/2#1740125213]
  2251. 2019-10-21 15:33:22,248 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  2252. 2019-10-21 15:33:22,248 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [355 ms]
  2253. 2019-10-21 15:33:22,248 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  2254. 2019-10-21 15:33:22,248 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  2255. 2019-10-21 15:33:22,249 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  2256. 2019-10-21 15:33:22,249 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  2257. 2019-10-21 15:33:22,249 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [1 ms]
  2258. 2019-10-21 15:33:22,249 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  2259. 2019-10-21 15:33:22,250 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  2260. 2019-10-21 15:33:22,251 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Kubernetes API entity: [{"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces/default/pods","resourceVersion":"42754"},"items":[{"metadata":{"name":"cart-6588c46d86-cn69x","generateName":"cart-6588c46d86-","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/cart-6588c46d86-cn69x","uid":"d055b3ce-e9e0-4fb6-914d-f8669b8f2542","resourceVersion":"42737","creationTimestamp":"2019-10-21T15:33:15Z","labels":{"app":"cart","app.kubernetes.io/chartVersion":"0.1.0","app.kubernetes.io/imageTag":"97dd28b69615d2452a3ef11c1a4192d11523cb20","app.kubernetes.io/instance":"cart","app.kubernetes.io/managed-by":"Tiller","app.kubernetes.io/name":"cart","app.kubernetes.io/part-of":"backend","app.kubernetes.io/version":"97dd28b69615d2452a3ef11c1a4192d11523cb20","helm.sh/chart":"cart-0.1.0","pod-template-hash":"6588c46d86"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"cart-6588c46d86","uid":"7af461f6-e716-4a3c-b6ea-1b941e470f5e","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-s9gwc","secret":{"secretName":"default-token-s9gwc","defaultMode":420}}],"containers":[{"name":"cart","image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","ports":[{"name":"http","containerPort":9000,"protocol":"TCP"},{"name":"remoting","containerPort":2552,"protocol":"TCP"},{"name":"management","containerPort":8558,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"common-service-config"}},{"configMapRef":{"name":"cart-config"}}],"env":[{"name":"CLUSTER_BOOTSTRAP_SERVICE_NAME","value":"cart"},{"name":"CLUSTER_BOOTSTRAP_CONTACT_POINT_NR","value":"1"},{"name":"JAVA_OPTS","value":"-Xms256m -Xmx256m -Dconfig.resource=prod-application.conf"},{"name":"PLAY_HTTP_SECRET_KEY","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"http.play.secretKey"}}},{"name":"DB_USER","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.user"}}},{"name":"DB_PASS","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-s9gwc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/alive","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"readinessProbe":{"httpGet":{"path":"/ready","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Never"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"minikube","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z"}],"hostIP":"10.0.2.15","podIP":"172.17.0.4","startTime":"2019-10-21T15:33:15Z","containerStatuses":[{"name":"cart","state":{"running":{"startedAt":"2019-10-21T15:33:16Z"}},"lastState":{},"ready":false,"restartCount":0,"image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","imageID":"docker://sha256:738a509b000132c58685974f4474e1e63fb31ea980d1f7acfcbc02c4cb0c4db4","containerID":"docker://50bf3895a995269b138bc0ad56a95b90853f27d5c3f9167139af3722e1f8d7cd"}],"qosClass":"BestEffort"}}]}
  2261. ]
  2262. 2019-10-21 15:33:22,252 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Located service members based on: [Lookup(cart,None,Some(tcp))]: [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))], filtered to [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))]
  2263. 2019-10-21 15:33:22,253 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  2264. 2019-10-21 15:33:22,253 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  2265. 2019-10-21 15:33:22,253 DEBUG akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Ensuring probing actor: contactPointProbe-172-17-0-4.default.pod.cluster.local-8558
  2266. 2019-10-21 15:33:22,254 DEBUG akka.actor.TimerScheduler - Cancel timer [resolve-key] with generation [3]
  2267. 2019-10-21 15:33:22,254 DEBUG akka.actor.TimerScheduler - Start timer [resolve-key] with generation [4]
  2268. 2019-10-21 15:33:22,268 DEBUG akka.io.TcpOutgoingConnection - Attempting connection to [172-17-0-4.default.pod.cluster.local/172.17.0.4:8558]
  2269. 2019-10-21 15:33:22,286 DEBUG akka.io.TcpOutgoingConnection - Connection established to [172-17-0-4.default.pod.cluster.local:8558]
  2270. 2019-10-21 15:33:22,287 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] Connection attempt succeeded
  2271. 2019-10-21 15:33:22,287 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] Before event [onConnectionAttemptSucceeded] In state [Connecting] for [128 ms]
  2272. 2019-10-21 15:33:22,287 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Connecting)] Slot connection was established
  2273. 2019-10-21 15:33:22,288 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onConnectionAttemptSucceeded] State change [Connecting] -> [PushingRequestToConnection]
  2274. 2019-10-21 15:33:22,288 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  2275. 2019-10-21 15:33:22,288 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  2276. 2019-10-21 15:33:22,288 DEBUG akka.io.TcpListener - New connection accepted
  2277. 2019-10-21 15:33:22,357 DEBUG akka.serialization.Serialization(akka://application) - Using serializer [akka.cluster.ddata.protobuf.ReplicatorMessageSerializer] for message [akka.cluster.ddata.Replicator$Internal$DataEnvelope]
  2278. 2019-10-21 15:33:22,378 DEBUG akka.cluster.sharding.ShardRegion - CartProcessor: Request shard [eventworld.cart.impl.evt$CartEvent] home. Coordinator [None]
  2279. 2019-10-21 15:33:22,381 DEBUG akka.cluster.singleton.ClusterSingletonProxy - Singleton not available, buffering message type [com.lightbend.lagom.internal.persistence.cluster.ClusterStartupTaskActor$Execute$]
  2280. 2019-10-21 15:33:22,467 INFO  akka.management.cluster.bootstrap.contactpoint.HttpClusterBootstrapRoutes - Bootstrap request from 172.17.0.4:47536: Contact Point returning 0 seed-nodes ([TreeSet()])
  2281. 2019-10-21 15:33:22,498 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  2282. 2019-10-21 15:33:22,499 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [227 ms]
  2283. 2019-10-21 15:33:22,500 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  2284. 2019-10-21 15:33:22,500 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  2285. 2019-10-21 15:33:22,500 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  2286. 2019-10-21 15:33:22,501 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  2287. 2019-10-21 15:33:22,502 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [0 ms]
  2288. 2019-10-21 15:33:22,503 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  2289. 2019-10-21 15:33:22,503 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  2290. 2019-10-21 15:33:22,504 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  2291. 2019-10-21 15:33:22,504 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  2292. 2019-10-21 15:33:22,504 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Contact point [akka.tcp://application@172.17.0.4:2552] returned [0] seed-nodes []
  2293. 2019-10-21 15:33:22,504 DEBUG akka.actor.TimerScheduler - Start timer [probing-key] with generation [1]
  2294. 2019-10-21 15:33:22,617 DEBUG akka.discovery.dns.DnsServiceDiscovery - system resolver is not async-dns. Loading isolated resolver
  2295. 2019-10-21 15:33:22,622 INFO  akka.actor.ActorSystemImpl - Creating async dns resolver async-dns with manager name SD-DNS
  2296. 2019-10-21 15:33:22,818 DEBUG akka.management.cluster.bootstrap.LowestAddressJoinDecider - Contact points observations have changed more recently than the stable-margin [5000 milliseconds], changed at [2019-10-21T15:33:22.115], not joining myself. This process will be retried.
  2297. 2019-10-21 15:33:23,247 DEBUG akka.io.dns.internal.AsyncDnsResolver - Using name servers [List(/10.96.0.10:53)] and search domains [List(default.svc.cluster.local, svc.cluster.local, cluster.local)] with ndots=5
  2298. 2019-10-21 15:33:23,259 DEBUG akka.actor.TimerScheduler - Start timer [CacheCleanup] with generation [1]
  2299. 2019-10-21 15:33:23,459 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Looking up [Lookup(cart,None,Some(tcp))]
  2300. 2019-10-21 15:33:23,460 INFO  akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Querying for pods with label selector: [app=cart]. Namespace: [default]. Port: [None]
  2301. 2019-10-21 15:33:23,461 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /api/v1/namespaces/default/pods Empty]
  2302. 2019-10-21 15:33:23,461 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1208 ms]
  2303. 2019-10-21 15:33:23,461 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  2304. 2019-10-21 15:33:23,462 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  2305. 2019-10-21 15:33:23,462 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  2306. 2019-10-21 15:33:23,500 DEBUG akka.io.UdpListener - Successfully bound to [/0.0.0.0:47115]
  2307. 2019-10-21 15:33:23,586 DEBUG akka.io.dns.internal.DnsClient - Bound to UDP address [/0.0.0.0:47115]
  2308. 2019-10-21 15:33:23,590 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  2309. 2019-10-21 15:33:23,591 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [128 ms]
  2310. 2019-10-21 15:33:23,591 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  2311. 2019-10-21 15:33:23,591 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  2312. 2019-10-21 15:33:23,592 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  2313. 2019-10-21 15:33:23,592 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  2314. 2019-10-21 15:33:23,594 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [3 ms]
  2315. 2019-10-21 15:33:23,595 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  2316. 2019-10-21 15:33:23,595 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [1 ms]
  2317. 2019-10-21 15:33:23,595 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  2318. 2019-10-21 15:33:23,595 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  2319. 2019-10-21 15:33:23,596 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Kubernetes API entity: [{"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces/default/pods","resourceVersion":"42756"},"items":[{"metadata":{"name":"cart-6588c46d86-cn69x","generateName":"cart-6588c46d86-","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/cart-6588c46d86-cn69x","uid":"d055b3ce-e9e0-4fb6-914d-f8669b8f2542","resourceVersion":"42737","creationTimestamp":"2019-10-21T15:33:15Z","labels":{"app":"cart","app.kubernetes.io/chartVersion":"0.1.0","app.kubernetes.io/imageTag":"97dd28b69615d2452a3ef11c1a4192d11523cb20","app.kubernetes.io/instance":"cart","app.kubernetes.io/managed-by":"Tiller","app.kubernetes.io/name":"cart","app.kubernetes.io/part-of":"backend","app.kubernetes.io/version":"97dd28b69615d2452a3ef11c1a4192d11523cb20","helm.sh/chart":"cart-0.1.0","pod-template-hash":"6588c46d86"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"cart-6588c46d86","uid":"7af461f6-e716-4a3c-b6ea-1b941e470f5e","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-s9gwc","secret":{"secretName":"default-token-s9gwc","defaultMode":420}}],"containers":[{"name":"cart","image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","ports":[{"name":"http","containerPort":9000,"protocol":"TCP"},{"name":"remoting","containerPort":2552,"protocol":"TCP"},{"name":"management","containerPort":8558,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"common-service-config"}},{"configMapRef":{"name":"cart-config"}}],"env":[{"name":"CLUSTER_BOOTSTRAP_SERVICE_NAME","value":"cart"},{"name":"CLUSTER_BOOTSTRAP_CONTACT_POINT_NR","value":"1"},{"name":"JAVA_OPTS","value":"-Xms256m -Xmx256m -Dconfig.resource=prod-application.conf"},{"name":"PLAY_HTTP_SECRET_KEY","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"http.play.secretKey"}}},{"name":"DB_USER","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.user"}}},{"name":"DB_PASS","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-s9gwc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/alive","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"readinessProbe":{"httpGet":{"path":"/ready","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Never"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"minikube","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z"}],"hostIP":"10.0.2.15","podIP":"172.17.0.4","startTime":"2019-10-21T15:33:15Z","containerStatuses":[{"name":"cart","state":{"running":{"startedAt":"2019-10-21T15:33:16Z"}},"lastState":{},"ready":false,"restartCount":0,"image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","imageID":"docker://sha256:738a509b000132c58685974f4474e1e63fb31ea980d1f7acfcbc02c4cb0c4db4","containerID":"docker://50bf3895a995269b138bc0ad56a95b90853f27d5c3f9167139af3722e1f8d7cd"}],"qosClass":"BestEffort"}}]}
  2320. ]
  2321. 2019-10-21 15:33:23,631 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Located service members based on: [Lookup(cart,None,Some(tcp))]: [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))], filtered to [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))]
  2322. 2019-10-21 15:33:23,631 DEBUG akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Ensuring probing actor: contactPointProbe-172-17-0-4.default.pod.cluster.local-8558
  2323. 2019-10-21 15:33:23,631 DEBUG akka.actor.TimerScheduler - Start timer [resolve-key] with generation [5]
  2324. 2019-10-21 15:33:23,744 DEBUG akka.management.cluster.bootstrap.internal.HttpContactPointBootstrap - Probing [http://172-17-0-4.default.pod.cluster.local:8558/bootstrap/seed-nodes] for seed nodes...
  2325. 2019-10-21 15:33:23,745 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /bootstrap/seed-nodes Empty]
  2326. 2019-10-21 15:33:23,745 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1245 ms]
  2327. 2019-10-21 15:33:23,745 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  2328. 2019-10-21 15:33:23,745 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  2329. 2019-10-21 15:33:23,745 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  2330. 2019-10-21 15:33:23,750 DEBUG akka.management.cluster.bootstrap.LowestAddressJoinDecider - Contact points observations have changed more recently than the stable-margin [5000 milliseconds], changed at [2019-10-21T15:33:22.115], not joining myself. This process will be retried.
  2331. 2019-10-21 15:33:23,759 INFO  akka.management.cluster.bootstrap.contactpoint.HttpClusterBootstrapRoutes - Bootstrap request from 172.17.0.4:47536: Contact Point returning 0 seed-nodes ([TreeSet()])
  2332. 2019-10-21 15:33:23,765 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  2333. 2019-10-21 15:33:23,766 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [16 ms]
  2334. 2019-10-21 15:33:23,766 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  2335. 2019-10-21 15:33:23,766 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  2336. 2019-10-21 15:33:23,766 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  2337. 2019-10-21 15:33:23,766 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  2338. 2019-10-21 15:33:23,766 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [0 ms]
  2339. 2019-10-21 15:33:23,766 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  2340. 2019-10-21 15:33:23,766 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  2341. 2019-10-21 15:33:23,766 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  2342. 2019-10-21 15:33:23,766 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  2343. 2019-10-21 15:33:23,766 DEBUG akka.actor.TimerScheduler - Start timer [probing-key] with generation [2]
  2344. 2019-10-21 15:33:23,766 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Contact point [akka.tcp://application@172.17.0.4:2552] returned [0] seed-nodes []
  2345. 2019-10-21 15:33:24,538 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart: Request shard [singleton] home. Coordinator [None]
  2346. 2019-10-21 15:33:24,545 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_reservation: Request shard [singleton] home. Coordinator [None]
  2347. 2019-10-21 15:33:24,560 DEBUG akka.cluster.sharding.ShardRegion - kafkaProducer-cart_price_offer: Request shard [singleton] home. Coordinator [None]
  2348. 2019-10-21 15:33:24,600 DEBUG akka.kafka.internal.KafkaConsumerActor - Creating Kafka consumer with akka.kafka.ConsumerSettings(properties=auto.offset.reset -> earliest,group.id -> cart,bootstrap.servers -> kafka:9092,enable.auto.commit -> false,client.id -> cart-2,keyDeserializer=Some(org.apache.kafka.common.serialization.StringDeserializer@273132d2),valueDeserializer=Some(com.lightbend.lagom.internal.scaladsl.broker.kafka.ScaladslKafkaDeserializer@6bc833ff),pollInterval=1 second,pollTimeout=50 milliseconds,stopTimeout=30 seconds,closeTimeout=20 seconds,commitTimeout=15 seconds,commitRefreshInterval=Duration.Inf,dispatcher=akka.kafka.default-dispatcher,commitTimeWarning=1 second,waitClosePartition=500 milliseconds,metadataRequestTimeout=5 seconds)
  2349. 2019-10-21 15:33:24,602 DEBUG akka.kafka.internal.KafkaConsumerActor - Creating Kafka consumer with akka.kafka.ConsumerSettings(properties=auto.offset.reset -> earliest,group.id -> cart,bootstrap.servers -> kafka:9092,enable.auto.commit -> false,client.id -> cart-1,keyDeserializer=Some(org.apache.kafka.common.serialization.StringDeserializer@1cba3e7a),valueDeserializer=Some(com.lightbend.lagom.internal.scaladsl.broker.kafka.ScaladslKafkaDeserializer@127dd39d),pollInterval=1 second,pollTimeout=50 milliseconds,stopTimeout=30 seconds,closeTimeout=20 seconds,commitTimeout=15 seconds,commitRefreshInterval=Duration.Inf,dispatcher=akka.kafka.default-dispatcher,commitTimeWarning=1 second,waitClosePartition=500 milliseconds,metadataRequestTimeout=5 seconds)
  2350. 2019-10-21 15:33:24,604 DEBUG akka.kafka.internal.KafkaConsumerActor - Creating Kafka consumer with akka.kafka.ConsumerSettings(properties=auto.offset.reset -> earliest,group.id -> cart,bootstrap.servers -> kafka:9092,enable.auto.commit -> false,client.id -> cart-3,keyDeserializer=Some(org.apache.kafka.common.serialization.StringDeserializer@34f27046),valueDeserializer=Some(com.lightbend.lagom.internal.scaladsl.broker.kafka.ScaladslKafkaDeserializer@3a3588a8),pollInterval=1 second,pollTimeout=50 milliseconds,stopTimeout=30 seconds,closeTimeout=20 seconds,commitTimeout=15 seconds,commitRefreshInterval=Duration.Inf,dispatcher=akka.kafka.default-dispatcher,commitTimeWarning=1 second,waitClosePartition=500 milliseconds,metadataRequestTimeout=5 seconds)
  2351. 2019-10-21 15:33:24,715 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Looking up [Lookup(cart,None,Some(tcp))]
  2352. 2019-10-21 15:33:24,716 INFO  akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Querying for pods with label selector: [app=cart]. Namespace: [default]. Port: [None]
  2353. 2019-10-21 15:33:24,718 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /api/v1/namespaces/default/pods Empty]
  2354. 2019-10-21 15:33:24,718 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1123 ms]
  2355. 2019-10-21 15:33:24,719 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  2356. 2019-10-21 15:33:24,719 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  2357. 2019-10-21 15:33:24,719 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  2358. 2019-10-21 15:33:24,730 DEBUG akka.management.cluster.bootstrap.LowestAddressJoinDecider - Contact points observations have changed more recently than the stable-margin [5000 milliseconds], changed at [2019-10-21T15:33:22.115], not joining myself. This process will be retried.
  2359. 2019-10-21 15:33:24,738 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  2360. 2019-10-21 15:33:24,738 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [19 ms]
  2361. 2019-10-21 15:33:24,738 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  2362. 2019-10-21 15:33:24,738 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  2363. 2019-10-21 15:33:24,738 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  2364. 2019-10-21 15:33:24,738 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  2365. 2019-10-21 15:33:24,740 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [2 ms]
  2366. 2019-10-21 15:33:24,740 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  2367. 2019-10-21 15:33:24,746 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [4 ms]
  2368. 2019-10-21 15:33:24,747 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  2369. 2019-10-21 15:33:24,747 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  2370. 2019-10-21 15:33:24,747 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Kubernetes API entity: [{"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces/default/pods","resourceVersion":"42756"},"items":[{"metadata":{"name":"cart-6588c46d86-cn69x","generateName":"cart-6588c46d86-","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/cart-6588c46d86-cn69x","uid":"d055b3ce-e9e0-4fb6-914d-f8669b8f2542","resourceVersion":"42737","creationTimestamp":"2019-10-21T15:33:15Z","labels":{"app":"cart","app.kubernetes.io/chartVersion":"0.1.0","app.kubernetes.io/imageTag":"97dd28b69615d2452a3ef11c1a4192d11523cb20","app.kubernetes.io/instance":"cart","app.kubernetes.io/managed-by":"Tiller","app.kubernetes.io/name":"cart","app.kubernetes.io/part-of":"backend","app.kubernetes.io/version":"97dd28b69615d2452a3ef11c1a4192d11523cb20","helm.sh/chart":"cart-0.1.0","pod-template-hash":"6588c46d86"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"cart-6588c46d86","uid":"7af461f6-e716-4a3c-b6ea-1b941e470f5e","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-s9gwc","secret":{"secretName":"default-token-s9gwc","defaultMode":420}}],"containers":[{"name":"cart","image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","ports":[{"name":"http","containerPort":9000,"protocol":"TCP"},{"name":"remoting","containerPort":2552,"protocol":"TCP"},{"name":"management","containerPort":8558,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"common-service-config"}},{"configMapRef":{"name":"cart-config"}}],"env":[{"name":"CLUSTER_BOOTSTRAP_SERVICE_NAME","value":"cart"},{"name":"CLUSTER_BOOTSTRAP_CONTACT_POINT_NR","value":"1"},{"name":"JAVA_OPTS","value":"-Xms256m -Xmx256m -Dconfig.resource=prod-application.conf"},{"name":"PLAY_HTTP_SECRET_KEY","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"http.play.secretKey"}}},{"name":"DB_USER","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.user"}}},{"name":"DB_PASS","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-s9gwc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/alive","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"readinessProbe":{"httpGet":{"path":"/ready","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Never"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"minikube","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z"}],"hostIP":"10.0.2.15","podIP":"172.17.0.4","startTime":"2019-10-21T15:33:15Z","containerStatuses":[{"name":"cart","state":{"running":{"startedAt":"2019-10-21T15:33:16Z"}},"lastState":{},"ready":false,"restartCount":0,"image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","imageID":"docker://sha256:738a509b000132c58685974f4474e1e63fb31ea980d1f7acfcbc02c4cb0c4db4","containerID":"docker://50bf3895a995269b138bc0ad56a95b90853f27d5c3f9167139af3722e1f8d7cd"}],"qosClass":"BestEffort"}}]}
  2371. ]
  2372. 2019-10-21 15:33:24,765 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Located service members based on: [Lookup(cart,None,Some(tcp))]: [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))], filtered to [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))]
  2373. 2019-10-21 15:33:24,765 DEBUG akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Ensuring probing actor: contactPointProbe-172-17-0-4.default.pod.cluster.local-8558
  2374. 2019-10-21 15:33:24,765 DEBUG akka.actor.TimerScheduler - Start timer [resolve-key] with generation [6]
  2375. 2019-10-21 15:33:24,882 DEBUG akka.io.TcpListener - Successfully bound to /0.0.0.0:9000
  2376. 2019-10-21 15:33:24,912 DEBUG akka.management.cluster.bootstrap.internal.HttpContactPointBootstrap - Probing [http://172-17-0-4.default.pod.cluster.local:8558/bootstrap/seed-nodes] for seed nodes...
  2377. 2019-10-21 15:33:24,916 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /bootstrap/seed-nodes Empty]
  2378. 2019-10-21 15:33:24,917 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1154 ms]
  2379. 2019-10-21 15:33:24,917 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  2380. 2019-10-21 15:33:24,917 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  2381. 2019-10-21 15:33:24,918 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  2382. 2019-10-21 15:33:25,008 INFO  akka.management.cluster.bootstrap.contactpoint.HttpClusterBootstrapRoutes - Bootstrap request from 172.17.0.4:47536: Contact Point returning 0 seed-nodes ([TreeSet()])
  2383. 2019-10-21 15:33:25,009 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  2384. 2019-10-21 15:33:25,009 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [92 ms]
  2385. 2019-10-21 15:33:25,009 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  2386. 2019-10-21 15:33:25,010 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  2387. 2019-10-21 15:33:25,010 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  2388. 2019-10-21 15:33:25,011 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  2389. 2019-10-21 15:33:25,011 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [0 ms]
  2390. 2019-10-21 15:33:25,011 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  2391. 2019-10-21 15:33:25,011 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  2392. 2019-10-21 15:33:25,011 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  2393. 2019-10-21 15:33:25,012 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  2394. 2019-10-21 15:33:25,012 DEBUG akka.actor.TimerScheduler - Start timer [probing-key] with generation [3]
  2395. 2019-10-21 15:33:25,012 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Contact point [akka.tcp://application@172.17.0.4:2552] returned [0] seed-nodes []
  2396. 2019-10-21 15:33:25,126 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [1]
  2397. 2019-10-21 15:33:25,127 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [1]
  2398. 2019-10-21 15:33:25,127 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [1]
  2399. 2019-10-21 15:33:25,753 DEBUG akka.management.cluster.bootstrap.LowestAddressJoinDecider - Contact points observations have changed more recently than the stable-margin [5000 milliseconds], changed at [2019-10-21T15:33:22.115], not joining myself. This process will be retried.
  2400. 2019-10-21 15:33:25,810 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Looking up [Lookup(cart,None,Some(tcp))]
  2401. 2019-10-21 15:33:25,816 INFO  akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Querying for pods with label selector: [app=cart]. Namespace: [default]. Port: [None]
  2402. 2019-10-21 15:33:25,819 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /api/v1/namespaces/default/pods Empty]
  2403. 2019-10-21 15:33:25,840 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1073 ms]
  2404. 2019-10-21 15:33:25,862 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  2405. 2019-10-21 15:33:25,862 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  2406. 2019-10-21 15:33:25,862 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  2407. 2019-10-21 15:33:26,143 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  2408. 2019-10-21 15:33:26,144 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [325 ms]
  2409. 2019-10-21 15:33:26,146 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  2410. 2019-10-21 15:33:26,146 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  2411. 2019-10-21 15:33:26,147 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [2 ms]
  2412. 2019-10-21 15:33:26,147 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  2413. 2019-10-21 15:33:26,152 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [5 ms]
  2414. 2019-10-21 15:33:26,152 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  2415. 2019-10-21 15:33:26,153 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  2416. 2019-10-21 15:33:26,153 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  2417. 2019-10-21 15:33:26,153 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  2418. 2019-10-21 15:33:26,153 DEBUG akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Kubernetes API entity: [{"kind":"PodList","apiVersion":"v1","metadata":{"selfLink":"/api/v1/namespaces/default/pods","resourceVersion":"42759"},"items":[{"metadata":{"name":"cart-6588c46d86-cn69x","generateName":"cart-6588c46d86-","namespace":"default","selfLink":"/api/v1/namespaces/default/pods/cart-6588c46d86-cn69x","uid":"d055b3ce-e9e0-4fb6-914d-f8669b8f2542","resourceVersion":"42737","creationTimestamp":"2019-10-21T15:33:15Z","labels":{"app":"cart","app.kubernetes.io/chartVersion":"0.1.0","app.kubernetes.io/imageTag":"97dd28b69615d2452a3ef11c1a4192d11523cb20","app.kubernetes.io/instance":"cart","app.kubernetes.io/managed-by":"Tiller","app.kubernetes.io/name":"cart","app.kubernetes.io/part-of":"backend","app.kubernetes.io/version":"97dd28b69615d2452a3ef11c1a4192d11523cb20","helm.sh/chart":"cart-0.1.0","pod-template-hash":"6588c46d86"},"ownerReferences":[{"apiVersion":"apps/v1","kind":"ReplicaSet","name":"cart-6588c46d86","uid":"7af461f6-e716-4a3c-b6ea-1b941e470f5e","controller":true,"blockOwnerDeletion":true}]},"spec":{"volumes":[{"name":"default-token-s9gwc","secret":{"secretName":"default-token-s9gwc","defaultMode":420}}],"containers":[{"name":"cart","image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","ports":[{"name":"http","containerPort":9000,"protocol":"TCP"},{"name":"remoting","containerPort":2552,"protocol":"TCP"},{"name":"management","containerPort":8558,"protocol":"TCP"}],"envFrom":[{"configMapRef":{"name":"common-service-config"}},{"configMapRef":{"name":"cart-config"}}],"env":[{"name":"CLUSTER_BOOTSTRAP_SERVICE_NAME","value":"cart"},{"name":"CLUSTER_BOOTSTRAP_CONTACT_POINT_NR","value":"1"},{"name":"JAVA_OPTS","value":"-Xms256m -Xmx256m -Dconfig.resource=prod-application.conf"},{"name":"PLAY_HTTP_SECRET_KEY","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"http.play.secretKey"}}},{"name":"DB_USER","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.user"}}},{"name":"DB_PASS","valueFrom":{"secretKeyRef":{"name":"common-service-secret","key":"postgres.password"}}}],"resources":{},"volumeMounts":[{"name":"default-token-s9gwc","readOnly":true,"mountPath":"/var/run/secrets/kubernetes.io/serviceaccount"}],"livenessProbe":{"httpGet":{"path":"/alive","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"readinessProbe":{"httpGet":{"path":"/ready","port":"management","scheme":"HTTP"},"initialDelaySeconds":20,"timeoutSeconds":1,"periodSeconds":10,"successThreshold":1,"failureThreshold":10},"terminationMessagePath":"/dev/termination-log","terminationMessagePolicy":"File","imagePullPolicy":"Never"}],"restartPolicy":"Always","terminationGracePeriodSeconds":30,"dnsPolicy":"ClusterFirst","serviceAccountName":"default","serviceAccount":"default","nodeName":"minikube","securityContext":{},"schedulerName":"default-scheduler","tolerations":[{"key":"node.kubernetes.io/not-ready","operator":"Exists","effect":"NoExecute","tolerationSeconds":300},{"key":"node.kubernetes.io/unreachable","operator":"Exists","effect":"NoExecute","tolerationSeconds":300}],"priority":0,"enableServiceLinks":true},"status":{"phase":"Running","conditions":[{"type":"Initialized","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z"},{"type":"Ready","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"ContainersReady","status":"False","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z","reason":"ContainersNotReady","message":"containers with unready status: [cart]"},{"type":"PodScheduled","status":"True","lastProbeTime":null,"lastTransitionTime":"2019-10-21T15:33:15Z"}],"hostIP":"10.0.2.15","podIP":"172.17.0.4","startTime":"2019-10-21T15:33:15Z","containerStatuses":[{"name":"cart","state":{"running":{"startedAt":"2019-10-21T15:33:16Z"}},"lastState":{},"ready":false,"restartCount":0,"image":"cart:97dd28b69615d2452a3ef11c1a4192d11523cb20","imageID":"docker://sha256:738a509b000132c58685974f4474e1e63fb31ea980d1f7acfcbc02c4cb0c4db4","containerID":"docker://50bf3895a995269b138bc0ad56a95b90853f27d5c3f9167139af3722e1f8d7cd"}],"qosClass":"BestEffort"}}]}
  2419. ]
  2420. 2019-10-21 15:33:26,192 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Located service members based on: [Lookup(cart,None,Some(tcp))]: [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))], filtered to [ResolvedTarget(172-17-0-4.default.pod.cluster.local,None,Some(/172.17.0.4))]
  2421. 2019-10-21 15:33:26,192 DEBUG akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Ensuring probing actor: contactPointProbe-172-17-0-4.default.pod.cluster.local-8558
  2422. 2019-10-21 15:33:26,192 DEBUG akka.actor.TimerScheduler - Start timer [resolve-key] with generation [7]
  2423. 2019-10-21 15:33:26,200 DEBUG akka.management.cluster.bootstrap.internal.HttpContactPointBootstrap - Probing [http://172-17-0-4.default.pod.cluster.local:8558/bootstrap/seed-nodes] for seed nodes...
  2424. 2019-10-21 15:33:26,201 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /bootstrap/seed-nodes Empty]
  2425. 2019-10-21 15:33:26,201 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1191 ms]
  2426. 2019-10-21 15:33:26,201 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  2427. 2019-10-21 15:33:26,201 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  2428. 2019-10-21 15:33:26,201 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  2429. 2019-10-21 15:33:26,203 INFO  akka.management.cluster.bootstrap.contactpoint.HttpClusterBootstrapRoutes - Bootstrap request from 172.17.0.4:47536: Contact Point returning 0 seed-nodes ([TreeSet()])
  2430. 2019-10-21 15:33:26,204 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  2431. 2019-10-21 15:33:26,205 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [3 ms]
  2432. 2019-10-21 15:33:26,205 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  2433. 2019-10-21 15:33:26,205 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  2434. 2019-10-21 15:33:26,205 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  2435. 2019-10-21 15:33:26,210 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  2436. 2019-10-21 15:33:26,211 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [5 ms]
  2437. 2019-10-21 15:33:26,211 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  2438. 2019-10-21 15:33:26,211 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  2439. 2019-10-21 15:33:26,211 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  2440. 2019-10-21 15:33:26,211 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  2441. 2019-10-21 15:33:26,226 DEBUG akka.actor.TimerScheduler - Start timer [probing-key] with generation [4]
  2442. 2019-10-21 15:33:26,226 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Contact point [akka.tcp://application@172.17.0.4:2552] returned [0] seed-nodes []
  2443. 2019-10-21 15:33:26,737 DEBUG akka.management.cluster.bootstrap.LowestAddressJoinDecider - Contact points observations have changed more recently than the stable-margin [5000 milliseconds], changed at [2019-10-21T15:33:22.115], not joining myself. This process will be retried.
  2444. 2019-10-21 15:33:27,205 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [2]
  2445. 2019-10-21 15:33:27,206 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [2]
  2446. 2019-10-21 15:33:27,207 DEBUG akka.actor.TimerScheduler - Start timer [PollTask] with generation [2]
  2447. 2019-10-21 15:33:27,318 DEBUG akka.management.cluster.bootstrap.internal.HttpContactPointBootstrap - Probing [http://172-17-0-4.default.pod.cluster.local:8558/bootstrap/seed-nodes] for seed nodes...
  2448. 2019-10-21 15:33:27,320 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /bootstrap/seed-nodes Empty]
  2449. 2019-10-21 15:33:27,322 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1107 ms]
  2450. 2019-10-21 15:33:27,322 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  2451. 2019-10-21 15:33:27,323 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  2452. 2019-10-21 15:33:27,323 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  2453. 2019-10-21 15:33:27,329 INFO  akka.management.cluster.bootstrap.contactpoint.HttpClusterBootstrapRoutes - Bootstrap request from 172.17.0.4:47536: Contact Point returning 0 seed-nodes ([TreeSet()])
  2454. 2019-10-21 15:33:27,331 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Received response
  2455. 2019-10-21 15:33:27,331 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] Before event [onResponseReceived] In state [WaitingForResponse] for [12 ms]
  2456. 2019-10-21 15:33:27,331 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] onResponseReceived in WaitingForResponse with false
  2457. 2019-10-21 15:33:27,331 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] After event [onResponseReceived] State change [WaitingForResponse] -> [WaitingForResponseDispatch]
  2458. 2019-10-21 15:33:27,331 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseDispatch)] Before event [onResponseDispatchable] In state [WaitingForResponseDispatch] for [0 ms]
  2459. 2019-10-21 15:33:27,331 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] After event [onResponseDispatchable] State change [WaitingForResponseDispatch] -> [WaitingForResponseEntitySubscription]
  2460. 2019-10-21 15:33:27,331 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponseEntitySubscription)] Before event [onResponseEntitySubscribed] In state [WaitingForResponseEntitySubscription] for [0 ms]
  2461. 2019-10-21 15:33:27,331 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] After event [onResponseEntitySubscribed] State change [WaitingForResponseEntitySubscription] -> [WaitingForEndOfResponseEntity]
  2462. 2019-10-21 15:33:27,331 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForEndOfResponseEntity)] Before event [onResponseEntityCompleted] In state [WaitingForEndOfResponseEntity] for [0 ms]
  2463. 2019-10-21 15:33:27,331 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] After event [onResponseEntityCompleted] State change [WaitingForEndOfResponseEntity] -> [Idle]
  2464. 2019-10-21 15:33:27,332 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Slot became idle... Trying to pull
  2465. 2019-10-21 15:33:27,332 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Contact point [akka.tcp://application@172.17.0.4:2552] returned [0] seed-nodes []
  2466. 2019-10-21 15:33:27,332 DEBUG akka.actor.TimerScheduler - Start timer [probing-key] with generation [5]
  2467. 2019-10-21 15:33:27,364 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Looking up [Lookup(cart,None,Some(tcp))]
  2468. 2019-10-21 15:33:27,368 INFO  akka.discovery.kubernetes.KubernetesApiServiceDiscovery - Querying for pods with label selector: [app=cart]. Namespace: [default]. Port: [None]
  2469. 2019-10-21 15:33:27,369 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Dispatching request [GET /api/v1/namespaces/default/pods Empty]
  2470. 2019-10-21 15:33:27,369 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (Idle)] Before event [onNewRequest] In state [Idle] for [1215 ms]
  2471. 2019-10-21 15:33:27,370 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] After event [onNewRequest] State change [Idle] -> [PushingRequestToConnection]
  2472. 2019-10-21 15:33:27,370 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (PushingRequestToConnection)] Before event [onRequestDispatched] In state [PushingRequestToConnection] for [0 ms]
  2473. 2019-10-21 15:33:27,370 DEBUG akka.http.impl.engine.client.PoolGateway - [0 (WaitingForResponse)] After event [onRequestDispatched] State change [PushingRequestToConnection] -> [WaitingForResponse]
  2474. 2019-10-21 15:33:27,930 INFO  akka.management.cluster.bootstrap.internal.BootstrapCoordinator - Initiating new cluster, self-joining [akka.tcp://application@172.17.0.4:2552]. Other nodes are expected to locate this cluster via continued contact-point probing.
RAW Paste Data
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy. OK, I Understand
 
Top