123

Setting memory threshold on 'rabbit@node-5' to 0.4 ...
...done.
INFO       2015-06-12 08:20:19,116 MainThread     : Use amqp nodes: 10.109.2.4:5673,10.109.2.5:5673,10.109.2.6:5673
INFO       2015-06-12 08:20:19,116 MainThread     : Start publisher worker
INFO       2015-06-12 08:20:19,117 Thread-1       : Connect to amqp://nova:bOgj3Obj@10.109.2.4:5673/%2F?connection_attempts=3&heartbeat_interval=3600
INFO       2015-06-12 08:20:19,118 Thread-1       : Connecting to 10.109.2.4:5673
INFO       2015-06-12 08:20:19,118 MainThread     : Start publisher worker
INFO       2015-06-12 08:20:19,118 Thread-2       : Connect to amqp://nova:bOgj3Obj@10.109.2.5:5673/%2F?connection_attempts=3&heartbeat_interval=3600
INFO       2015-06-12 08:20:19,119 Thread-2       : Connecting to 10.109.2.5:5673
INFO       2015-06-12 08:20:19,119 MainThread     : Start publisher worker
INFO       2015-06-12 08:20:19,120 Thread-3       : Connect to amqp://nova:bOgj3Obj@10.109.2.6:5673/%2F?connection_attempts=3&heartbeat_interval=3600
INFO       2015-06-12 08:20:19,120 Thread-3       : Connecting to 10.109.2.6:5673
INFO       2015-06-12 08:20:19,125 Thread-1       : Connection opened
INFO       2015-06-12 08:20:19,128 Thread-3       : Connection opened
INFO       2015-06-12 08:20:19,131 Thread-2       : Connection opened
INFO       2015-06-12 08:20:19,133 Thread-1       : Bind exchange metering1 to queue metering1 with routing key / for publisher
INFO       2015-06-12 08:20:19,136 Thread-2       : Bind exchange metering2 to queue metering2 with routing key / for publisher
INFO       2015-06-12 08:20:19,136 Thread-1       : Start publishing
INFO       2015-06-12 08:20:19,137 Thread-2       : Start publishing
INFO       2015-06-12 08:20:19,147 Thread-3       : Bind exchange metering3 to queue metering3 with routing key / for publisher
INFO       2015-06-12 08:20:19,149 Thread-3       : Start publishing
Setting memory threshold on 'rabbit@node-5' to 0.0 ...
...done.
metering1	261	running
metering2	258	running
metering3	257	running
[{{resource_limit,memory,'rabbit@node-5'},[]}]
10.109.2.6:38247 -> 10.109.2.5:5673	blocked
10.109.2.6:48920 -> 10.109.2.4:5673	blocked
10.109.2.6:49723 -> 10.109.2.6:5673	blocked
INFO       2015-06-12 08:20:22,662 MainThread     : Use amqp nodes: 10.109.2.4:5673,10.109.2.5:5673,10.109.2.6:5673
metering1	261	running
metering2	258	running
metering3	257	running
Setting memory threshold on 'rabbit@node-5' to 0.0 ...
...done.
[{{resource_limit,memory,'rabbit@node-5'},[]}]
10.109.2.6:38247 -> 10.109.2.5:5673	blocked
10.109.2.6:48920 -> 10.109.2.4:5673	blocked
10.109.2.6:49723 -> 10.109.2.6:5673	blocked
metering1	261	running
metering2	258	running
metering3	257	running
Setting memory threshold on 'rabbit@node-5' to 0.0 ...
...done.
[]
metering1	493	running
metering2	495	running
metering3	712	running
Setting memory threshold on 'rabbit@node-5' to 0.0 ...
...done.
[{{resource_limit,memory,'rabbit@node-5'},[]}]
10.109.2.6:38247 -> 10.109.2.5:5673	blocked
10.109.2.6:48920 -> 10.109.2.4:5673	blocked
10.109.2.6:49723 -> 10.109.2.6:5673	blocked
metering1	516	running
metering2	517	running
metering3	735	running
Setting memory threshold on 'rabbit@node-5' to 0.0 ...
...done.
INFO       2015-06-12 08:20:30,570 Thread-3       : Max publishing rate: 86.0
INFO       2015-06-12 08:20:30,570 Thread-3       : Channel.close(200, Normal shutdown)
INFO       2015-06-12 08:20:30,570 Thread-3       : Closing connection (200): Normal shutdown
INFO       2015-06-12 08:20:30,570 Thread-3       : Connection closed
[{{resource_limit,memory,'rabbit@node-5'},[]}]
INFO       2015-06-12 08:20:30,586 Thread-1       : Max publishing rate: 86.2857142857
INFO       2015-06-12 08:20:30,586 Thread-1       : Channel.close(200, Normal shutdown)
INFO       2015-06-12 08:20:30,586 Thread-1       : Closing connection (200): Normal shutdown
INFO       2015-06-12 08:20:30,586 Thread-1       : Connection closed
INFO       2015-06-12 08:20:30,584 Thread-2       : Max publishing rate: 85.9090909091
INFO       2015-06-12 08:20:30,587 Thread-2       : Channel.close(200, Normal shutdown)
INFO       2015-06-12 08:20:30,587 Thread-2       : Closing connection (200): Normal shutdown
INFO       2015-06-12 08:20:30,587 Thread-2       : Connection closed
INFO       2015-06-12 08:20:30,587 MainThread     : Connection closed
10.109.2.6:38247 -> 10.109.2.5:5673	blocked
10.109.2.6:48920 -> 10.109.2.4:5673	blocked
10.109.2.6:49723 -> 10.109.2.6:5673	blocked
metering1	516	running
metering2	517	running
metering3	735	running
Setting memory threshold on 'rabbit@node-5' to 0.0 ...
...done.
[{{resource_limit,memory,'rabbit@node-5'},[]}]
10.109.2.6:38247 -> 10.109.2.5:5673	blocked
10.109.2.6:48920 -> 10.109.2.4:5673	blocked
10.109.2.6:49723 -> 10.109.2.6:5673	blocked
INFO       2015-06-12 08:20:32,672 MainThread     : Consume from shifted amqp nodes ['10.109.2.6:5673', '10.109.2.4:5673', '10.109.2.5:5673']
INFO       2015-06-12 08:20:32,672 MainThread     : Start consumer worker
INFO       2015-06-12 08:20:32,672 MainThread     : Start consumer worker
INFO       2015-06-12 08:20:32,672 MainThread     : Start consumer worker
INFO       2015-06-12 08:20:32,673 Thread-1       : Connect to amqp://nova:bOgj3Obj@10.109.2.6:5673/%2F?connection_attempts=3&heartbeat_interval=3600
INFO       2015-06-12 08:20:32,674 Thread-1       : Connecting to 10.109.2.6:5673
INFO       2015-06-12 08:20:32,678 Thread-1       : Connection opened
INFO       2015-06-12 08:20:32,680 Thread-2       : Connect to amqp://nova:bOgj3Obj@10.109.2.4:5673/%2F?connection_attempts=3&heartbeat_interval=3600
INFO       2015-06-12 08:20:32,681 Thread-2       : Connecting to 10.109.2.4:5673
INFO       2015-06-12 08:20:32,681 Thread-3       : Connect to amqp://nova:bOgj3Obj@10.109.2.5:5673/%2F?connection_attempts=3&heartbeat_interval=3600
INFO       2015-06-12 08:20:32,682 MainThread     : Delivery verification note: expected #3000 messages
INFO       2015-06-12 08:20:32,682 Thread-3       : Connecting to 10.109.2.5:5673
INFO       2015-06-12 08:20:32,682 Thread-1       : Bind metering1 to metering1 with / for consumer
INFO       2015-06-12 08:20:32,695 Thread-2       : Connection opened
INFO       2015-06-12 08:20:32,698 Thread-3       : Connection opened
INFO       2015-06-12 08:20:32,706 Thread-2       : Bind metering2 to metering2 with / for consumer
INFO       2015-06-12 08:20:32,727 Thread-3       : Bind metering3 to metering3 with / for consumer
metering1	442	running
metering2	442	running
metering3	673	running
Setting memory threshold on 'rabbit@node-5' to 0.0 ...
...done.
[{{resource_limit,memory,'rabbit@node-5'},[]}]
10.109.2.6:38247 -> 10.109.2.5:5673	blocked
10.109.2.6:48920 -> 10.109.2.4:5673	blocked
10.109.2.6:49723 -> 10.109.2.6:5673	blocked
metering1	0	running
metering2	0	running
metering3	0	running
Setting memory threshold on 'rabbit@node-5' to 0.0 ...
...done.
[{{resource_limit,memory,'rabbit@node-5'},[]}]
10.109.2.6:38247 -> 10.109.2.5:5673	blocked
10.109.2.6:48920 -> 10.109.2.4:5673	blocked
10.109.2.6:49723 -> 10.109.2.6:5673	blocked
metering1	0	running
metering2	0	running
metering3	0	running
Setting memory threshold on 'rabbit@node-5' to 0.0 ...
...done.
[]