Guest User

Logs

a guest
May 8th, 2026
272
0
Never
1
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 31.36 KB | None | 0 0
  1. [2026-05-09 02:45:48] root@h004:~$ openstack --version
  2. openstack 8.2.0
  3. [2026-05-09 02:46:10] root@h004:~$ systemctl status neutron-rpc-server neutron-dhcp-agent
  4. * neutron-rpc-server.service - OpenStack Neutron RPC server (neutron-rpc-server)
  5. Loaded: loaded (/usr/lib/systemd/system/neutron-rpc-server.service; enabled; preset: enabled)
  6. Active: active (running) since Sat 2026-05-09 01:58:51 CEST; 47min ago
  7. Docs: man:neutron-rpc-server(1)
  8. Main PID: 236377 (neutron-rpc-ser)
  9. Tasks: 29 (limit: 618805)
  10. Memory: 236.8M (peak: 237.1M)
  11. CPU: 3.901s
  12. CGroup: /system.slice/neutron-rpc-server.service
  13. |-236377 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  14. |-236391 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  15. |-236392 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  16. |-236393 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  17. |-236394 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  18. |-236395 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  19. |-236396 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  20. |-236397 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  21. |-236398 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  22. |-236399 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  23. |-236400 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  24. |-236401 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  25. |-236402 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  26. |-236403 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  27. |-236404 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  28. |-236405 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  29. |-236406 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  30. |-236407 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  31. |-236408 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  32. |-236409 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  33. |-236410 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  34. |-236417 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  35. |-236423 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  36. |-236429 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  37. |-236430 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  38. |-236431 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  39. |-236432 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  40. |-236433 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  41. `-236434 "neutron-rpc-server: master process [/usr/bin/neutron-rpc-server --config-file=/etc/neutron/neutron.con>
  42.  
  43. May 09 01:58:47 h004 systemd[1]: Starting neutron-rpc-server.service - OpenStack Neutron RPC server (neutron-rpc-server)...
  44. May 09 01:58:47 h004 systemd[1]: neutron-rpc-server.service: Got notification message from PID 236380, but reception only per>
  45. May 09 01:58:50 h004 neutron-rpc-server[236377]: 3 RLock(s) were not greened, to fix this error make sure you run eventlet.mo>
  46. May 09 01:58:51 h004 systemd[1]: Started neutron-rpc-server.service - OpenStack Neutron RPC server (neutron-rpc-server).
  47.  
  48. * neutron-dhcp-agent.service - OpenStack Neutron DHCP agent
  49. Loaded: loaded (/usr/lib/systemd/system/neutron-dhcp-agent.service; enabled; preset: enabled)
  50. Active: active (running) since Sat 2026-05-09 02:00:02 CEST; 46min ago
  51. Docs: man:neutron-dhcp-agent(1)
  52. Main PID: 243362 (neutron-dhcp-ag)
  53. Tasks: 13 (limit: 618805)
  54. Memory: 135.5M (peak: 136.0M)
  55. CPU: 3.303s
  56. CGroup: /system.slice/neutron-dhcp-agent.service
  57. |-243362 "neutron-dhcp-agent: master process [/usr/bin/neutron-dhcp-agent --config-file=/etc/neutron/neutron.con>
  58. `-243378 "neutron-dhcp-agent: ServiceWrapper worker(0)"
  59.  
  60. May 09 02:00:02 h004 systemd[1]: Started neutron-dhcp-agent.service - OpenStack Neutron DHCP agent.
  61. [2026-05-09 02:47:01] root@h004:~$ rabbitmqctl cluster_status
  62. Cluster status of node rabbit@h004 ...
  63. Basics
  64.  
  65. Cluster name: [email protected]
  66. Total CPU cores available cluster-wide: 120
  67.  
  68. Disk Nodes
  69.  
  70. rabbit@h002
  71. rabbit@h003
  72. rabbit@h004
  73.  
  74. Running Nodes
  75.  
  76. rabbit@h002
  77. rabbit@h003
  78. rabbit@h004
  79.  
  80. Versions
  81.  
  82. rabbit@h002: RabbitMQ 3.12.1 on Erlang 25.3.2.8
  83. rabbit@h003: RabbitMQ 3.12.1 on Erlang 25.3.2.8
  84. rabbit@h004: RabbitMQ 3.12.1 on Erlang 25.3.2.8
  85.  
  86. CPU Cores
  87.  
  88. Node: rabbit@h002, available CPU cores: 40
  89. Node: rabbit@h003, available CPU cores: 40
  90. Node: rabbit@h004, available CPU cores: 40
  91.  
  92. Maintenance status
  93.  
  94. Node: rabbit@h002, status: not under maintenance
  95. Node: rabbit@h003, status: not under maintenance
  96. Node: rabbit@h004, status: not under maintenance
  97.  
  98. Alarms
  99.  
  100. (none)
  101.  
  102. Network Partitions
  103.  
  104. (none)
  105.  
  106. Listeners
  107.  
  108. Node: rabbit@h002, interface: [::], port: 15672, protocol: http, purpose: HTTP API
  109. Node: rabbit@h002, interface: [::], port: 25672, protocol: clustering, purpose: inter-node and CLI tool communication
  110. Node: rabbit@h002, interface: 10.1.12.102, port: 5672, protocol: amqp, purpose: AMQP 0-9-1 and AMQP 1.0
  111. Node: rabbit@h003, interface: [::], port: 15672, protocol: http, purpose: HTTP API
  112. Node: rabbit@h003, interface: [::], port: 25672, protocol: clustering, purpose: inter-node and CLI tool communication
  113. Node: rabbit@h003, interface: 10.1.12.103, port: 5672, protocol: amqp, purpose: AMQP 0-9-1 and AMQP 1.0
  114. Node: rabbit@h004, interface: [::], port: 15672, protocol: http, purpose: HTTP API
  115. Node: rabbit@h004, interface: [::], port: 25672, protocol: clustering, purpose: inter-node and CLI tool communication
  116. Node: rabbit@h004, interface: 10.1.12.104, port: 5672, protocol: amqp, purpose: AMQP 0-9-1 and AMQP 1.0
  117.  
  118. Feature flags
  119.  
  120. Flag: classic_mirrored_queue_version, state: enabled
  121. Flag: classic_queue_type_delivery_support, state: enabled
  122. Flag: direct_exchange_routing_v2, state: enabled
  123. Flag: drop_unroutable_metric, state: enabled
  124. Flag: empty_basic_get_metric, state: enabled
  125. Flag: feature_flags_v2, state: enabled
  126. Flag: implicit_default_bindings, state: enabled
  127. Flag: listener_records_in_ets, state: enabled
  128. Flag: maintenance_mode_status, state: enabled
  129. Flag: quorum_queue, state: enabled
  130. Flag: restart_streams, state: enabled
  131. Flag: stream_queue, state: enabled
  132. Flag: stream_sac_coordinator_unblock_group, state: enabled
  133. Flag: stream_single_active_consumer, state: enabled
  134. Flag: tracking_records_in_ets, state: enabled
  135. Flag: user_limits, state: enabled
  136. Flag: virtual_host_metadata, state: enabled
  137. [2026-05-09 02:47:09] root@h004:~$ v
  138. -bash: v: command not found
  139. [2026-05-09 02:47:20] root@h004:~$ rabbitmq-diagnostics check_running
  140. Checking if RabbitMQ is running on node rabbit@h004 ...
  141. RabbitMQ on node rabbit@h004 is fully booted and running
  142. [2026-05-09 02:47:22] root@h004:~$ rabbitmq-diagnostics check_local_alarms
  143. Asking node rabbit@h004 to report any local resource alarms ...
  144. Node rabbit@h004 reported no local alarms
  145. [2026-05-09 02:47:35] root@h004:~$ rabbitmqctl list_policies -p /
  146. Listing policies for vhost "/" ...
  147. vhost name pattern apply-to definition priority
  148. / ha-durable ^(?!amq\.|reply_|.*_fanout_).* queues {"ha-mode":"all","ha-sync-mode":"automatic"} 0
  149. [2026-05-09 02:47:41] root@h004:~$ rabbitmqctl list_queues name consumers messages_ready messages_unacknowledged | egrep "dhcp_agent|neutron|q-agent|plugin"
  150. neutron-vo-Port-1.10.h004 1 0 0
  151. neutron-vo-SecurityGroup-1.6 1 0 0
  152. neutron-vo-Network-1.2_fanout_0004357ae47d4ad0b9d9ee0752dbe750 1 0 0
  153. neutron-vo-SecurityGroupRule-1.3.h004 1 0 0
  154. neutron-vo-Subnet-1.2.h004 1 0 0
  155. neutron-vo-SecurityGroupRule-1.3_fanout_0d9697c0238f40e4a597cf344046876e 1 0 0
  156. neutron-vo-SecurityGroup-1.6_fanout_0b20a963f0394c75be7903c70feb2831 1 0 0
  157. neutron-vo-Port-1.10 1 0 0
  158. neutron-vo-AddressGroup-1.2 1 0 0
  159. neutron-vo-SecurityGroup-1.6.h004 1 0 0
  160. neutron-vo-Subnet-1.2 1 0 0
  161. neutron-vo-Port-1.10_fanout_9013fd52c98a46fe9162714b1dee6144 1 0 0
  162. neutron-vo-SecurityGroupRule-1.3 1 0 0
  163. neutron-vo-AddressGroup-1.2.h004 1 0 0
  164. neutron-vo-Network-1.2.h004 1 0 0
  165. neutron-vo-Network-1.2 1 0 0
  166. neutron-vo-AddressGroup-1.2_fanout_5723abfe7c8648188a0b786f5d3fff24 1 0 0
  167. dhcp_agent 1 0 0
  168. neutron-vo-Subnet-1.2_fanout_996e671a5f1f42cc9b30a2d88606927b 1 0 0
  169. dhcp_agent.h004 1 0 0
  170. dhcp_agent_fanout_4fa2f34eed49495caec14626cf5cc0a4 1 0 0
  171. [2026-05-09 02:47:52] root@h004:~$ rabbitmqctl list_connections name user vhost peer_host state | egrep "neutron|openstack"
  172. 10.1.12.104:60826 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  173. 10.1.12.104:39304 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  174. 10.1.12.104:39306 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  175. 10.1.12.104:39318 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  176. 10.1.12.104:39328 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  177. 10.1.12.104:39344 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  178. 10.1.12.104:39348 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  179. 10.1.12.104:39362 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  180. 10.1.12.104:39368 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  181. 10.1.12.104:39382 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  182. 10.1.12.104:39396 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  183. 10.1.12.104:39406 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  184. 10.1.12.103:58558 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  185. 10.1.12.103:44718 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  186. 10.1.12.103:44728 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  187. 10.1.12.103:44744 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  188. 10.1.12.103:44758 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  189. 10.1.12.103:44772 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  190. 10.1.12.103:44776 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  191. 10.1.12.103:44788 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  192. 10.1.12.103:44796 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  193. 10.1.12.103:44804 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  194. 10.1.12.103:44816 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  195. 10.1.12.103:44828 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  196. 10.1.12.103:44840 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  197. 10.1.12.103:44856 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  198. 10.1.12.103:44862 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  199. 10.1.12.103:44874 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  200. 10.1.12.103:44880 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  201. 10.1.12.103:44886 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  202. 10.1.12.103:44902 -> 10.1.12.104:5672 openstack / 10.1.12.103 running
  203. 10.1.12.102:53746 -> 10.1.12.104:5672 openstack / 10.1.12.102 running
  204. 10.1.12.102:53752 -> 10.1.12.104:5672 openstack / 10.1.12.102 running
  205. 10.1.12.102:53754 -> 10.1.12.104:5672 openstack / 10.1.12.102 running
  206. 10.1.12.102:53766 -> 10.1.12.104:5672 openstack / 10.1.12.102 running
  207. 10.1.12.102:53774 -> 10.1.12.104:5672 openstack / 10.1.12.102 running
  208. 10.1.12.102:53788 -> 10.1.12.104:5672 openstack / 10.1.12.102 running
  209. 10.1.12.102:53794 -> 10.1.12.104:5672 openstack / 10.1.12.102 running
  210. 10.1.12.102:53806 -> 10.1.12.104:5672 openstack / 10.1.12.102 running
  211. 10.1.12.104:56360 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  212. 10.1.12.104:56376 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  213. 10.1.12.104:56378 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  214. 10.1.12.104:56392 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  215. 10.1.12.104:56394 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  216. 10.1.12.104:56406 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  217. 10.1.12.104:56410 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  218. 10.1.12.104:49762 -> 10.1.12.104:5672 openstack / 10.1.12.104 running
  219. 10.1.12.104:42378 -> 10.1.12.102:5672 openstack / 10.1.12.104 running
  220. 10.1.12.104:42380 -> 10.1.12.102:5672 openstack / 10.1.12.104 running
  221. 10.1.12.104:42386 -> 10.1.12.102:5672 openstack / 10.1.12.104 running
  222. 10.1.12.104:42396 -> 10.1.12.102:5672 openstack / 10.1.12.104 running
  223. 10.1.12.104:42398 -> 10.1.12.102:5672 openstack / 10.1.12.104 running
  224. 10.1.12.104:42400 -> 10.1.12.102:5672 openstack / 10.1.12.104 running
  225. 10.1.12.104:42408 -> 10.1.12.102:5672 openstack / 10.1.12.104 running
  226. 10.1.12.104:42422 -> 10.1.12.102:5672 openstack / 10.1.12.104 running
  227. 10.1.12.104:42430 -> 10.1.12.102:5672 openstack / 10.1.12.104 running
  228. 10.1.12.104:42446 -> 10.1.12.102:5672 openstack / 10.1.12.104 running
  229. 10.1.12.104:42452 -> 10.1.12.102:5672 openstack / 10.1.12.104 running
  230. 10.1.12.103:37608 -> 10.1.12.102:5672 openstack / 10.1.12.103 running
  231. 10.1.12.103:37622 -> 10.1.12.102:5672 openstack / 10.1.12.103 running
  232. 10.1.12.103:37630 -> 10.1.12.102:5672 openstack / 10.1.12.103 running
  233. 10.1.12.104:52856 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  234. 10.1.12.104:52862 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  235. 10.1.12.104:52872 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  236. 10.1.12.104:52880 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  237. 10.1.12.104:52888 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  238. 10.1.12.103:37636 -> 10.1.12.102:5672 openstack / 10.1.12.103 running
  239. 10.1.12.104:52898 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  240. 10.1.12.103:37644 -> 10.1.12.102:5672 openstack / 10.1.12.103 running
  241. 10.1.12.103:37650 -> 10.1.12.102:5672 openstack / 10.1.12.103 running
  242. 10.1.12.103:37658 -> 10.1.12.102:5672 openstack / 10.1.12.103 running
  243. 10.1.12.103:37670 -> 10.1.12.102:5672 openstack / 10.1.12.103 running
  244. 10.1.12.103:37678 -> 10.1.12.102:5672 openstack / 10.1.12.103 running
  245. 10.1.12.103:37690 -> 10.1.12.102:5672 openstack / 10.1.12.103 running
  246. 10.1.12.104:52908 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  247. 10.1.12.104:52912 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  248. 10.1.12.104:52916 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  249. 10.1.12.104:52932 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  250. 10.1.12.104:52936 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  251. 10.1.12.103:37704 -> 10.1.12.102:5672 openstack / 10.1.12.103 running
  252. 10.1.12.103:37710 -> 10.1.12.102:5672 openstack / 10.1.12.103 running
  253. 10.1.12.103:37720 -> 10.1.12.102:5672 openstack / 10.1.12.103 running
  254. 10.1.12.103:37748 -> 10.1.12.102:5672 openstack / 10.1.12.103 running
  255. 10.1.12.102:41248 -> 10.1.12.102:5672 openstack / 10.1.12.102 running
  256. 10.1.12.104:52948 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  257. 10.1.12.102:41254 -> 10.1.12.102:5672 openstack / 10.1.12.102 running
  258. 10.1.12.104:52956 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  259. 10.1.12.104:52968 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  260. 10.1.12.104:52978 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  261. 10.1.12.104:52980 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  262. 10.1.12.104:52992 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  263. 10.1.12.102:41260 -> 10.1.12.102:5672 openstack / 10.1.12.102 running
  264. 10.1.12.102:41268 -> 10.1.12.102:5672 openstack / 10.1.12.102 running
  265. 10.1.12.102:41280 -> 10.1.12.102:5672 openstack / 10.1.12.102 running
  266. 10.1.12.102:41292 -> 10.1.12.102:5672 openstack / 10.1.12.102 running
  267. 10.1.12.102:41304 -> 10.1.12.102:5672 openstack / 10.1.12.102 running
  268. 10.1.12.104:53002 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  269. 10.1.12.102:41306 -> 10.1.12.102:5672 openstack / 10.1.12.102 running
  270. 10.1.12.103:45416 -> 10.1.12.103:5672 openstack / 10.1.12.103 running
  271. 10.1.12.103:35738 -> 10.1.12.103:5672 openstack / 10.1.12.103 running
  272. 10.1.12.103:35746 -> 10.1.12.103:5672 openstack / 10.1.12.103 running
  273. 10.1.12.103:35750 -> 10.1.12.103:5672 openstack / 10.1.12.103 running
  274. 10.1.12.103:35766 -> 10.1.12.103:5672 openstack / 10.1.12.103 running
  275. 10.1.12.102:41322 -> 10.1.12.102:5672 openstack / 10.1.12.102 running
  276. 10.1.12.102:41330 -> 10.1.12.102:5672 openstack / 10.1.12.102 running
  277. 10.1.12.102:41344 -> 10.1.12.102:5672 openstack / 10.1.12.102 running
  278. 10.1.12.102:41358 -> 10.1.12.102:5672 openstack / 10.1.12.102 running
  279. 10.1.12.102:41364 -> 10.1.12.102:5672 openstack / 10.1.12.102 running
  280. 10.1.12.103:35776 -> 10.1.12.103:5672 openstack / 10.1.12.103 running
  281. 10.1.12.102:41370 -> 10.1.12.102:5672 openstack / 10.1.12.102 running
  282. 10.1.12.103:35778 -> 10.1.12.103:5672 openstack / 10.1.12.103 running
  283. 10.1.12.103:35786 -> 10.1.12.103:5672 openstack / 10.1.12.103 running
  284. 10.1.12.103:35792 -> 10.1.12.103:5672 openstack / 10.1.12.103 running
  285. 10.1.12.103:35798 -> 10.1.12.103:5672 openstack / 10.1.12.103 running
  286. 10.1.12.102:51916 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  287. 10.1.12.102:41372 -> 10.1.12.102:5672 openstack / 10.1.12.102 running
  288. 10.1.12.102:41382 -> 10.1.12.102:5672 openstack / 10.1.12.102 running
  289. 10.1.12.104:57168 -> 10.1.12.102:5672 openstack / 10.1.12.104 running
  290. 10.1.12.104:53914 -> 10.1.12.102:5672 openstack / 10.1.12.104 running
  291. 10.1.12.104:57576 -> 10.1.12.102:5672 openstack / 10.1.12.104 running
  292. 10.1.12.102:51932 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  293. 10.1.12.104:57586 -> 10.1.12.102:5672 openstack / 10.1.12.104 running
  294. 10.1.12.102:51940 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  295. 10.1.12.102:51954 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  296. 10.1.12.102:51964 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  297. 10.1.12.102:51978 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  298. 10.1.12.102:51984 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  299. 10.1.12.104:36352 -> 10.1.12.102:5672 openstack / 10.1.12.104 running
  300. 10.1.12.104:39016 -> 10.1.12.102:5672 openstack / 10.1.12.104 running
  301. 10.1.12.102:51986 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  302. 10.1.12.102:51996 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  303. 10.1.12.102:52006 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  304. 10.1.12.102:52008 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  305. 10.1.12.102:52012 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  306. 10.1.12.102:52018 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  307. 10.1.12.102:52032 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  308. 10.1.12.102:52046 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  309. 10.1.12.102:52058 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  310. 10.1.12.102:52062 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  311. 10.1.12.102:52064 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  312. 10.1.12.102:52080 -> 10.1.12.103:5672 openstack / 10.1.12.102 running
  313. 10.1.12.104:55806 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  314. 10.1.12.104:51210 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  315. 10.1.12.104:46844 -> 10.1.12.103:5672 openstack / 10.1.12.104 running
  316. [2026-05-09 02:48:06] root@h004:~$ grep -E "transport_url|rpc_response_timeout|control_exchange|host" /etc/neutron/neutron.conf
  317. /etc/neutron/neutron.conf:bind_host = 10.1.12.104
  318. /etc/neutron/neutron.conf:transport_url = rabbit://openstack:*@10.1.12.102:5672,openstack:*@10.1.12.103:5672,openstack:*@10.1.12.104:5672/
  319. /etc/neutron/neutron.conf:#transport_url = rabbit://openstack:*@10.1.12.100:5672/
  320. /etc/neutron/neutron.conf:rpc_response_timeout = 120
  321. /etc/neutron/neutron.conf:#transport_url = rabbit://openstack:*@10.1.12.100:5672/
  322. /etc/neutron/neutron.conf:transport_url = rabbit://openstack:*@10.1.12.102:5672,openstack:*@10.1.12.103:5672,openstack:*@10.1.12.104:5672/
  323. [2026-05-09 02:48:55] root@h004:~$ . admin-openrc
  324. [2026-05-09 02:49:00] root@h004:~$ openstack network agent list | grep h004
  325. | 3bedc3aa-009c-4aab-8808-f333919bfb5f | DHCP agent | h004 | nova | XXX | UP | neutron-dhcp-agent |
  326. | ad677609-970d-432c-92cc-900c25ae934d | Metadata agent | h004 | None | XXX | UP | neutron-metadata-agent |
  327. | b4bc3c07-7ce6-4f82-9059-6478990b0fa1 | Open vSwitch agent | h004 | None | XXX | UP | neutron-openvswitch-agent |
  328. | fa2c8e9f-2b54-483f-b3e6-d04553385452 | L3 agent | h004 | nova | XXX | UP | neutron-l3-agent |
  329. [2026-05-09 02:49:08] root@h004:~$
  330.  
  331. /var/log/neutron/neutron-dhcp-agent.log:
  332. =======================================
  333. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent [None req-0f551aef-b87d-4499-b334-eda91dd8019f - - - - - -] Failed reporting state!: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 5ff5e73a3ecc416da553944dc56814c5
  334. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent Traceback (most recent call last):
  335. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent File "/usr/lib/python3/dist-packages/neutron/agent/dhcp/agent.py", line 1103, in _report_state
  336. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent agent_status = self.state_rpc.report_state(
  337. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  338. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent File "/usr/lib/python3/dist-packages/neutron/agent/rpc.py", line 105, in report_state
  339. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent return method(context, 'report_state', **kwargs)
  340. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  341. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent File "/usr/lib/python3/dist-packages/oslo_messaging/rpc/client.py", line 180, in call
  342. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent result = self.transport._send(
  343. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent ^^^^^^^^^^^^^^^^^^^^^
  344. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent File "/usr/lib/python3/dist-packages/oslo_messaging/transport.py", line 123, in _send
  345. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent return self._driver.send(target, ctxt, message,
  346. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  347. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 794, in send
  348. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent return self._send(target, ctxt, message, wait_for_reply, timeout,
  349. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  350. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 783, in _send
  351. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent result = self._waiter.wait(msg_id, timeout,
  352. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  353. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 654, in wait
  354. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent message = self.waiters.get(msg_id, timeout=timeout)
  355. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  356. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent File "/usr/lib/python3/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 520, in get
  357. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent raise oslo_messaging.MessagingTimeout(
  358. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 5ff5e73a3ecc416da553944dc56814c5
  359. 2026-05-09 02:54:58.963 243378 ERROR neutron.agent.dhcp.agent
  360. 2026-05-09 02:54:58.965 243378 WARNING oslo.service.backend._threading.loopingcall [None req-0f551aef-b87d-4499-b334-eda91dd8019f - - - - - -] Function 'neutron.agent.dhcp.agent.DhcpAgentWithStateReport._report_state' run outlasted interval by 0.01 sec
  361.  
  362. /var/log/neutron/neutron-l3-agent.log:
  363. =====================================
  364. 2026-05-09 02:16:42.477 229482 ERROR neutron_lib.rpc [-] Timeout in RPC method get_host_ha_router_count. Waiting for 66 seconds before next attempt. If the server is not down, consider increasing the rpc_response_timeout option as Neutron server(s) may be overloaded and unable to respond quickly enough.: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 1e9692ca75114e5c9e4490eb90e3934b
  365. 2026-05-09 02:17:48.807 229482 WARNING neutron.agent.l3.agent [-] l3-agent cannot contact neutron server to retrieve HA router count. Check connectivity to neutron server. Retrying... Detailed message: Timed out waiting for a reply to message ID 1e9692ca75114e5c9e4490eb90e3934b.: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 1e9692ca75114e5c9e4490eb90e3934b
  366. 2026-05-09 02:27:48.928 229482 ERROR neutron_lib.rpc [-] Timeout in RPC method get_host_ha_router_count. Waiting for 78 seconds before next attempt. If the server is not down, consider increasing the rpc_response_timeout option as Neutron server(s) may be overloaded and unable to respond quickly enough.: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 81ea3b32ce694c698e17c2288b0ccb42
  367. 2026-05-09 02:29:07.346 229482 WARNING neutron.agent.l3.agent [-] l3-agent cannot contact neutron server to retrieve HA router count. Check connectivity to neutron server. Retrying... Detailed message: Timed out waiting for a reply to message ID 81ea3b32ce694c698e17c2288b0ccb42.: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 81ea3b32ce694c698e17c2288b0ccb42
  368. 2026-05-09 02:39:07.468 229482 ERROR neutron_lib.rpc [-] Timeout in RPC method get_host_ha_router_count. Waiting for 113 seconds before next attempt. If the server is not down, consider increasing the rpc_response_timeout option as Neutron server(s) may be overloaded and unable to respond quickly enough.: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 9dad2cfa2d0344149773052cc3b2a2b7
  369. 2026-05-09 02:41:00.458 229482 WARNING neutron.agent.l3.agent [-] l3-agent cannot contact neutron server to retrieve HA router count. Check connectivity to neutron server. Retrying... Detailed message: Timed out waiting for a reply to message ID 9dad2cfa2d0344149773052cc3b2a2b7.: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 9dad2cfa2d0344149773052cc3b2a2b7
  370. 2026-05-09 02:51:00.583 229482 ERROR neutron_lib.rpc [-] Timeout in RPC method get_host_ha_router_count. Waiting for 88 seconds before next attempt. If the server is not down, consider increasing the rpc_response_timeout option as Neutron server(s) may be overloaded and unable to respond quickly enough.: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 82d3a92a0e4049a599223e8062f7ae71
  371. 2026-05-09 02:52:28.451 229482 WARNING neutron.agent.l3.agent [-] l3-agent cannot contact neutron server to retrieve HA router count. Check connectivity to neutron server. Retrying... Detailed message: Timed out waiting for a reply to message ID 82d3a92a0e4049a599223e8062f7ae71.: oslo_messaging.exceptions.MessagingTimeout: Timed out waiting for a reply to message ID 82d3a92a0e4049a599223e8062f7ae71
  372. ~
Advertisement
Comments
  • User was banned
Add Comment
Please, Sign In to add comment