API tools faq
paste
Guest User

Untitled

a guest
Apr 29th, 2014
282
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 92.96 KB | None | 0 0
raw download clone embed print report
  1. zenoss@zenoss:~$ zenhub run -v10
  2. 2014-04-29 10:26:55,924 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/Products/DataCollector/plugins
  3. 2014-04-29 10:26:55,930 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.ActiveDirectory-2.1.0-py2.7.egg/ZenPacks/zenoss/ActiveDirectory/modeler/plugins
  4. 2014-04-29 10:26:55,931 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.ApacheMonitor-2.1.3-py2.7.egg/ZenPacks/zenoss/ApacheMonitor/modeler/plugins
  5. 2014-04-29 10:26:55,932 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.DellMonitor-2.2.0-py2.7.egg/ZenPacks/zenoss/DellMonitor/modeler/plugins
  6. 2014-04-29 10:26:55,933 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.DeviceSearch-1.2.0-py2.7.egg/ZenPacks/zenoss/DeviceSearch/modeler/plugins
  7. 2014-04-29 10:26:55,934 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.DigMonitor-1.1.0-py2.7.egg/ZenPacks/zenoss/DigMonitor/modeler/plugins
  8. 2014-04-29 10:26:55,935 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.DnsMonitor-2.1.0-py2.7.egg/ZenPacks/zenoss/DnsMonitor/modeler/plugins
  9. 2014-04-29 10:26:55,935 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.FtpMonitor-1.1.0-py2.7.egg/ZenPacks/zenoss/FtpMonitor/modeler/plugins
  10. 2014-04-29 10:26:55,936 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.HPMonitor-2.1.0-py2.7.egg/ZenPacks/zenoss/HPMonitor/modeler/plugins
  11. 2014-04-29 10:26:55,937 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.HttpMonitor-2.1.0-py2.7.egg/ZenPacks/zenoss/HttpMonitor/modeler/plugins
  12. 2014-04-29 10:26:55,938 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.IISMonitor-2.0.2-py2.7.egg/ZenPacks/zenoss/IISMonitor/modeler/plugins
  13. 2014-04-29 10:26:55,939 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.IRCDMonitor-1.1.0-py2.7.egg/ZenPacks/zenoss/IRCDMonitor/modeler/plugins
  14. 2014-04-29 10:26:55,940 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.JabberMonitor-1.1.0-py2.7.egg/ZenPacks/zenoss/JabberMonitor/modeler/plugins
  15. 2014-04-29 10:26:55,940 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.LDAPMonitor-1.4.0-py2.7.egg/ZenPacks/zenoss/LDAPMonitor/modeler/plugins
  16. 2014-04-29 10:26:55,941 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.LinuxMonitor-1.2.0-py2.7.egg/ZenPacks/zenoss/LinuxMonitor/modeler/plugins
  17. 2014-04-29 10:26:55,942 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.MSExchange-2.0.4-py2.7.egg/ZenPacks/zenoss/MSExchange/modeler/plugins
  18. 2014-04-29 10:26:55,944 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.MSMQMonitor-1.2.1-py2.7.egg/ZenPacks/zenoss/MSMQMonitor/modeler/plugins
  19. 2014-04-29 10:26:55,945 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.MSSQLServer-2.0.3-py2.7.egg/ZenPacks/zenoss/MSSQLServer/modeler/plugins
  20. 2014-04-29 10:26:55,945 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.MySqlMonitor-2.2.0-py2.7.egg/ZenPacks/zenoss/MySqlMonitor/modeler/plugins
  21. 2014-04-29 10:26:55,946 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.NNTPMonitor-1.1.0-py2.7.egg/ZenPacks/zenoss/NNTPMonitor/modeler/plugins
  22. 2014-04-29 10:26:55,947 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.NtpMonitor-2.2.0-py2.7.egg/ZenPacks/zenoss/NtpMonitor/modeler/plugins
  23. 2014-04-29 10:26:55,948 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.PySamba-1.0.0-py2.7-linux-x86_64.egg/ZenPacks/zenoss/PySamba/modeler/plugins
  24. 2014-04-29 10:26:55,949 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.WindowsMonitor-1.0.5-py2.7.egg/ZenPacks/zenoss/WindowsMonitor/modeler/plugins
  25. 2014-04-29 10:26:55,950 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.XenMonitor-1.1.0-py2.7.egg/ZenPacks/zenoss/XenMonitor/modeler/plugins
  26. 2014-04-29 10:26:55,951 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.ZenAWS-1.1.0-py2.7.egg/ZenPacks/zenoss/ZenAWS/modeler/plugins
  27. 2014-04-29 10:26:55,952 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.ZenJMX-3.9.3-py2.7.egg/ZenPacks/zenoss/ZenJMX/modeler/plugins
  28. 2014-04-29 10:26:55,953 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.ZenossVirtualHostMonitor-2.4.0-py2.7.egg/ZenPacks/zenoss/ZenossVirtualHostMonitor/modeler/plugins
  29. 2014-04-29 10:26:55,953 INFO zen.HubService.RenderConfig: Starting graph retrieval listener on port 8090
  30. 2014-04-29 10:26:55,957 DEBUG zen.Events: =============== incoming event ===============
  31. 2014-04-29 10:26:55,963 DEBUG zen.queuepublisher: About to publish this event to the raw event queue:uuid: "b2a62a24-cfb2-11e3-b7a5-000c29d302ba"
  32. created_time: 1398785215957
  33. event_class: "/App/Start"
  34. actor {
  35. element_type_id: DEVICE
  36. element_identifier: "localhost"
  37. element_sub_type_id: COMPONENT
  38. element_sub_identifier: "zenhub"
  39. }
  40. summary: "zenhub started"
  41. severity: SEVERITY_CLEAR
  42. event_key: ""
  43. first_seen_time: 1398785215957
  44. , with this routing key: zenoss.zenevent.app.start
  45. 2014-04-29 10:26:55,967 DEBUG zen.zenoss.protocols.amqp: Connecting to RabbitMQ...
  46. 2014-04-29 10:26:55,968 DEBUG zen.protocols: Creating exchange: zenoss.zenevents.raw
  47. 2014-04-29 10:26:55,969 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.zenevent.app.start to exchange zenoss.zenevents.raw
  48. 2014-04-29 10:26:57,504 DEBUG zen.ZenHub: Registered 4 invalidation filters.
  49. 2014-04-29 10:26:57,537 DEBUG zen.thresholds: Updating threshold ('high event queue', ('localhost collector', ''))
  50. 2014-04-29 10:26:57,537 DEBUG zen.thresholds: Updating threshold ('zenmodeler cycle time', ('localhost collector', ''))
  51. 2014-04-29 10:26:57,538 DEBUG zen.ZenHub: Starting /usr/bin/nice -n +5 /usr/local/zenoss/bin/zenhubworker run -C /usr/local/zenoss/var/zenhub/localhost_worker.conf
  52. 2014-04-29 10:26:57,541 DEBUG zen.ZenHub: Starting /usr/bin/nice -n +5 /usr/local/zenoss/bin/zenhubworker run -C /usr/local/zenoss/var/zenhub/localhost_worker.conf
  53. 2014-04-29 10:26:57,569 DEBUG zen.hub: adding listener for localhost:EventService
  54. 2014-04-29 10:26:57,572 DEBUG zen.hub: adding listener for localhost:WinServiceConfig
  55. 2014-04-29 10:26:57,573 DEBUG zen.hub: adding listener for localhost:EventService
  56. 2014-04-29 10:26:57,573 DEBUG zen.hub: adding listener for localhost:PingPerformanceConfig
  57. 2014-04-29 10:26:57,576 DEBUG zen.hub: adding listener for localhost:EventService
  58. 2014-04-29 10:26:57,577 DEBUG zen.hub: adding listener for localhost:ZenJMXConfigService
  59. 2014-04-29 10:26:57,583 DEBUG zen.hub: adding listener for localhost:EventService
  60. 2014-04-29 10:26:57,585 DEBUG zen.hub: adding listener for localhost:ProcessConfig
  61. 2014-04-29 10:26:57,750 DEBUG zen.hub: adding listener for localhost:EventService
  62. 2014-04-29 10:26:57,751 DEBUG zen.hub: adding listener for localhost:SnmpPerformanceConfig
  63. 2014-04-29 10:26:57,761 DEBUG zen.hub: adding listener for localhost:EventService
  64. 2014-04-29 10:26:57,762 DEBUG zen.hub: adding listener for localhost:WinPerfConfig
  65. 2014-04-29 10:26:57,919 DEBUG zen.hub: adding listener for localhost:EventService
  66. 2014-04-29 10:26:57,920 DEBUG zen.hub: adding listener for localhost:CommandPerformanceConfig
  67. 2014-04-29 10:26:58,035 DEBUG zen.hub: adding listener for localhost:EventService
  68. 2014-04-29 10:26:58,036 DEBUG zen.hub: adding listener for localhost:SnmpTrapConfig
  69. 2014-04-29 10:26:59,180 DEBUG zen.hub: adding listener for localhost:EventService
  70. 2014-04-29 10:26:59,181 DEBUG zen.hub: adding listener for localhost:SyslogConfig
  71. 2014-04-29 10:26:59,710 DEBUG zen.ZenHub: worklist has 1 items
  72. 2014-04-29 10:26:59,710 DEBUG zen.ZenHub: all workers are busy
  73. 2014-04-29 10:27:01,664 DEBUG zen.ZenHub: worklist has 2 items
  74. 2014-04-29 10:27:01,664 DEBUG zen.ZenHub: all workers are busy
  75. 2014-04-29 10:27:02,546 DEBUG zen.ZenHub: worklist has 3 items
  76. 2014-04-29 10:27:02,546 DEBUG zen.ZenHub: all workers are busy
  77. 2014-04-29 10:27:03,926 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,926 DEBUG zen.zenhubworker: establishing SIGUSR2 signal handler
  78. 2014-04-29 10:27:03,932 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,931 DEBUG zen.zenhubworker: establishing SIGUSR2 signal handler
  79. 2014-04-29 10:27:03,932 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,932 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/Products/DataCollector/plugins
  80. 2014-04-29 10:27:03,935 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,935 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/Products/DataCollector/plugins
  81. 2014-04-29 10:27:03,944 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,944 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.ActiveDirectory-2.1.0-py2.7.egg/ZenPacks/zenoss/ActiveDirectory/modeler/plugins
  82. 2014-04-29 10:27:03,945 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,945 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.ApacheMonitor-2.1.3-py2.7.egg/ZenPacks/zenoss/ApacheMonitor/modeler/plugins
  83. 2014-04-29 10:27:03,947 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,947 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.ActiveDirectory-2.1.0-py2.7.egg/ZenPacks/zenoss/ActiveDirectory/modeler/plugins
  84. 2014-04-29 10:27:03,948 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,948 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.DellMonitor-2.2.0-py2.7.egg/ZenPacks/zenoss/DellMonitor/modeler/plugins
  85. 2014-04-29 10:27:03,949 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,949 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.DeviceSearch-1.2.0-py2.7.egg/ZenPacks/zenoss/DeviceSearch/modeler/plugins
  86. 2014-04-29 10:27:03,950 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,950 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.ApacheMonitor-2.1.3-py2.7.egg/ZenPacks/zenoss/ApacheMonitor/modeler/plugins
  87. 2014-04-29 10:27:03,951 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,951 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.DigMonitor-1.1.0-py2.7.egg/ZenPacks/zenoss/DigMonitor/modeler/plugins
  88. 2014-04-29 10:27:03,952 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,952 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.DellMonitor-2.2.0-py2.7.egg/ZenPacks/zenoss/DellMonitor/modeler/plugins
  89. 2014-04-29 10:27:03,953 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,953 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.DnsMonitor-2.1.0-py2.7.egg/ZenPacks/zenoss/DnsMonitor/modeler/plugins
  90. 2014-04-29 10:27:03,954 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,954 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.DeviceSearch-1.2.0-py2.7.egg/ZenPacks/zenoss/DeviceSearch/modeler/plugins
  91. 2014-04-29 10:27:03,955 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,955 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.FtpMonitor-1.1.0-py2.7.egg/ZenPacks/zenoss/FtpMonitor/modeler/plugins
  92. 2014-04-29 10:27:03,956 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,956 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.DigMonitor-1.1.0-py2.7.egg/ZenPacks/zenoss/DigMonitor/modeler/plugins
  93. 2014-04-29 10:27:03,957 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,957 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.HPMonitor-2.1.0-py2.7.egg/ZenPacks/zenoss/HPMonitor/modeler/plugins
  94. 2014-04-29 10:27:03,959 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,959 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.DnsMonitor-2.1.0-py2.7.egg/ZenPacks/zenoss/DnsMonitor/modeler/plugins
  95. 2014-04-29 10:27:03,960 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,960 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.HttpMonitor-2.1.0-py2.7.egg/ZenPacks/zenoss/HttpMonitor/modeler/plugins
  96. 2014-04-29 10:27:03,961 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,960 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.FtpMonitor-1.1.0-py2.7.egg/ZenPacks/zenoss/FtpMonitor/modeler/plugins
  97. 2014-04-29 10:27:03,962 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,962 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.IISMonitor-2.0.2-py2.7.egg/ZenPacks/zenoss/IISMonitor/modeler/plugins
  98. 2014-04-29 10:27:03,963 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,963 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.HPMonitor-2.1.0-py2.7.egg/ZenPacks/zenoss/HPMonitor/modeler/plugins
  99. 2014-04-29 10:27:03,964 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,964 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.IRCDMonitor-1.1.0-py2.7.egg/ZenPacks/zenoss/IRCDMonitor/modeler/plugins
  100. 2014-04-29 10:27:03,965 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,965 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.HttpMonitor-2.1.0-py2.7.egg/ZenPacks/zenoss/HttpMonitor/modeler/plugins
  101. 2014-04-29 10:27:03,966 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,966 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.JabberMonitor-1.1.0-py2.7.egg/ZenPacks/zenoss/JabberMonitor/modeler/plugins
  102. 2014-04-29 10:27:03,967 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,967 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.IISMonitor-2.0.2-py2.7.egg/ZenPacks/zenoss/IISMonitor/modeler/plugins
  103. 2014-04-29 10:27:03,968 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,968 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.LDAPMonitor-1.4.0-py2.7.egg/ZenPacks/zenoss/LDAPMonitor/modeler/plugins
  104. 2014-04-29 10:27:03,969 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,969 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.IRCDMonitor-1.1.0-py2.7.egg/ZenPacks/zenoss/IRCDMonitor/modeler/plugins
  105. 2014-04-29 10:27:03,970 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,969 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.LinuxMonitor-1.2.0-py2.7.egg/ZenPacks/zenoss/LinuxMonitor/modeler/plugins
  106. 2014-04-29 10:27:03,970 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,970 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.JabberMonitor-1.1.0-py2.7.egg/ZenPacks/zenoss/JabberMonitor/modeler/plugins
  107. 2014-04-29 10:27:03,972 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,972 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.MSExchange-2.0.4-py2.7.egg/ZenPacks/zenoss/MSExchange/modeler/plugins
  108. 2014-04-29 10:27:03,973 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,973 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.LDAPMonitor-1.4.0-py2.7.egg/ZenPacks/zenoss/LDAPMonitor/modeler/plugins
  109. 2014-04-29 10:27:03,974 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,974 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.LinuxMonitor-1.2.0-py2.7.egg/ZenPacks/zenoss/LinuxMonitor/modeler/plugins
  110. 2014-04-29 10:27:03,975 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,975 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.MSMQMonitor-1.2.1-py2.7.egg/ZenPacks/zenoss/MSMQMonitor/modeler/plugins
  111. 2014-04-29 10:27:03,977 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,976 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.MSExchange-2.0.4-py2.7.egg/ZenPacks/zenoss/MSExchange/modeler/plugins
  112. 2014-04-29 10:27:03,979 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,979 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.MSMQMonitor-1.2.1-py2.7.egg/ZenPacks/zenoss/MSMQMonitor/modeler/plugins
  113. 2014-04-29 10:27:03,979 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,978 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.MSSQLServer-2.0.3-py2.7.egg/ZenPacks/zenoss/MSSQLServer/modeler/plugins
  114. 2014-04-29 10:27:03,980 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,980 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.MySqlMonitor-2.2.0-py2.7.egg/ZenPacks/zenoss/MySqlMonitor/modeler/plugins
  115. 2014-04-29 10:27:03,982 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,982 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.MSSQLServer-2.0.3-py2.7.egg/ZenPacks/zenoss/MSSQLServer/modeler/plugins
  116. 2014-04-29 10:27:03,982 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,982 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.NNTPMonitor-1.1.0-py2.7.egg/ZenPacks/zenoss/NNTPMonitor/modeler/plugins
  117. 2014-04-29 10:27:03,983 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,983 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.NtpMonitor-2.2.0-py2.7.egg/ZenPacks/zenoss/NtpMonitor/modeler/plugins
  118. 2014-04-29 10:27:03,984 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,984 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.MySqlMonitor-2.2.0-py2.7.egg/ZenPacks/zenoss/MySqlMonitor/modeler/plugins
  119. 2014-04-29 10:27:03,985 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,985 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.PySamba-1.0.0-py2.7-linux-x86_64.egg/ZenPacks/zenoss/PySamba/modeler/plugins
  120. 2014-04-29 10:27:03,986 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,986 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.NNTPMonitor-1.1.0-py2.7.egg/ZenPacks/zenoss/NNTPMonitor/modeler/plugins
  121. 2014-04-29 10:27:03,987 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,987 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.WindowsMonitor-1.0.5-py2.7.egg/ZenPacks/zenoss/WindowsMonitor/modeler/plugins
  122. 2014-04-29 10:27:03,988 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,988 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.NtpMonitor-2.2.0-py2.7.egg/ZenPacks/zenoss/NtpMonitor/modeler/plugins
  123. 2014-04-29 10:27:03,990 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,990 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.PySamba-1.0.0-py2.7-linux-x86_64.egg/ZenPacks/zenoss/PySamba/modeler/plugins
  124. 2014-04-29 10:27:03,991 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,990 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.XenMonitor-1.1.0-py2.7.egg/ZenPacks/zenoss/XenMonitor/modeler/plugins
  125. 2014-04-29 10:27:03,992 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,992 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.WindowsMonitor-1.0.5-py2.7.egg/ZenPacks/zenoss/WindowsMonitor/modeler/plugins
  126. 2014-04-29 10:27:03,993 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,993 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.ZenAWS-1.1.0-py2.7.egg/ZenPacks/zenoss/ZenAWS/modeler/plugins
  127. 2014-04-29 10:27:03,994 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,994 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.XenMonitor-1.1.0-py2.7.egg/ZenPacks/zenoss/XenMonitor/modeler/plugins
  128. 2014-04-29 10:27:03,995 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,995 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.ZenJMX-3.9.3-py2.7.egg/ZenPacks/zenoss/ZenJMX/modeler/plugins
  129. 2014-04-29 10:27:03,997 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,996 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.ZenAWS-1.1.0-py2.7.egg/ZenPacks/zenoss/ZenAWS/modeler/plugins
  130. 2014-04-29 10:27:03,998 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,997 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.ZenossVirtualHostMonitor-2.4.0-py2.7.egg/ZenPacks/zenoss/ZenossVirtualHostMonitor/modeler/plugins
  131. 2014-04-29 10:27:03,998 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:03,998 DEBUG zen.zenhubworker: Connecting to localhost:8789
  132. 2014-04-29 10:27:03,999 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:03,999 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.ZenJMX-3.9.3-py2.7.egg/ZenPacks/zenoss/ZenJMX/modeler/plugins
  133. 2014-04-29 10:27:04,000 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,000 DEBUG zen.pbclientfactory: Starting connection...
  134. 2014-04-29 10:27:04,000 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,000 DEBUG zen.zenhubworker: Logging in as admin
  135. 2014-04-29 10:27:04,001 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,001 DEBUG zen.pbclientfactory: Connected
  136. 2014-04-29 10:27:04,002 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:04,002 DEBUG zen.Plugins: Loading collector plugins from: /usr/local/zenoss/ZenPacks/ZenPacks.zenoss.ZenossVirtualHostMonitor-2.4.0-py2.7.egg/ZenPacks/zenoss/ZenossVirtualHostMonitor/modeler/plugins
  137. 2014-04-29 10:27:04,002 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:04,002 DEBUG zen.zenhubworker: Connecting to localhost:8789
  138. 2014-04-29 10:27:04,003 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,003 DEBUG zen.pbclientfactory: Cancelling connect timeout
  139. 2014-04-29 10:27:04,004 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,004 DEBUG zen.pbclientfactory: Sending credentials
  140. 2014-04-29 10:27:04,005 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:04,005 DEBUG zen.pbclientfactory: Starting connection...
  141. 2014-04-29 10:27:04,006 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:04,006 DEBUG zen.zenhubworker: Logging in as admin
  142. 2014-04-29 10:27:04,007 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:04,006 DEBUG zen.pbclientfactory: Connected
  143. 2014-04-29 10:27:04,007 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,007 DEBUG zen.pbclientfactory: Cancelling connect timeout
  144. 2014-04-29 10:27:04,008 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:04,008 DEBUG zen.pbclientfactory: Cancelling connect timeout
  145. 2014-04-29 10:27:04,008 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:04,008 DEBUG zen.pbclientfactory: Sending credentials
  146. 2014-04-29 10:27:04,010 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:04,010 DEBUG zen.pbclientfactory: Cancelling connect timeout
  147. 2014-04-29 10:27:04,546 DEBUG zen.ZenHub: worklist has 3 items
  148. 2014-04-29 10:27:04,546 DEBUG zen.ZenHub: get candidate workers for sendEvents...
  149. 2014-04-29 10:27:04,547 DEBUG zen.ZenHub: candidate workers are [0, 1]
  150. 2014-04-29 10:27:04,547 DEBUG zen.ZenHub: Giving sendEvents to worker 0, (localhost:Products.ZenHub.services.EventService.sendEvents)
  151. 2014-04-29 10:27:04,547 DEBUG zen.ZenHub: get candidate workers for sendEvents...
  152. 2014-04-29 10:27:04,547 DEBUG zen.ZenHub: candidate workers are [1]
  153. 2014-04-29 10:27:04,547 DEBUG zen.ZenHub: Giving sendEvents to worker 1, (localhost:Products.ZenHub.services.EventService.sendEvents)
  154. 2014-04-29 10:27:04,548 DEBUG zen.ZenHub: all workers are busy
  155. 2014-04-29 10:27:04,549 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,548 DEBUG zen.zenhubworker: Servicing sendEvents in Products.ZenHub.services.EventService
  156. 2014-04-29 10:27:04,550 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,550 DEBUG zen.zenhubworker: Synchronized with database
  157. 2014-04-29 10:27:04,550 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:04,550 DEBUG zen.zenhubworker: Servicing sendEvents in Products.ZenHub.services.EventService
  158. 2014-04-29 10:27:04,552 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:04,552 DEBUG zen.zenhubworker: Synchronized with database
  159. 2014-04-29 10:27:04,555 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,554 DEBUG zen.zenhubworker: Synchronized with database
  160. 2014-04-29 10:27:04,556 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,555 DEBUG zen.Events: =============== incoming event ===============
  161. 2014-04-29 10:27:04,556 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,556 DEBUG zen.Events: Got a localhost zentrap heartbeat event (timeout 900 sec).
  162. 2014-04-29 10:27:04,558 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:04,558 DEBUG zen.zenhubworker: Synchronized with database
  163. 2014-04-29 10:27:04,559 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:04,559 DEBUG zen.Events: =============== incoming event ===============
  164. 2014-04-29 10:27:04,559 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:04,559 DEBUG zen.Events: Got a localhost zencommand heartbeat event (timeout 900 sec).
  165. 2014-04-29 10:27:04,561 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,561 DEBUG zen.zenoss.protocols.amqp: Connecting to RabbitMQ...
  166. 2014-04-29 10:27:04,562 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,562 DEBUG zen.protocols: Creating exchange: zenoss.heartbeats
  167. 2014-04-29 10:27:04,564 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,563 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.heartbeat.localhost to exchange zenoss.heartbeats
  168. 2014-04-29 10:27:04,564 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:04,564 DEBUG zen.zenoss.protocols.amqp: Connecting to RabbitMQ...
  169. 2014-04-29 10:27:04,565 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,565 DEBUG zen.zenhubworker: Time in sendEvents: 0.02
  170. 2014-04-29 10:27:04,566 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:04,566 DEBUG zen.protocols: Creating exchange: zenoss.heartbeats
  171. 2014-04-29 10:27:04,566 DEBUG zen.ZenHub: worker 0, work localhost:Products.ZenHub.services.EventService.sendEvents finished in 0.0196249485016
  172. 2014-04-29 10:27:04,567 DEBUG zen.ZenHub: worklist has 1 items
  173. 2014-04-29 10:27:04,567 DEBUG zen.ZenHub: get candidate workers for sendEvents...
  174. 2014-04-29 10:27:04,567 DEBUG zen.ZenHub: candidate workers are [0]
  175. 2014-04-29 10:27:04,567 DEBUG zen.ZenHub: Giving sendEvents to worker 0, (localhost:Products.ZenHub.services.EventService.sendEvents)
  176. 2014-04-29 10:27:04,568 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,568 DEBUG zen.zenhubworker: Servicing sendEvents in Products.ZenHub.services.EventService
  177. 2014-04-29 10:27:04,569 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:04,569 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.heartbeat.localhost to exchange zenoss.heartbeats
  178. 2014-04-29 10:27:04,570 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:04,570 DEBUG zen.zenhubworker: Time in sendEvents: 0.02
  179. 2014-04-29 10:27:04,571 DEBUG zen.ZenHub: worker 1, work localhost:Products.ZenHub.services.EventService.sendEvents finished in 0.0234179496765
  180. 2014-04-29 10:27:04,572 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,572 DEBUG zen.zenhubworker: Synchronized with database
  181. 2014-04-29 10:27:04,573 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,573 DEBUG zen.zenhubworker: Synchronized with database
  182. 2014-04-29 10:27:04,573 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,573 DEBUG zen.Events: =============== incoming event ===============
  183. 2014-04-29 10:27:04,573 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,573 DEBUG zen.Events: Got a localhost zenperfsnmp heartbeat event (timeout 900 sec).
  184. 2014-04-29 10:27:04,574 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,574 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.heartbeat.localhost to exchange zenoss.heartbeats
  185. 2014-04-29 10:27:04,575 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,574 DEBUG zen.Events: =============== incoming event ===============
  186. 2014-04-29 10:27:04,581 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,581 DEBUG zen.queuepublisher: About to publish this event to the raw event queue:uuid: "b7c9022e-cfb2-11e3-b398-000c29d302ba"
  187. created_time: 1398785220179
  188. event_class: "/Status/Perf"
  189. actor {
  190. element_type_id: DEVICE
  191. element_identifier: "vpn.rpccompany.com"
  192. }
  193. summary: "Value changed from 137.0 to 124.0"
  194. severity: SEVERITY_INFO
  195. event_key: "Connections_Connections|Test"
  196. agent: "zenperfsnmp"
  197. monitor: "localhost"
  198. details {
  199. name: "current"
  200. value: "124.0"
  201. }
  202. details {
  203. name: "manager"
  204. value: "zenoss.verustech.com"
  205. }
  206. details {
  207. name: "previous"
  208. value: "137.0"
  209. }
  210. first_seen_time: 1398785220179
  211. , with this routing key: zenoss.zenevent.status.perf
  212. 2014-04-29 10:27:04,584 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,584 DEBUG zen.zenoss.protocols.amqp: Connecting to RabbitMQ...
  213. 2014-04-29 10:27:04,585 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,585 DEBUG zen.protocols: Creating exchange: zenoss.zenevents.raw
  214. 2014-04-29 10:27:04,586 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,586 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.zenevent.status.perf to exchange zenoss.zenevents.raw
  215. 2014-04-29 10:27:04,606 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:04,606 DEBUG zen.zenhubworker: Time in sendEvents: 0.04
  216. 2014-04-29 10:27:04,607 DEBUG zen.ZenHub: worker 0, work localhost:Products.ZenHub.services.EventService.sendEvents finished in 0.0400550365448
  217. 2014-04-29 10:27:11,325 DEBUG zen.ZenHub: worklist has 1 items
  218. 2014-04-29 10:27:11,325 DEBUG zen.ZenHub: get candidate workers for getDevicePingIssues...
  219. 2014-04-29 10:27:11,325 DEBUG zen.ZenHub: candidate workers are [1]
  220. 2014-04-29 10:27:11,325 DEBUG zen.ZenHub: Giving getDevicePingIssues to worker 1, (localhost:Products.ZenHub.services.EventService.getDevicePingIssues)
  221. 2014-04-29 10:27:11,327 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:11,326 DEBUG zen.zenhubworker: Servicing getDevicePingIssues in Products.ZenHub.services.EventService
  222. 2014-04-29 10:27:11,327 DEBUG zen.zenhubworker: Synchronized with database
  223. 2014-04-29 10:27:11,328 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:11,328 DEBUG zen.zenhubworker: Synchronized with database
  224. 2014-04-29 10:27:11,329 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:11,329 DEBUG zen.protocols.services: Creating new HTTP connection pool to: http://localhost:8084/zeneventserver/api/1.0/events/
  225. 2014-04-29 10:27:11,333 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:11,333 DEBUG zen.protocols.services: Elapsed time calling http://localhost:8084/zeneventserver/api/1.0/events/tag_severities: 0.00251293182373
  226. 2014-04-29 10:27:11,334 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:11,334 DEBUG zen.zenhubworker: Time in getDevicePingIssues: 0.01
  227. 2014-04-29 10:27:11,338 INFO zen.ZenHub: Worker (5877) reports Unhandled Error
  228. Traceback (most recent call last):
  229. File "/usr/local/zenoss/lib/python/twisted/spread/pb.py", line 841, in _recvMessage
  230. netResult = object.remoteMessageReceived(self, message, netArgs, netKw)
  231. File "/usr/local/zenoss/lib/python/twisted/spread/flavors.py", line 114, in remoteMessageReceived
  232. state = method(*args, **kw)
  233. File "/usr/local/zenoss/Products/ZenHub/PBDaemon.py", line 84, in inner
  234. return callable(*args, **kw)
  235. File "/usr/local/zenoss/lib/python/twisted/internet/defer.py", line 1141, in unwindGenerator
  236. return _inlineCallbacks(None, f(*args, **kwargs), Deferred())
  237. --- <exception caught here> ---
  238. File "/usr/local/zenoss/lib/python/twisted/internet/defer.py", line 1020, in _inlineCallbacks
  239. result = g.send(result)
  240. File "/usr/local/zenoss/Products/ZenHub/zenhubworker.py", line 204, in remote_execute
  241. result = runOnce()
  242. File "/usr/local/zenoss/Products/ZenHub/zenhubworker.py", line 190, in runOnce
  243. res = m(*args, **kw)
  244. File "/usr/local/zenoss/Products/ZenHub/PBDaemon.py", line 92, in inner
  245. traceback.format_exc())
  246. Products.ZenHub.PBDaemon.RemoteException: Remote exception: <class 'zenoss.protocols.services.ServiceResponseError'>: Service Unavailable: Traceback (most recent call last):
  247. File "/usr/local/zenoss/Products/ZenHub/PBDaemon.py", line 84, in inner
  248. return callable(*args, **kw)
  249. File "/usr/local/zenoss/Products/ZenHub/services/EventService.py", line 52, in remote_getDevicePingIssues
  250. return zep.getDevicePingIssues()
  251. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 617, in getDevicePingIssues
  252. status=[STATUS_NEW,STATUS_ACKNOWLEDGED,STATUS_SUPPRESSED])
  253. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 627, in getDeviceIssues
  254. tagSeverities = self._getEventTagSeverities(eventClass, severity, status)
  255. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 611, in _getEventTagSeverities
  256. response, content = self.client.getEventTagSeverities(from_dict(EventFilter, eventFilter))
  257. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/zep.py", line 174, in getEventTagSeverities
  258. return self.client.post('tag_severities', body=event_filter)
  259. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 175, in post
  260. return self._request_with_body(path, method='POST', body=body, params=params, headers=headers)
  261. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 170, in _request_with_body
  262. response, content = self._executeRequest(request)
  263. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 154, in _executeRequest
  264. raise ServiceResponseError(response.reason, response.status, request, response, content)
  265. ServiceResponseError: Service Unavailable
  266. 2014-04-29 10:27:11,340 DEBUG zen.ZenHub: worker 1, work localhost:Products.ZenHub.services.EventService.getDevicePingIssues finished in 0.0149121284485
  267. Unhandled Error
  268. Traceback (most recent call last):
  269. Failure: Products.ZenHub.PBDaemon.RemoteException: : Traceback (most recent call last):
  270. File "/usr/local/zenoss/Products/ZenHub/PBDaemon.py", line 84, in inner
  271. return callable(*args, **kw)
  272. File "/usr/local/zenoss/Products/ZenHub/services/EventService.py", line 52, in remote_getDevicePingIssues
  273. return zep.getDevicePingIssues()
  274. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 617, in getDevicePingIssues
  275. status=[STATUS_NEW,STATUS_ACKNOWLEDGED,STATUS_SUPPRESSED])
  276. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 627, in getDeviceIssues
  277. tagSeverities = self._getEventTagSeverities(eventClass, severity, status)
  278. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 611, in _getEventTagSeverities
  279. response, content = self.client.getEventTagSeverities(from_dict(EventFilter, eventFilter))
  280. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/zep.py", line 174, in getEventTagSeverities
  281. return self.client.post('tag_severities', body=event_filter)
  282. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 175, in post
  283. return self._request_with_body(path, method='POST', body=body, params=params, headers=headers)
  284. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 170, in _request_with_body
  285. response, content = self._executeRequest(request)
  286. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 154, in _executeRequest
  287. raise ServiceResponseError(response.reason, response.status, request, response, content)
  288. ServiceResponseError: Service Unavailable
  289.  
  290. 2014-04-29 10:27:11,415 DEBUG zen.ZenHub: worklist has 1 items
  291. 2014-04-29 10:27:11,415 DEBUG zen.ZenHub: get candidate workers for getDevicePingIssues...
  292. 2014-04-29 10:27:11,415 DEBUG zen.ZenHub: candidate workers are [1]
  293. 2014-04-29 10:27:11,415 DEBUG zen.ZenHub: Giving getDevicePingIssues to worker 1, (localhost:Products.ZenHub.services.EventService.getDevicePingIssues)
  294. 2014-04-29 10:27:11,416 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:11,416 DEBUG zen.zenhubworker: Servicing getDevicePingIssues in Products.ZenHub.services.EventService
  295. 2014-04-29 10:27:11,417 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:11,417 DEBUG zen.zenhubworker: Synchronized with database
  296. 2014-04-29 10:27:11,418 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:11,418 DEBUG zen.zenhubworker: Synchronized with database
  297. 2014-04-29 10:27:11,421 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:11,420 DEBUG zen.protocols.services: Elapsed time calling http://localhost:8084/zeneventserver/api/1.0/events/tag_severities: 0.00110507011414
  298. 2014-04-29 10:27:11,421 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:11,421 DEBUG zen.zenhubworker: Time in getDevicePingIssues: 0.00
  299. 2014-04-29 10:27:11,424 INFO zen.ZenHub: Worker (5877) reports Unhandled Error
  300. Traceback (most recent call last):
  301. File "/usr/local/zenoss/lib/python/twisted/spread/pb.py", line 841, in _recvMessage
  302. netResult = object.remoteMessageReceived(self, message, netArgs, netKw)
  303. File "/usr/local/zenoss/lib/python/twisted/spread/flavors.py", line 114, in remoteMessageReceived
  304. state = method(*args, **kw)
  305. File "/usr/local/zenoss/Products/ZenHub/PBDaemon.py", line 84, in inner
  306. return callable(*args, **kw)
  307. File "/usr/local/zenoss/lib/python/twisted/internet/defer.py", line 1141, in unwindGenerator
  308. return _inlineCallbacks(None, f(*args, **kwargs), Deferred())
  309. --- <exception caught here> ---
  310. File "/usr/local/zenoss/lib/python/twisted/internet/defer.py", line 1020, in _inlineCallbacks
  311. result = g.send(result)
  312. File "/usr/local/zenoss/Products/ZenHub/zenhubworker.py", line 204, in remote_execute
  313. result = runOnce()
  314. File "/usr/local/zenoss/Products/ZenHub/zenhubworker.py", line 190, in runOnce
  315. res = m(*args, **kw)
  316. File "/usr/local/zenoss/Products/ZenHub/PBDaemon.py", line 92, in inner
  317. traceback.format_exc())
  318. Products.ZenHub.PBDaemon.RemoteException: Remote exception: <class 'zenoss.protocols.services.ServiceResponseError'>: Service Unavailable: Traceback (most recent call last):
  319. File "/usr/local/zenoss/Products/ZenHub/PBDaemon.py", line 84, in inner
  320. return callable(*args, **kw)
  321. File "/usr/local/zenoss/Products/ZenHub/services/EventService.py", line 52, in remote_getDevicePingIssues
  322. return zep.getDevicePingIssues()
  323. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 617, in getDevicePingIssues
  324. status=[STATUS_NEW,STATUS_ACKNOWLEDGED,STATUS_SUPPRESSED])
  325. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 627, in getDeviceIssues
  326. tagSeverities = self._getEventTagSeverities(eventClass, severity, status)
  327. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 611, in _getEventTagSeverities
  328. response, content = self.client.getEventTagSeverities(from_dict(EventFilter, eventFilter))
  329. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/zep.py", line 174, in getEventTagSeverities
  330. return self.client.post('tag_severities', body=event_filter)
  331. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 175, in post
  332. return self._request_with_body(path, method='POST', body=body, params=params, headers=headers)
  333. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 170, in _request_with_body
  334. response, content = self._executeRequest(request)
  335. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 154, in _executeRequest
  336. raise ServiceResponseError(response.reason, response.status, request, response, content)
  337. ServiceResponseError: Service Unavailable
  338. 2014-04-29 10:27:11,426 DEBUG zen.ZenHub: worker 1, work localhost:Products.ZenHub.services.EventService.getDevicePingIssues finished in 0.010204076767
  339. Unhandled Error
  340. Traceback (most recent call last):
  341. Failure: Products.ZenHub.PBDaemon.RemoteException: : Traceback (most recent call last):
  342. File "/usr/local/zenoss/Products/ZenHub/PBDaemon.py", line 84, in inner
  343. return callable(*args, **kw)
  344. File "/usr/local/zenoss/Products/ZenHub/services/EventService.py", line 52, in remote_getDevicePingIssues
  345. return zep.getDevicePingIssues()
  346. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 617, in getDevicePingIssues
  347. status=[STATUS_NEW,STATUS_ACKNOWLEDGED,STATUS_SUPPRESSED])
  348. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 627, in getDeviceIssues
  349. tagSeverities = self._getEventTagSeverities(eventClass, severity, status)
  350. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 611, in _getEventTagSeverities
  351. response, content = self.client.getEventTagSeverities(from_dict(EventFilter, eventFilter))
  352. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/zep.py", line 174, in getEventTagSeverities
  353. return self.client.post('tag_severities', body=event_filter)
  354. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 175, in post
  355. return self._request_with_body(path, method='POST', body=body, params=params, headers=headers)
  356. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 170, in _request_with_body
  357. response, content = self._executeRequest(request)
  358. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 154, in _executeRequest
  359. raise ServiceResponseError(response.reason, response.status, request, response, content)
  360. ServiceResponseError: Service Unavailable
  361.  
  362. 2014-04-29 10:27:11,913 DEBUG zen.ZenHub: worklist has 1 items
  363. 2014-04-29 10:27:11,913 DEBUG zen.ZenHub: get candidate workers for sendEvents...
  364. 2014-04-29 10:27:11,913 DEBUG zen.ZenHub: candidate workers are [0, 1]
  365. 2014-04-29 10:27:11,913 DEBUG zen.ZenHub: Giving sendEvents to worker 0, (localhost:Products.ZenHub.services.EventService.sendEvents)
  366. 2014-04-29 10:27:11,915 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:11,914 DEBUG zen.zenhubworker: Servicing sendEvents in Products.ZenHub.services.EventService
  367. 2014-04-29 10:27:11,916 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:11,916 DEBUG zen.zenhubworker: Synchronized with database
  368. 2014-04-29 10:27:11,917 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:11,917 DEBUG zen.zenhubworker: Synchronized with database
  369. 2014-04-29 10:27:11,917 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:11,917 DEBUG zen.Events: =============== incoming event ===============
  370. 2014-04-29 10:27:11,918 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:11,918 DEBUG zen.Events: Got a localhost zenwinperf heartbeat event (timeout 900 sec).
  371. 2014-04-29 10:27:11,918 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:11,918 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.heartbeat.localhost to exchange zenoss.heartbeats
  372. 2014-04-29 10:27:11,919 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:11,919 DEBUG zen.zenhubworker: Time in sendEvents: 0.00
  373. 2014-04-29 10:27:11,919 DEBUG zen.ZenHub: worker 0, work localhost:Products.ZenHub.services.EventService.sendEvents finished in 0.00624585151672
  374. 2014-04-29 10:27:11,957 DEBUG zen.ZenHub: worklist has 1 items
  375. 2014-04-29 10:27:11,957 DEBUG zen.ZenHub: get candidate workers for sendEvents...
  376. 2014-04-29 10:27:11,957 DEBUG zen.ZenHub: candidate workers are [0, 1]
  377. 2014-04-29 10:27:11,957 DEBUG zen.ZenHub: Giving sendEvents to worker 0, (localhost:Products.ZenHub.services.EventService.sendEvents)
  378. 2014-04-29 10:27:11,958 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:11,958 DEBUG zen.zenhubworker: Servicing sendEvents in Products.ZenHub.services.EventService
  379. 2014-04-29 10:27:11,959 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:11,959 DEBUG zen.zenhubworker: Synchronized with database
  380. 2014-04-29 10:27:11,961 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:11,961 DEBUG zen.zenhubworker: Synchronized with database
  381. 2014-04-29 10:27:11,961 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:11,961 DEBUG zen.Events: =============== incoming event ===============
  382. 2014-04-29 10:27:11,961 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:11,961 DEBUG zen.Events: Got a localhost zenwin heartbeat event (timeout 900 sec).
  383. 2014-04-29 10:27:11,962 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:11,962 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.heartbeat.localhost to exchange zenoss.heartbeats
  384. 2014-04-29 10:27:11,962 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:11,962 DEBUG zen.zenhubworker: Time in sendEvents: 0.00
  385. 2014-04-29 10:27:11,963 DEBUG zen.ZenHub: worker 0, work localhost:Products.ZenHub.services.EventService.sendEvents finished in 0.00561809539795
  386. 2014-04-29 10:27:12,591 DEBUG zen.hub: adding listener for localhost:EventService
  387. 2014-04-29 10:27:12,592 DEBUG zen.hub: adding listener for localhost:ModelerService
  388. 2014-04-29 10:27:13,830 DEBUG zen.ZenHub: worklist has 1 items
  389. 2014-04-29 10:27:13,830 DEBUG zen.ZenHub: get candidate workers for sendEvents...
  390. 2014-04-29 10:27:13,830 DEBUG zen.ZenHub: candidate workers are [0, 1]
  391. 2014-04-29 10:27:13,830 DEBUG zen.ZenHub: Giving sendEvents to worker 0, (localhost:Products.ZenHub.services.EventService.sendEvents)
  392. 2014-04-29 10:27:13,831 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:13,831 DEBUG zen.zenhubworker: Servicing sendEvents in Products.ZenHub.services.EventService
  393. 2014-04-29 10:27:13,832 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:13,832 DEBUG zen.zenhubworker: Synchronized with database
  394. 2014-04-29 10:27:13,834 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:13,833 DEBUG zen.zenhubworker: Synchronized with database
  395. 2014-04-29 10:27:13,834 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:13,834 DEBUG zen.Events: =============== incoming event ===============
  396. 2014-04-29 10:27:13,834 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:13,834 DEBUG zen.Events: Got a localhost zenmodeler heartbeat event (timeout 90 sec).
  397. 2014-04-29 10:27:13,835 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:13,834 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.heartbeat.localhost to exchange zenoss.heartbeats
  398. 2014-04-29 10:27:13,835 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:13,835 DEBUG zen.zenhubworker: Time in sendEvents: 0.00
  399. 2014-04-29 10:27:13,836 DEBUG zen.ZenHub: worker 0, work localhost:Products.ZenHub.services.EventService.sendEvents finished in 0.00550889968872
  400. 2014-04-29 10:27:14,682 DEBUG zen.hub: adding listener for localhost:EventService
  401. 2014-04-29 10:27:14,683 DEBUG zen.hub: adding listener for localhost:ZenStatusConfig
  402. 2014-04-29 10:27:16,971 DEBUG zen.hub: adding listener for localhost:EventService
  403. 2014-04-29 10:27:16,972 DEBUG zen.hub: adding listener for localhost:EventLogConfig
  404. 2014-04-29 10:27:17,719 DEBUG zen.ZenHub: worklist has 1 items
  405. 2014-04-29 10:27:17,719 DEBUG zen.ZenHub: get candidate workers for getDevicePingIssues...
  406. 2014-04-29 10:27:17,719 DEBUG zen.ZenHub: candidate workers are [1]
  407. 2014-04-29 10:27:17,719 DEBUG zen.ZenHub: Giving getDevicePingIssues to worker 1, (localhost:Products.ZenHub.services.EventService.getDevicePingIssues)
  408. 2014-04-29 10:27:17,721 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:17,720 DEBUG zen.zenhubworker: Servicing getDevicePingIssues in Products.ZenHub.services.EventService
  409. 2014-04-29 10:27:17,721 DEBUG zen.zenhubworker: Synchronized with database
  410. 2014-04-29 10:27:17,723 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:17,723 DEBUG zen.zenhubworker: Synchronized with database
  411. 2014-04-29 10:27:17,725 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:17,725 DEBUG zen.protocols.services: Elapsed time calling http://localhost:8084/zeneventserver/api/1.0/events/tag_severities: 0.00114607810974
  412. 2014-04-29 10:27:17,725 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:17,725 DEBUG zen.zenhubworker: Time in getDevicePingIssues: 0.01
  413. 2014-04-29 10:27:17,728 INFO zen.ZenHub: Worker (5877) reports Unhandled Error
  414. Traceback (most recent call last):
  415. File "/usr/local/zenoss/lib/python/twisted/spread/pb.py", line 841, in _recvMessage
  416. netResult = object.remoteMessageReceived(self, message, netArgs, netKw)
  417. File "/usr/local/zenoss/lib/python/twisted/spread/flavors.py", line 114, in remoteMessageReceived
  418. state = method(*args, **kw)
  419. File "/usr/local/zenoss/Products/ZenHub/PBDaemon.py", line 84, in inner
  420. return callable(*args, **kw)
  421. File "/usr/local/zenoss/lib/python/twisted/internet/defer.py", line 1141, in unwindGenerator
  422. return _inlineCallbacks(None, f(*args, **kwargs), Deferred())
  423. --- <exception caught here> ---
  424. File "/usr/local/zenoss/lib/python/twisted/internet/defer.py", line 1020, in _inlineCallbacks
  425. result = g.send(result)
  426. File "/usr/local/zenoss/Products/ZenHub/zenhubworker.py", line 204, in remote_execute
  427. result = runOnce()
  428. File "/usr/local/zenoss/Products/ZenHub/zenhubworker.py", line 190, in runOnce
  429. res = m(*args, **kw)
  430. File "/usr/local/zenoss/Products/ZenHub/PBDaemon.py", line 92, in inner
  431. traceback.format_exc())
  432. Products.ZenHub.PBDaemon.RemoteException: Remote exception: <class 'zenoss.protocols.services.ServiceResponseError'>: Service Unavailable: Traceback (most recent call last):
  433. File "/usr/local/zenoss/Products/ZenHub/PBDaemon.py", line 84, in inner
  434. return callable(*args, **kw)
  435. File "/usr/local/zenoss/Products/ZenHub/services/EventService.py", line 52, in remote_getDevicePingIssues
  436. return zep.getDevicePingIssues()
  437. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 617, in getDevicePingIssues
  438. status=[STATUS_NEW,STATUS_ACKNOWLEDGED,STATUS_SUPPRESSED])
  439. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 627, in getDeviceIssues
  440. tagSeverities = self._getEventTagSeverities(eventClass, severity, status)
  441. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 611, in _getEventTagSeverities
  442. response, content = self.client.getEventTagSeverities(from_dict(EventFilter, eventFilter))
  443. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/zep.py", line 174, in getEventTagSeverities
  444. return self.client.post('tag_severities', body=event_filter)
  445. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 175, in post
  446. return self._request_with_body(path, method='POST', body=body, params=params, headers=headers)
  447. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 170, in _request_with_body
  448. response, content = self._executeRequest(request)
  449. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 154, in _executeRequest
  450. raise ServiceResponseError(response.reason, response.status, request, response, content)
  451. ServiceResponseError: Service Unavailable
  452. 2014-04-29 10:27:17,730 DEBUG zen.ZenHub: worker 1, work localhost:Products.ZenHub.services.EventService.getDevicePingIssues finished in 0.0110301971436
  453. Unhandled Error
  454. Traceback (most recent call last):
  455. Failure: Products.ZenHub.PBDaemon.RemoteException: : Traceback (most recent call last):
  456. File "/usr/local/zenoss/Products/ZenHub/PBDaemon.py", line 84, in inner
  457. return callable(*args, **kw)
  458. File "/usr/local/zenoss/Products/ZenHub/services/EventService.py", line 52, in remote_getDevicePingIssues
  459. return zep.getDevicePingIssues()
  460. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 617, in getDevicePingIssues
  461. status=[STATUS_NEW,STATUS_ACKNOWLEDGED,STATUS_SUPPRESSED])
  462. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 627, in getDeviceIssues
  463. tagSeverities = self._getEventTagSeverities(eventClass, severity, status)
  464. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 611, in _getEventTagSeverities
  465. response, content = self.client.getEventTagSeverities(from_dict(EventFilter, eventFilter))
  466. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/zep.py", line 174, in getEventTagSeverities
  467. return self.client.post('tag_severities', body=event_filter)
  468. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 175, in post
  469. return self._request_with_body(path, method='POST', body=body, params=params, headers=headers)
  470. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 170, in _request_with_body
  471. response, content = self._executeRequest(request)
  472. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 154, in _executeRequest
  473. raise ServiceResponseError(response.reason, response.status, request, response, content)
  474. ServiceResponseError: Service Unavailable
  475.  
  476. 2014-04-29 10:27:17,898 DEBUG zen.ZenHub: worklist has 1 items
  477. 2014-04-29 10:27:17,898 DEBUG zen.ZenHub: get candidate workers for sendEvents...
  478. 2014-04-29 10:27:17,898 DEBUG zen.ZenHub: candidate workers are [0, 1]
  479. 2014-04-29 10:27:17,898 DEBUG zen.ZenHub: Giving sendEvents to worker 0, (localhost:Products.ZenHub.services.EventService.sendEvents)
  480. 2014-04-29 10:27:17,900 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:17,899 DEBUG zen.zenhubworker: Servicing sendEvents in Products.ZenHub.services.EventService
  481. 2014-04-29 10:27:17,901 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:17,901 DEBUG zen.zenhubworker: Synchronized with database
  482. 2014-04-29 10:27:17,903 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:17,903 DEBUG zen.zenhubworker: Synchronized with database
  483. 2014-04-29 10:27:17,904 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:17,904 DEBUG zen.Events: =============== incoming event ===============
  484. 2014-04-29 10:27:17,905 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:17,905 DEBUG zen.Events: Got a localhost zeneventlog heartbeat event (timeout 900 sec).
  485. 2014-04-29 10:27:17,905 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:17,905 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.heartbeat.localhost to exchange zenoss.heartbeats
  486. 2014-04-29 10:27:17,908 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:17,908 DEBUG zen.zenhubworker: Time in sendEvents: 0.01
  487. 2014-04-29 10:27:17,908 DEBUG zen.ZenHub: worker 0, work localhost:Products.ZenHub.services.EventService.sendEvents finished in 0.0100610256195
  488. 2014-04-29 10:27:20,323 DEBUG zen.ZenHub: worklist has 1 items
  489. 2014-04-29 10:27:20,324 DEBUG zen.ZenHub: get candidate workers for sendEvents...
  490. 2014-04-29 10:27:20,324 DEBUG zen.ZenHub: candidate workers are [0, 1]
  491. 2014-04-29 10:27:20,324 DEBUG zen.ZenHub: Giving sendEvents to worker 0, (localhost:Products.ZenHub.services.EventService.sendEvents)
  492. 2014-04-29 10:27:20,325 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:20,325 DEBUG zen.zenhubworker: Servicing sendEvents in Products.ZenHub.services.EventService
  493. 2014-04-29 10:27:20,326 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:20,326 DEBUG zen.zenhubworker: Synchronized with database
  494. 2014-04-29 10:27:20,327 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:20,327 DEBUG zen.zenhubworker: Synchronized with database
  495. 2014-04-29 10:27:20,328 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:20,327 DEBUG zen.Events: =============== incoming event ===============
  496. 2014-04-29 10:27:20,328 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:20,328 DEBUG zen.Events: Got a localhost zenjmx heartbeat event (timeout 900 sec).
  497. 2014-04-29 10:27:20,328 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:20,328 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.heartbeat.localhost to exchange zenoss.heartbeats
  498. 2014-04-29 10:27:20,329 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:20,329 DEBUG zen.zenhubworker: Time in sendEvents: 0.00
  499. 2014-04-29 10:27:20,330 DEBUG zen.ZenHub: worker 0, work localhost:Products.ZenHub.services.EventService.sendEvents finished in 0.00557494163513
  500. 2014-04-29 10:27:23,831 DEBUG zen.ZenHub: worklist has 1 items
  501. 2014-04-29 10:27:23,832 DEBUG zen.ZenHub: get candidate workers for sendEvents...
  502. 2014-04-29 10:27:23,832 DEBUG zen.ZenHub: candidate workers are [0, 1]
  503. 2014-04-29 10:27:23,832 DEBUG zen.ZenHub: Giving sendEvents to worker 0, (localhost:Products.ZenHub.services.EventService.sendEvents)
  504. 2014-04-29 10:27:23,833 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:23,833 DEBUG zen.zenhubworker: Servicing sendEvents in Products.ZenHub.services.EventService
  505. 2014-04-29 10:27:23,834 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:23,834 DEBUG zen.zenhubworker: Synchronized with database
  506. 2014-04-29 10:27:23,835 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:23,835 DEBUG zen.zenhubworker: Synchronized with database
  507. 2014-04-29 10:27:23,836 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:23,836 DEBUG zen.Events: =============== incoming event ===============
  508. 2014-04-29 10:27:23,836 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:23,836 DEBUG zen.Events: Got a localhost zenmodeler heartbeat event (timeout 90 sec).
  509. 2014-04-29 10:27:23,836 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:23,836 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.heartbeat.localhost to exchange zenoss.heartbeats
  510. 2014-04-29 10:27:23,837 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:23,837 DEBUG zen.zenhubworker: Time in sendEvents: 0.00
  511. 2014-04-29 10:27:23,838 DEBUG zen.ZenHub: worker 0, work localhost:Products.ZenHub.services.EventService.sendEvents finished in 0.00593090057373
  512. 2014-04-29 10:27:27,505 DEBUG zen.ZenHub: [processQueue] syncing....
  513. 2014-04-29 10:27:27,523 DEBUG zen.ZenHub: Synchronized with database
  514. 2014-04-29 10:27:27,523 DEBUG zen.ZenHub: [processQueue] synced
  515. 2014-04-29 10:27:27,551 DEBUG zen.ZenHub: worklist has 1 items
  516. 2014-04-29 10:27:27,551 DEBUG zen.ZenHub: get candidate workers for sendEvents...
  517. 2014-04-29 10:27:27,551 DEBUG zen.ZenHub: candidate workers are [0, 1]
  518. 2014-04-29 10:27:27,551 DEBUG zen.ZenHub: Giving sendEvents to worker 0, (localhost:Products.ZenHub.services.EventService.sendEvents)
  519. 2014-04-29 10:27:27,553 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:27,552 DEBUG zen.zenhubworker: Servicing sendEvents in Products.ZenHub.services.EventService
  520. 2014-04-29 10:27:27,553 DEBUG zen.zenhubworker: Synchronized with database
  521. 2014-04-29 10:27:27,555 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:27,555 DEBUG zen.zenhubworker: Synchronized with database
  522. 2014-04-29 10:27:27,555 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:27,555 DEBUG zen.Events: =============== incoming event ===============
  523. 2014-04-29 10:27:27,562 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:27,561 DEBUG zen.queuepublisher: About to publish this event to the raw event queue:uuid: "c57bb1be-cfb2-11e3-b398-000c29d302ba"
  524. created_time: 1398785244173
  525. event_class: "/Status/Snmp"
  526. actor {
  527. element_type_id: DEVICE
  528. element_identifier: "savpn.divconems.com"
  529. }
  530. summary: "SNMP agent down - no response received"
  531. severity: SEVERITY_ERROR
  532. event_key: "agent_down"
  533. event_group: "SnmpTest"
  534. agent: "zenperfsnmp"
  535. monitor: "localhost"
  536. details {
  537. name: "manager"
  538. value: "zenoss.verustech.com"
  539. }
  540. first_seen_time: 1398785244173
  541. , with this routing key: zenoss.zenevent.status.snmp
  542. 2014-04-29 10:27:27,565 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:27,565 DEBUG zen.zenoss.protocols.amqp: Connecting to RabbitMQ...
  543. 2014-04-29 10:27:27,566 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:27,566 DEBUG zen.protocols: Creating exchange: zenoss.zenevents.raw
  544. 2014-04-29 10:27:27,567 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:27,567 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.zenevent.status.snmp to exchange zenoss.zenevents.raw
  545. 2014-04-29 10:27:27,579 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:27,579 DEBUG zen.Events: =============== incoming event ===============
  546. 2014-04-29 10:27:27,584 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:27,584 DEBUG zen.queuepublisher: About to publish this event to the raw event queue:uuid: "c57f3ece-cfb2-11e3-b398-000c29d302ba"
  547. created_time: 1398785245175
  548. event_class: "/Status/Snmp"
  549. actor {
  550. element_type_id: DEVICE
  551. element_identifier: "dalvpn.divconems.com"
  552. }
  553. summary: "SNMP agent down - no response received"
  554. severity: SEVERITY_ERROR
  555. event_key: "agent_down"
  556. event_group: "SnmpTest"
  557. agent: "zenperfsnmp"
  558. monitor: "localhost"
  559. details {
  560. name: "manager"
  561. value: "zenoss.verustech.com"
  562. }
  563. first_seen_time: 1398785245175
  564. , with this routing key: zenoss.zenevent.status.snmp
  565. 2014-04-29 10:27:27,585 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:27,585 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.zenevent.status.snmp to exchange zenoss.zenevents.raw
  566. 2014-04-29 10:27:27,587 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:27,587 DEBUG zen.zenhubworker: Time in sendEvents: 0.03
  567. 2014-04-29 10:27:27,588 DEBUG zen.ZenHub: worker 0, work localhost:Products.ZenHub.services.EventService.sendEvents finished in 0.0369780063629
  568. 2014-04-29 10:27:32,551 DEBUG zen.ZenHub: worklist has 1 items
  569. 2014-04-29 10:27:32,551 DEBUG zen.ZenHub: get candidate workers for sendEvents...
  570. 2014-04-29 10:27:32,551 DEBUG zen.ZenHub: candidate workers are [0, 1]
  571. 2014-04-29 10:27:32,552 DEBUG zen.ZenHub: Giving sendEvents to worker 0, (localhost:Products.ZenHub.services.EventService.sendEvents)
  572. 2014-04-29 10:27:32,553 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:32,552 DEBUG zen.zenhubworker: Servicing sendEvents in Products.ZenHub.services.EventService
  573. 2014-04-29 10:27:32,554 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:32,554 DEBUG zen.zenhubworker: Synchronized with database
  574. 2014-04-29 10:27:32,562 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:32,561 DEBUG zen.zenhubworker: Synchronized with database
  575. 2014-04-29 10:27:32,562 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:32,562 DEBUG zen.Events: =============== incoming event ===============
  576. 2014-04-29 10:27:32,573 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:32,573 DEBUG zen.queuepublisher: About to publish this event to the raw event queue:uuid: "c8787cb2-cfb2-11e3-b398-000c29d302ba"
  577. created_time: 1398785248241
  578. event_class: "/Status/Perf"
  579. actor {
  580. element_type_id: DEVICE
  581. element_identifier: "cwm.verustech.com"
  582. }
  583. summary: "Value changed from 45.0 to 54.0"
  584. severity: SEVERITY_INFO
  585. event_key: "Connections_Connections|Test"
  586. agent: "zenperfsnmp"
  587. monitor: "localhost"
  588. details {
  589. name: "current"
  590. value: "54.0"
  591. }
  592. details {
  593. name: "manager"
  594. value: "zenoss.verustech.com"
  595. }
  596. details {
  597. name: "previous"
  598. value: "45.0"
  599. }
  600. first_seen_time: 1398785248241
  601. , with this routing key: zenoss.zenevent.status.perf
  602. 2014-04-29 10:27:32,579 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:32,578 DEBUG zen.zenoss.protocols.amqp: Connecting to RabbitMQ...
  603. 2014-04-29 10:27:32,580 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:32,579 DEBUG zen.protocols: Creating exchange: zenoss.zenevents.raw
  604. 2014-04-29 10:27:32,581 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:32,580 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.zenevent.status.perf to exchange zenoss.zenevents.raw
  605. 2014-04-29 10:27:32,584 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:32,583 DEBUG zen.zenhubworker: Time in sendEvents: 0.03
  606. 2014-04-29 10:27:32,585 DEBUG zen.ZenHub: worker 0, work localhost:Products.ZenHub.services.EventService.sendEvents finished in 0.0329360961914
  607. 2014-04-29 10:27:36,727 DEBUG zen.ZenHub: worklist has 1 items
  608. 2014-04-29 10:27:36,727 DEBUG zen.ZenHub: get candidate workers for getDevicePingIssues...
  609. 2014-04-29 10:27:36,728 DEBUG zen.ZenHub: candidate workers are [1]
  610. 2014-04-29 10:27:36,728 DEBUG zen.ZenHub: Giving getDevicePingIssues to worker 1, (localhost:Products.ZenHub.services.EventService.getDevicePingIssues)
  611. 2014-04-29 10:27:36,729 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:36,728 DEBUG zen.zenhubworker: Servicing getDevicePingIssues in Products.ZenHub.services.EventService
  612. 2014-04-29 10:27:36,730 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:36,730 DEBUG zen.zenhubworker: Synchronized with database
  613. 2014-04-29 10:27:36,731 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:36,731 DEBUG zen.zenhubworker: Synchronized with database
  614. 2014-04-29 10:27:36,735 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:27:36,733 DEBUG zen.protocols.services: Elapsed time calling http://localhost:8084/zeneventserver/api/1.0/events/tag_severities: 0.00105500221252
  615. 2014-04-29 10:27:36,733 DEBUG zen.zenhubworker: Time in getDevicePingIssues: 0.00
  616. 2014-04-29 10:27:36,736 INFO zen.ZenHub: Worker (5877) reports Unhandled Error
  617. Traceback (most recent call last):
  618. File "/usr/local/zenoss/lib/python/twisted/spread/pb.py", line 841, in _recvMessage
  619. netResult = object.remoteMessageReceived(self, message, netArgs, netKw)
  620. File "/usr/local/zenoss/lib/python/twisted/spread/flavors.py", line 114, in remoteMessageReceived
  621. state = method(*args, **kw)
  622. File "/usr/local/zenoss/Products/ZenHub/PBDaemon.py", line 84, in inner
  623. return callable(*args, **kw)
  624. File "/usr/local/zenoss/lib/python/twisted/internet/defer.py", line 1141, in unwindGenerator
  625. return _inlineCallbacks(None, f(*args, **kwargs), Deferred())
  626. --- <exception caught here> ---
  627. File "/usr/local/zenoss/lib/python/twisted/internet/defer.py", line 1020, in _inlineCallbacks
  628. result = g.send(result)
  629. File "/usr/local/zenoss/Products/ZenHub/zenhubworker.py", line 204, in remote_execute
  630. result = runOnce()
  631. File "/usr/local/zenoss/Products/ZenHub/zenhubworker.py", line 190, in runOnce
  632. res = m(*args, **kw)
  633. File "/usr/local/zenoss/Products/ZenHub/PBDaemon.py", line 92, in inner
  634. traceback.format_exc())
  635. Products.ZenHub.PBDaemon.RemoteException: Remote exception: <class 'zenoss.protocols.services.ServiceResponseError'>: Service Unavailable: Traceback (most recent call last):
  636. File "/usr/local/zenoss/Products/ZenHub/PBDaemon.py", line 84, in inner
  637. return callable(*args, **kw)
  638. File "/usr/local/zenoss/Products/ZenHub/services/EventService.py", line 52, in remote_getDevicePingIssues
  639. return zep.getDevicePingIssues()
  640. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 617, in getDevicePingIssues
  641. status=[STATUS_NEW,STATUS_ACKNOWLEDGED,STATUS_SUPPRESSED])
  642. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 627, in getDeviceIssues
  643. tagSeverities = self._getEventTagSeverities(eventClass, severity, status)
  644. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 611, in _getEventTagSeverities
  645. response, content = self.client.getEventTagSeverities(from_dict(EventFilter, eventFilter))
  646. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/zep.py", line 174, in getEventTagSeverities
  647. return self.client.post('tag_severities', body=event_filter)
  648. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 175, in post
  649. return self._request_with_body(path, method='POST', body=body, params=params, headers=headers)
  650. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 170, in _request_with_body
  651. response, content = self._executeRequest(request)
  652. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 154, in _executeRequest
  653. raise ServiceResponseError(response.reason, response.status, request, response, content)
  654. ServiceResponseError: Service Unavailable
  655. 2014-04-29 10:27:36,737 DEBUG zen.ZenHub: worker 1, work localhost:Products.ZenHub.services.EventService.getDevicePingIssues finished in 0.0093789100647
  656. Unhandled Error
  657. Traceback (most recent call last):
  658. Failure: Products.ZenHub.PBDaemon.RemoteException: : Traceback (most recent call last):
  659. File "/usr/local/zenoss/Products/ZenHub/PBDaemon.py", line 84, in inner
  660. return callable(*args, **kw)
  661. File "/usr/local/zenoss/Products/ZenHub/services/EventService.py", line 52, in remote_getDevicePingIssues
  662. return zep.getDevicePingIssues()
  663. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 617, in getDevicePingIssues
  664. status=[STATUS_NEW,STATUS_ACKNOWLEDGED,STATUS_SUPPRESSED])
  665. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 627, in getDeviceIssues
  666. tagSeverities = self._getEventTagSeverities(eventClass, severity, status)
  667. File "/usr/local/zenoss/Products/Zuul/facades/zepfacade.py", line 611, in _getEventTagSeverities
  668. response, content = self.client.getEventTagSeverities(from_dict(EventFilter, eventFilter))
  669. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/zep.py", line 174, in getEventTagSeverities
  670. return self.client.post('tag_severities', body=event_filter)
  671. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 175, in post
  672. return self._request_with_body(path, method='POST', body=body, params=params, headers=headers)
  673. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 170, in _request_with_body
  674. response, content = self._executeRequest(request)
  675. File "/usr/local/zenoss/lib/python/zenoss/protocols/services/__init__.py", line 154, in _executeRequest
  676. raise ServiceResponseError(response.reason, response.status, request, response, content)
  677. ServiceResponseError: Service Unavailable
  678.  
  679. 2014-04-29 10:27:36,975 DEBUG zen.ZenHub: worklist has 1 items
  680. 2014-04-29 10:27:36,976 DEBUG zen.ZenHub: get candidate workers for sendEvents...
  681. 2014-04-29 10:27:36,976 DEBUG zen.ZenHub: candidate workers are [0, 1]
  682. 2014-04-29 10:27:36,976 DEBUG zen.ZenHub: Giving sendEvents to worker 0, (localhost:Products.ZenHub.services.EventService.sendEvents)
  683. 2014-04-29 10:27:36,977 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:36,977 DEBUG zen.zenhubworker: Servicing sendEvents in Products.ZenHub.services.EventService
  684. 2014-04-29 10:27:36,979 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:36,978 DEBUG zen.zenhubworker: Synchronized with database
  685. 2014-04-29 10:27:36,980 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:36,980 DEBUG zen.zenhubworker: Synchronized with database
  686. 2014-04-29 10:27:36,980 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:36,980 DEBUG zen.Events: =============== incoming event ===============
  687. 2014-04-29 10:27:36,980 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:36,980 DEBUG zen.Events: Got a localhost zenstatus heartbeat event (timeout 180 sec).
  688. 2014-04-29 10:27:36,981 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:36,981 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.heartbeat.localhost to exchange zenoss.heartbeats
  689. 2014-04-29 10:27:36,981 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:36,981 DEBUG zen.zenhubworker: Time in sendEvents: 0.00
  690. 2014-04-29 10:27:36,982 DEBUG zen.ZenHub: worker 0, work localhost:Products.ZenHub.services.EventService.sendEvents finished in 0.00616693496704
  691. 2014-04-29 10:27:37,344 DEBUG zen.ZenHub: worklist has 1 items
  692. 2014-04-29 10:27:37,344 DEBUG zen.ZenHub: get candidate workers for sendEvents...
  693. 2014-04-29 10:27:37,344 DEBUG zen.ZenHub: candidate workers are [0, 1]
  694. 2014-04-29 10:27:37,345 DEBUG zen.ZenHub: Giving sendEvents to worker 0, (localhost:Products.ZenHub.services.EventService.sendEvents)
  695. 2014-04-29 10:27:37,346 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,345 DEBUG zen.zenhubworker: Servicing sendEvents in Products.ZenHub.services.EventService
  696. 2014-04-29 10:27:37,347 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,347 DEBUG zen.zenhubworker: Synchronized with database
  697. 2014-04-29 10:27:37,348 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,348 DEBUG zen.zenhubworker: Synchronized with database
  698. 2014-04-29 10:27:37,349 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,348 DEBUG zen.Events: =============== incoming event ===============
  699. 2014-04-29 10:27:37,353 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,353 DEBUG zen.queuepublisher: About to publish this event to the raw event queue:uuid: "cb51eacc-cfb2-11e3-b398-000c29d302ba"
  700. created_time: 1398785252570
  701. event_class: "/Status/Ping"
  702. actor {
  703. element_type_id: DEVICE
  704. element_identifier: "64.183.176.203"
  705. }
  706. summary: "64.183.176.203 is DOWN!"
  707. severity: SEVERITY_CRITICAL
  708. event_key: ""
  709. event_group: "Ping"
  710. agent: "zenping"
  711. monitor: "localhost"
  712. details {
  713. name: "manager"
  714. value: "zenoss.verustech.com"
  715. }
  716. details {
  717. name: "isManageIp"
  718. value: "True"
  719. }
  720. details {
  721. name: "zenoss.device.ip_address"
  722. value: "70.122.224.64"
  723. }
  724. first_seen_time: 1398785252570
  725. , with this routing key: zenoss.zenevent.status.ping
  726. 2014-04-29 10:27:37,356 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,356 DEBUG zen.zenoss.protocols.amqp: Connecting to RabbitMQ...
  727. 2014-04-29 10:27:37,357 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,357 DEBUG zen.protocols: Creating exchange: zenoss.zenevents.raw
  728. 2014-04-29 10:27:37,358 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,358 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.zenevent.status.ping to exchange zenoss.zenevents.raw
  729. 2014-04-29 10:27:37,373 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,373 DEBUG zen.Events: =============== incoming event ===============
  730. 2014-04-29 10:27:37,374 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,374 DEBUG zen.queuepublisher: About to publish this event to the raw event queue:uuid: "cb554eba-cfb2-11e3-b398-000c29d302ba"
  731. created_time: 1398785252570
  732. event_class: "/Status/Ping"
  733. actor {
  734. element_type_id: DEVICE
  735. element_identifier: "dalvpn.divconems.com"
  736. }
  737. summary: "dalvpn.divconems.com is DOWN!"
  738. severity: SEVERITY_CRITICAL
  739. event_key: ""
  740. event_group: "Ping"
  741. agent: "zenping"
  742. monitor: "localhost"
  743. details {
  744. name: "manager"
  745. value: "zenoss.verustech.com"
  746. }
  747. details {
  748. name: "isManageIp"
  749. value: "True"
  750. }
  751. details {
  752. name: "zenoss.device.ip_address"
  753. value: "71.41.199.50"
  754. }
  755. first_seen_time: 1398785252570
  756. , with this routing key: zenoss.zenevent.status.ping
  757. 2014-04-29 10:27:37,375 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,375 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.zenevent.status.ping to exchange zenoss.zenevents.raw
  758. 2014-04-29 10:27:37,376 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,376 DEBUG zen.Events: =============== incoming event ===============
  759. 2014-04-29 10:27:37,377 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,377 DEBUG zen.queuepublisher: About to publish this event to the raw event queue:uuid: "cb55bb02-cfb2-11e3-b398-000c29d302ba"
  760. created_time: 1398785252570
  761. event_class: "/Status/Ping"
  762. actor {
  763. element_type_id: DEVICE
  764. element_identifier: "for.verustech.com"
  765. }
  766. summary: "for.verustech.com is DOWN!"
  767. severity: SEVERITY_CRITICAL
  768. event_key: ""
  769. event_group: "Ping"
  770. agent: "zenping"
  771. monitor: "localhost"
  772. details {
  773. name: "manager"
  774. value: "zenoss.verustech.com"
  775. }
  776. details {
  777. name: "isManageIp"
  778. value: "True"
  779. }
  780. details {
  781. name: "zenoss.device.ip_address"
  782. value: "24.173.66.84"
  783. }
  784. first_seen_time: 1398785252570
  785. , with this routing key: zenoss.zenevent.status.ping
  786. 2014-04-29 10:27:37,378 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,378 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.zenevent.status.ping to exchange zenoss.zenevents.raw
  787. 2014-04-29 10:27:37,379 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,379 DEBUG zen.Events: =============== incoming event ===============
  788. 2014-04-29 10:27:37,380 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,380 DEBUG zen.queuepublisher: About to publish this event to the raw event queue:uuid: "cb562402-cfb2-11e3-b398-000c29d302ba"
  789. created_time: 1398785252571
  790. event_class: "/Status/Ping"
  791. actor {
  792. element_type_id: DEVICE
  793. element_identifier: "savpn.divconems.com"
  794. }
  795. summary: "savpn.divconems.com is DOWN!"
  796. severity: SEVERITY_CRITICAL
  797. event_key: ""
  798. event_group: "Ping"
  799. agent: "zenping"
  800. monitor: "localhost"
  801. details {
  802. name: "manager"
  803. value: "zenoss.verustech.com"
  804. }
  805. details {
  806. name: "isManageIp"
  807. value: "True"
  808. }
  809. details {
  810. name: "zenoss.device.ip_address"
  811. value: "24.153.129.182"
  812. }
  813. first_seen_time: 1398785252571
  814. , with this routing key: zenoss.zenevent.status.ping
  815. 2014-04-29 10:27:37,381 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,381 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.zenevent.status.ping to exchange zenoss.zenevents.raw
  816. 2014-04-29 10:27:37,382 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,381 DEBUG zen.Events: =============== incoming event ===============
  817. 2014-04-29 10:27:37,383 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,383 DEBUG zen.queuepublisher: About to publish this event to the raw event queue:uuid: "cb5695d6-cfb2-11e3-b398-000c29d302ba"
  818. created_time: 1398785252575
  819. event_class: "/Status/Ping"
  820. actor {
  821. element_type_id: DEVICE
  822. element_identifier: "bel.verustech.com"
  823. }
  824. summary: "bel.verustech.com is DOWN!"
  825. severity: SEVERITY_CRITICAL
  826. event_key: ""
  827. event_group: "Ping"
  828. agent: "zenping"
  829. monitor: "localhost"
  830. details {
  831. name: "manager"
  832. value: "zenoss.verustech.com"
  833. }
  834. details {
  835. name: "isManageIp"
  836. value: "True"
  837. }
  838. details {
  839. name: "zenoss.device.ip_address"
  840. value: "70.113.156.167"
  841. }
  842. first_seen_time: 1398785252575
  843. , with this routing key: zenoss.zenevent.status.ping
  844. 2014-04-29 10:27:37,384 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,384 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.zenevent.status.ping to exchange zenoss.zenevents.raw
  845. 2014-04-29 10:27:37,385 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,385 DEBUG zen.Events: =============== incoming event ===============
  846. 2014-04-29 10:27:37,386 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,386 DEBUG zen.queuepublisher: About to publish this event to the raw event queue:uuid: "cb571be6-cfb2-11e3-b398-000c29d302ba"
  847. created_time: 1398785252576
  848. event_class: "/Status/Ping"
  849. actor {
  850. element_type_id: DEVICE
  851. element_identifier: "192.168.203.2"
  852. }
  853. summary: "192.168.203.2 is DOWN!"
  854. severity: SEVERITY_CRITICAL
  855. event_key: ""
  856. event_group: "Ping"
  857. agent: "zenping"
  858. monitor: "localhost"
  859. details {
  860. name: "manager"
  861. value: "zenoss.verustech.com"
  862. }
  863. details {
  864. name: "isManageIp"
  865. value: "True"
  866. }
  867. details {
  868. name: "zenoss.device.ip_address"
  869. value: "192.168.203.2"
  870. }
  871. first_seen_time: 1398785252576
  872. , with this routing key: zenoss.zenevent.status.ping
  873. 2014-04-29 10:27:37,388 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,388 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.zenevent.status.ping to exchange zenoss.zenevents.raw
  874. 2014-04-29 10:27:37,391 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:37,390 DEBUG zen.zenhubworker: Time in sendEvents: 0.04
  875. 2014-04-29 10:27:37,391 DEBUG zen.ZenHub: worker 0, work localhost:Products.ZenHub.services.EventService.sendEvents finished in 0.046797990799
  876. 2014-04-29 10:27:47,553 DEBUG zen.ZenHub: worklist has 1 items
  877. 2014-04-29 10:27:47,553 DEBUG zen.ZenHub: get candidate workers for sendEvents...
  878. 2014-04-29 10:27:47,554 DEBUG zen.ZenHub: candidate workers are [0, 1]
  879. 2014-04-29 10:27:47,554 DEBUG zen.ZenHub: Giving sendEvents to worker 0, (localhost:Products.ZenHub.services.EventService.sendEvents)
  880. 2014-04-29 10:27:47,555 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:47,554 DEBUG zen.zenhubworker: Servicing sendEvents in Products.ZenHub.services.EventService
  881. 2014-04-29 10:27:47,556 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:47,556 DEBUG zen.zenhubworker: Synchronized with database
  882. 2014-04-29 10:27:47,558 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:47,558 DEBUG zen.zenhubworker: Synchronized with database
  883. 2014-04-29 10:27:47,558 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:47,558 DEBUG zen.Events: =============== incoming event ===============
  884. 2014-04-29 10:27:47,559 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:47,559 DEBUG zen.queuepublisher: About to publish this event to the raw event queue:uuid: "d1675dd4-cfb2-11e3-b398-000c29d302ba"
  885. created_time: 1398785266163
  886. event_class: "/Status/Snmp"
  887. actor {
  888. element_type_id: DEVICE
  889. element_identifier: "50.84.232.142"
  890. }
  891. summary: "SNMP agent down - no response received"
  892. severity: SEVERITY_ERROR
  893. event_key: "agent_down"
  894. event_group: "SnmpTest"
  895. agent: "zenperfsnmp"
  896. monitor: "localhost"
  897. details {
  898. name: "manager"
  899. value: "zenoss.verustech.com"
  900. }
  901. first_seen_time: 1398785266163
  902. , with this routing key: zenoss.zenevent.status.snmp
  903. 2014-04-29 10:27:47,562 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:47,561 DEBUG zen.zenoss.protocols.amqp: Connecting to RabbitMQ...
  904. 2014-04-29 10:27:47,562 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:47,562 DEBUG zen.protocols: Creating exchange: zenoss.zenevents.raw
  905. 2014-04-29 10:27:47,563 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:47,563 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.zenevent.status.snmp to exchange zenoss.zenevents.raw
  906. 2014-04-29 10:27:47,565 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:47,565 DEBUG zen.zenhubworker: Time in sendEvents: 0.01
  907. 2014-04-29 10:27:47,566 DEBUG zen.ZenHub: worker 0, work localhost:Products.ZenHub.services.EventService.sendEvents finished in 0.0121841430664
  908. 2014-04-29 10:27:53,834 DEBUG zen.ZenHub: worklist has 1 items
  909. 2014-04-29 10:27:53,834 DEBUG zen.ZenHub: get candidate workers for sendEvents...
  910. 2014-04-29 10:27:53,834 DEBUG zen.ZenHub: candidate workers are [0, 1]
  911. 2014-04-29 10:27:53,834 DEBUG zen.ZenHub: Giving sendEvents to worker 0, (localhost:Products.ZenHub.services.EventService.sendEvents)
  912. 2014-04-29 10:27:53,835 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:53,835 DEBUG zen.zenhubworker: Servicing sendEvents in Products.ZenHub.services.EventService
  913. 2014-04-29 10:27:53,837 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:53,836 DEBUG zen.zenhubworker: Synchronized with database
  914. 2014-04-29 10:27:53,838 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:53,838 DEBUG zen.zenhubworker: Synchronized with database
  915. 2014-04-29 10:27:53,838 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:53,838 DEBUG zen.Events: =============== incoming event ===============
  916. 2014-04-29 10:27:53,838 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:53,838 DEBUG zen.Events: Got a localhost zenmodeler heartbeat event (timeout 90 sec).
  917. 2014-04-29 10:27:53,839 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:53,839 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.heartbeat.localhost to exchange zenoss.heartbeats
  918. 2014-04-29 10:27:53,839 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:27:53,839 DEBUG zen.zenhubworker: Time in sendEvents: 0.00
  919. 2014-04-29 10:27:53,840 DEBUG zen.ZenHub: worker 0, work localhost:Products.ZenHub.services.EventService.sendEvents finished in 0.00548219680786
  920. 2014-04-29 10:27:57,525 DEBUG zen.ZenHub: [processQueue] syncing....
  921. 2014-04-29 10:27:57,527 DEBUG zen.ZenHub: Synchronized with database
  922. 2014-04-29 10:27:57,527 DEBUG zen.ZenHub: [processQueue] synced
  923. 2014-04-29 10:28:17,556 DEBUG zen.ZenHub: worklist has 1 items
  924. 2014-04-29 10:28:17,557 DEBUG zen.ZenHub: get candidate workers for sendEvents...
  925. 2014-04-29 10:28:17,557 DEBUG zen.ZenHub: candidate workers are [0, 1]
  926. 2014-04-29 10:28:17,557 DEBUG zen.ZenHub: Giving sendEvents to worker 0, (localhost:Products.ZenHub.services.EventService.sendEvents)
  927. 2014-04-29 10:28:17,559 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:17,557 DEBUG zen.zenhubworker: Servicing sendEvents in Products.ZenHub.services.EventService
  928. 2014-04-29 10:28:17,559 DEBUG zen.zenhubworker: Synchronized with database
  929. 2014-04-29 10:28:17,560 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:17,560 DEBUG zen.zenhubworker: Synchronized with database
  930. 2014-04-29 10:28:17,560 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:17,560 DEBUG zen.Events: =============== incoming event ===============
  931. 2014-04-29 10:28:17,561 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:17,561 DEBUG zen.queuepublisher: About to publish this event to the raw event queue:uuid: "e3495688-cfb2-11e3-b398-000c29d302ba"
  932. created_time: 1398785295168
  933. event_class: "/Status/Snmp"
  934. actor {
  935. element_type_id: DEVICE
  936. element_identifier: "cephas.verustech.com"
  937. }
  938. summary: "SNMP agent down - no response received"
  939. severity: SEVERITY_ERROR
  940. event_key: "agent_down"
  941. event_group: "SnmpTest"
  942. agent: "zenperfsnmp"
  943. monitor: "localhost"
  944. details {
  945. name: "manager"
  946. value: "zenoss.verustech.com"
  947. }
  948. first_seen_time: 1398785295168
  949. , with this routing key: zenoss.zenevent.status.snmp
  950. 2014-04-29 10:28:17,564 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:17,564 DEBUG zen.zenoss.protocols.amqp: Connecting to RabbitMQ...
  951. 2014-04-29 10:28:17,565 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:17,564 DEBUG zen.protocols: Creating exchange: zenoss.zenevents.raw
  952. 2014-04-29 10:28:17,565 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:17,565 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.zenevent.status.snmp to exchange zenoss.zenevents.raw
  953. 2014-04-29 10:28:17,568 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:17,568 DEBUG zen.zenhubworker: Time in sendEvents: 0.01
  954. 2014-04-29 10:28:17,568 DEBUG zen.ZenHub: worker 0, work localhost:Products.ZenHub.services.EventService.sendEvents finished in 0.0115900039673
  955. 2014-04-29 10:28:22,557 DEBUG zen.ZenHub: worklist has 1 items
  956. 2014-04-29 10:28:22,557 DEBUG zen.ZenHub: get candidate workers for sendEvents...
  957. 2014-04-29 10:28:22,558 DEBUG zen.ZenHub: candidate workers are [0, 1]
  958. 2014-04-29 10:28:22,558 DEBUG zen.ZenHub: Giving sendEvents to worker 0, (localhost:Products.ZenHub.services.EventService.sendEvents)
  959. 2014-04-29 10:28:22,559 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:22,558 DEBUG zen.zenhubworker: Servicing sendEvents in Products.ZenHub.services.EventService
  960. 2014-04-29 10:28:22,560 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:22,560 DEBUG zen.zenhubworker: Synchronized with database
  961. 2014-04-29 10:28:22,561 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:22,561 DEBUG zen.zenhubworker: Synchronized with database
  962. 2014-04-29 10:28:22,562 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:22,561 DEBUG zen.Events: =============== incoming event ===============
  963. 2014-04-29 10:28:22,562 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:22,562 DEBUG zen.queuepublisher: About to publish this event to the raw event queue:uuid: "e644798a-cfb2-11e3-b398-000c29d302ba"
  964. created_time: 1398785299170
  965. event_class: "/Status/Snmp"
  966. actor {
  967. element_type_id: DEVICE
  968. element_identifier: "hin.verustech.com"
  969. }
  970. summary: "SNMP agent down - no response received"
  971. severity: SEVERITY_ERROR
  972. event_key: "agent_down"
  973. event_group: "SnmpTest"
  974. agent: "zenperfsnmp"
  975. monitor: "localhost"
  976. details {
  977. name: "manager"
  978. value: "zenoss.verustech.com"
  979. }
  980. first_seen_time: 1398785299170
  981. , with this routing key: zenoss.zenevent.status.snmp
  982. 2014-04-29 10:28:22,565 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:22,565 DEBUG zen.zenoss.protocols.amqp: Connecting to RabbitMQ...
  983. 2014-04-29 10:28:22,566 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:22,566 DEBUG zen.protocols: Creating exchange: zenoss.zenevents.raw
  984. 2014-04-29 10:28:22,566 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:22,566 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.zenevent.status.snmp to exchange zenoss.zenevents.raw
  985. 2014-04-29 10:28:22,586 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:22,586 DEBUG zen.zenhubworker: Time in sendEvents: 0.03
  986. 2014-04-29 10:28:22,586 DEBUG zen.ZenHub: worker 0, work localhost:Products.ZenHub.services.EventService.sendEvents finished in 0.0287070274353
  987. 2014-04-29 10:28:23,837 DEBUG zen.ZenHub: worklist has 1 items
  988. 2014-04-29 10:28:23,837 DEBUG zen.ZenHub: get candidate workers for sendEvents...
  989. 2014-04-29 10:28:23,837 DEBUG zen.ZenHub: candidate workers are [0, 1]
  990. 2014-04-29 10:28:23,837 DEBUG zen.ZenHub: Giving sendEvents to worker 0, (localhost:Products.ZenHub.services.EventService.sendEvents)
  991. 2014-04-29 10:28:23,838 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:23,838 DEBUG zen.zenhubworker: Servicing sendEvents in Products.ZenHub.services.EventService
  992. 2014-04-29 10:28:23,840 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:23,840 DEBUG zen.zenhubworker: Synchronized with database
  993. 2014-04-29 10:28:23,841 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:23,841 DEBUG zen.zenhubworker: Synchronized with database
  994. 2014-04-29 10:28:23,841 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:23,841 DEBUG zen.Events: =============== incoming event ===============
  995. 2014-04-29 10:28:23,842 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:23,842 DEBUG zen.Events: Got a localhost zenmodeler heartbeat event (timeout 90 sec).
  996. 2014-04-29 10:28:23,842 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:23,842 DEBUG zen.zenoss.protocols.amqp: Publishing with routing key zenoss.heartbeat.localhost to exchange zenoss.heartbeats
  997. 2014-04-29 10:28:23,843 INFO zen.ZenHub: Worker (5878) reports 2014-04-29 10:28:23,843 DEBUG zen.zenhubworker: Time in sendEvents: 0.00
  998. 2014-04-29 10:28:23,844 DEBUG zen.ZenHub: worker 0, work localhost:Products.ZenHub.services.EventService.sendEvents finished in 0.00615406036377
  999. ^C2014-04-29 10:28:26,987 INFO zen.ZenHub: Worker (5877) reports 2014-04-29 10:28:26,985 DEBUG zen.collector.scheduler: In shutdown stage before
  1000. 2014-04-29 10:28:26,986 INFO zen.zenhubworker: Daemon zenhubworker shutting down
  1001. 2014-04-29 10:28:26,986 DEBUG zen.collector.scheduler: In shutdown stage during
  1002. 2014-04-29 10:28:26,986 DEBUG zen.collector.scheduler: In shutdown stage after
  1003. 2014-04-29 10:28:26,991 DEBUG zen.collector.scheduler: In shutdown stage before
  1004. 2014-04-29 10:28:26,992 INFO zen.ZenHub: Daemon ZenHub shutting down
  1005. 2014-04-29 10:28:26,992 DEBUG zen.hub: removing listener for localhost:EventService
  1006. 2014-04-29 10:28:26,993 DEBUG zen.hub: removing listener for localhost:SnmpTrapConfig
  1007. 2014-04-29 10:28:26,993 DEBUG zen.hub: removing listener for localhost:EventService
  1008. 2014-04-29 10:28:26,994 DEBUG zen.hub: removing listener for localhost:SyslogConfig
  1009. 2014-04-29 10:28:26,999 DEBUG zen.hub: removing listener for localhost:EventService
  1010. 2014-04-29 10:28:26,999 DEBUG zen.hub: removing listener for localhost:WinPerfConfig
  1011. 2014-04-29 10:28:27,000 DEBUG zen.hub: removing listener for localhost:EventService
  1012. 2014-04-29 10:28:27,000 DEBUG zen.hub: removing listener for localhost:SnmpPerformanceConfig
  1013. 2014-04-29 10:28:27,001 DEBUG zen.hub: removing listener for localhost:EventService
  1014. 2014-04-29 10:28:27,001 DEBUG zen.hub: removing listener for localhost:ZenStatusConfig
  1015. 2014-04-29 10:28:27,002 DEBUG zen.hub: removing listener for localhost:EventService
  1016. 2014-04-29 10:28:27,002 DEBUG zen.hub: removing listener for localhost:WinServiceConfig
  1017. 2014-04-29 10:28:27,002 DEBUG zen.hub: removing listener for localhost:EventService
  1018. 2014-04-29 10:28:27,003 DEBUG zen.hub: removing listener for localhost:EventLogConfig
  1019. 2014-04-29 10:28:27,003 DEBUG zen.hub: removing listener for localhost:EventService
  1020. 2014-04-29 10:28:27,003 DEBUG zen.hub: removing listener for localhost:CommandPerformanceConfig
  1021. 2014-04-29 10:28:27,004 DEBUG zen.hub: removing listener for localhost:EventService
  1022. 2014-04-29 10:28:27,005 DEBUG zen.hub: removing listener for localhost:PingPerformanceConfig
  1023. 2014-04-29 10:28:27,005 DEBUG zen.hub: removing listener for localhost:EventService
  1024. 2014-04-29 10:28:27,005 DEBUG zen.hub: removing listener for localhost:ModelerService
  1025. 2014-04-29 10:28:27,006 DEBUG zen.hub: removing listener for localhost:EventService
  1026. 2014-04-29 10:28:27,006 DEBUG zen.hub: removing listener for localhost:ProcessConfig
  1027. 2014-04-29 10:28:27,007 DEBUG zen.hub: removing listener for localhost:EventService
  1028. 2014-04-29 10:28:27,007 DEBUG zen.hub: removing listener for localhost:ZenJMXConfigService
  1029. 2014-04-29 10:28:27,008 DEBUG zen.collector.scheduler: In shutdown stage during
  1030. 2014-04-29 10:28:27,008 DEBUG zen.collector.scheduler: In shutdown stage after
  1031. 2014-04-29 10:28:27,008 DEBUG zen.ZenHub: Killing workers
  1032. 2014-04-29 10:28:27,008 DEBUG zen.ZenHub: Killed worker <Process pid=5877 status=-1>
  1033. 2014-04-29 10:28:27,008 DEBUG zen.ZenHub: Killed worker <Process pid=5878 status=-1>
  1034. zenoss@zenoss:~$
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!