API tools faq
paste
Advertisement
garethhowell

minion

garethhowell
Aug 4th, 2020
72
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 3.00 MB | None | 0 0
raw download clone embed print report
  1. 2020-06-05 07:50:36,095 [gpio_spi_conn :42 ][WARNING ][669] Unable to clear buffer - got unexpected value: 255
  2. 2020-06-05 07:50:36,102 [gpio_spi_conn :42 ][WARNING ][669] Unable to clear buffer - got unexpected value: 255
  3. 2020-06-05 07:50:36,117 [gpio_spi_conn :42 ][WARNING ][669] Unable to clear buffer - got unexpected value: 255
  4. 2020-06-05 07:50:36,732 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  5. Traceback (most recent call last):
  6. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7. self._serial.open()
  8. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11. 2020-06-05 07:50:37,744 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  12. Traceback (most recent call last):
  13. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14. self._serial.open()
  15. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18. 2020-06-05 07:50:38,144 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  19. 2020-06-05 07:50:38,647 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  20. 2020-06-05 07:50:38,748 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  21. Traceback (most recent call last):
  22. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23. self._serial.open()
  24. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27. 2020-06-05 07:50:39,149 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  28. 2020-06-05 07:50:39,151 [spm_conn :139 ][WARNING ][669] Unable to get status: Expected ack '12' but got '255'
  29. 2020-06-05 07:50:39,284 [messaging :208 ][ERROR ][666] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  30. Traceback (most recent call last):
  31. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  32. self._call_hook_for(message, "workflow", message)
  33. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34. return True, func(*args, **kwargs)
  35. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  36. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38. return True, func(*args, **kwargs)
  39. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40. return func(*args, **kwargs)
  41. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  42. res = _exec("AT+CCLK?")
  43. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  44. conn.write_line(cmd)
  45. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  46. self.ensure_open()
  47. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  48. self.open()
  49. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  50. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  51. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  52. raise attempt.get()
  53. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  54. six.reraise(self.value[0], self.value[1], self.value[2])
  55. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  56. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  57. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  58. self._serial.open()
  59. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  60. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  61. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  62. 2020-06-05 07:50:39,661 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  63. 2020-06-05 07:50:40,164 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  64. 2020-06-05 07:50:40,667 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  65. 2020-06-05 07:50:40,669 [spm_conn :139 ][WARNING ][669] Unable to get status: Expected ack '12' but got '255'
  66. 2020-06-05 07:50:41,173 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  67. 2020-06-05 07:50:41,686 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  68. 2020-06-05 07:50:42,189 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  69. 2020-06-05 07:50:42,192 [spm_conn :139 ][WARNING ][669] Unable to get status: Expected ack '12' but got '255'
  70. 2020-06-05 07:50:42,195 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  71. 2020-06-05 07:50:42,698 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  72. 2020-06-05 07:50:43,174 [salt.utils :831 ][ERROR ][545] DNS lookup or connection check of 'hub' failed.
  73. 2020-06-05 07:50:43,179 [salt.minion :178 ][ERROR ][545] Master hostname: 'hub' not found or not responsive. Retrying in 30 seconds
  74. 2020-06-05 07:50:43,206 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  75. 2020-06-05 07:50:43,208 [spm_conn :82 ][WARNING ][669] Unable to send noop: Expected ack '12' but got '255'
  76. 2020-06-05 07:50:43,712 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  77. 2020-06-05 07:50:44,215 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  78. 2020-06-05 07:50:44,718 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  79. 2020-06-05 07:50:44,720 [spm_conn :82 ][WARNING ][669] Unable to send noop: Expected ack '12' but got '255'
  80. 2020-06-05 07:50:44,781 [cloud_cache :432 ][WARNING ][708] Temporarily unable to upload batch with 2 entries from queue 'pend': HTTPSConnectionPool(host='api.autopi.io', port=443): Max retries exceeded with url: /logbook/storage (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x73585a50>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))
  81. 2020-06-05 07:50:44,869 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  82. Traceback (most recent call last):
  83. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  84. self._serial.open()
  85. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  86. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  87. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  88. 2020-06-05 07:50:45,223 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  89. 2020-06-05 07:50:45,726 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  90. 2020-06-05 07:50:45,873 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  91. Traceback (most recent call last):
  92. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  93. self._serial.open()
  94. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  95. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  96. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  97. 2020-06-05 07:50:46,229 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  98. 2020-06-05 07:50:46,239 [spm_conn :82 ][WARNING ][669] Unable to send noop: Expected ack '12' but got '255'
  99. 2020-06-05 07:50:46,242 [messaging :208 ][ERROR ][669] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  100. Traceback (most recent call last):
  101. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  102. self._call_hook_for(message, "workflow", message)
  103. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  104. return True, func(*args, **kwargs)
  105. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  106. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  107. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  108. return True, func(*args, **kwargs)
  109. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  110. return func(*args, **kwargs)
  111. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  112. conn.heartbeat()
  113. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  114. self.noop()
  115. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  116. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  117. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  118. raise attempt.get()
  119. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  120. six.reraise(self.value[0], self.value[1], self.value[2])
  121. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  122. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  123. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  124. self._begin_message()
  125. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  126. self.recv(ack=ACK_MESSAGE_BEGIN)
  127. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  128. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  129. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  130. raise attempt.get()
  131. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  132. six.reraise(self.value[0], self.value[1], self.value[2])
  133. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  134. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  135. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  136. raise Exception(msg)
  137. Exception: Expected ack '12' but got '255'
  138. 2020-06-05 07:50:46,878 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  139. Traceback (most recent call last):
  140. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  141. self._serial.open()
  142. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  143. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  144. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  145. 2020-06-05 07:50:47,363 [messaging :206 ][ERROR ][666] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  146. Traceback (most recent call last):
  147. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  148. self._call_hook_for(message, "workflow", message)
  149. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  150. return True, func(*args, **kwargs)
  151. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  152. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  153. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  154. return True, func(*args, **kwargs)
  155. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  156. return func(*args, **kwargs)
  157. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  158. res = _exec("AT+CCLK?")
  159. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  160. conn.write_line(cmd)
  161. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  162. self.ensure_open()
  163. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  164. self.open()
  165. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  166. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  167. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  168. raise attempt.get()
  169. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  170. six.reraise(self.value[0], self.value[1], self.value[2])
  171. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  172. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  173. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  174. self._serial.open()
  175. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  176. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  177. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  178. 2020-06-05 07:50:52,922 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  179. Traceback (most recent call last):
  180. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  181. self._serial.open()
  182. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  183. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  184. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  185. 2020-06-05 07:50:53,927 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  186. Traceback (most recent call last):
  187. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  188. self._serial.open()
  189. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  190. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  191. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  192. 2020-06-05 07:50:54,931 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  193. Traceback (most recent call last):
  194. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  195. self._serial.open()
  196. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  197. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  198. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  199. 2020-06-05 07:50:55,467 [messaging :206 ][ERROR ][666] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  200. Traceback (most recent call last):
  201. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  202. self._call_hook_for(message, "workflow", message)
  203. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  204. return True, func(*args, **kwargs)
  205. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  206. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  207. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  208. return True, func(*args, **kwargs)
  209. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  210. return func(*args, **kwargs)
  211. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  212. res = _exec("AT+CCLK?")
  213. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  214. conn.write_line(cmd)
  215. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  216. self.ensure_open()
  217. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  218. self.open()
  219. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  220. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  221. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  222. raise attempt.get()
  223. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  224. six.reraise(self.value[0], self.value[1], self.value[2])
  225. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  226. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  227. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  228. self._serial.open()
  229. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  230. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  231. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  232. 2020-06-05 07:51:01,039 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  233. Traceback (most recent call last):
  234. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  235. self._serial.open()
  236. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  237. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  238. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  239. 2020-06-05 07:51:02,043 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  240. Traceback (most recent call last):
  241. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  242. self._serial.open()
  243. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  244. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  245. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  246. 2020-06-05 07:51:03,047 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  247. Traceback (most recent call last):
  248. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  249. self._serial.open()
  250. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  251. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  252. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  253. 2020-06-05 07:51:06,212 [messaging :871 ][WARNING ][667] No reply message with tag 'ec2x/res/c1d3d7c0-661e-4251-aa48-d5c1f3b5eeef' received within timeout of 30 secs
  254. 2020-06-05 07:51:06,223 [messaging :208 ][ERROR ][667] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  255. Traceback (most recent call last):
  256. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  257. self._call_hook_for(message, "workflow", message)
  258. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  259. return True, func(*args, **kwargs)
  260. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  261. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  262. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  263. return True, func(*args, **kwargs)
  264. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  265. return func(*args, **kwargs)
  266. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  267. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  268. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  269. res = query("AT+QGPSLOC={:d}".format(mode))
  270. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  271. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  272. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  273. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  274. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 874, in _recv_reply
  275. "No reply message received within timeout of {:d} secs - please try again and maybe increase timeout value".format(timeout))
  276. CommandExecutionError: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  277. 2020-06-05 07:51:09,084 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  278. Traceback (most recent call last):
  279. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  280. self._serial.open()
  281. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  282. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  283. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  284. 2020-06-05 07:51:10,089 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  285. Traceback (most recent call last):
  286. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  287. self._serial.open()
  288. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  289. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  290. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  291. 2020-06-05 07:51:11,102 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  292. Traceback (most recent call last):
  293. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  294. self._serial.open()
  295. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  296. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  297. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  298. 2020-06-05 07:51:13,206 [salt.utils :831 ][ERROR ][545] DNS lookup or connection check of 'hub' failed.
  299. 2020-06-05 07:51:13,209 [salt.minion :178 ][ERROR ][545] Master hostname: 'hub' not found or not responsive. Retrying in 30 seconds
  300. 2020-06-05 07:51:17,180 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  301. Traceback (most recent call last):
  302. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  303. self._serial.open()
  304. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  305. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  306. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  307. 2020-06-05 07:51:18,185 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  308. Traceback (most recent call last):
  309. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  310. self._serial.open()
  311. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  312. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  313. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  314. 2020-06-05 07:51:19,199 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  315. Traceback (most recent call last):
  316. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  317. self._serial.open()
  318. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  319. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  320. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  321. 2020-06-05 07:51:25,321 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  322. Traceback (most recent call last):
  323. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  324. self._serial.open()
  325. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  326. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  327. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  328. 2020-06-05 07:51:26,326 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  329. Traceback (most recent call last):
  330. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  331. self._serial.open()
  332. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  333. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  334. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  335. 2020-06-05 07:51:27,349 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  336. Traceback (most recent call last):
  337. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  338. self._serial.open()
  339. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  340. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  341. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  342. 2020-06-05 07:51:33,453 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  343. Traceback (most recent call last):
  344. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  345. self._serial.open()
  346. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  347. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  348. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  349. 2020-06-05 07:51:34,458 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  350. Traceback (most recent call last):
  351. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  352. self._serial.open()
  353. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  354. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  355. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  356. 2020-06-05 07:51:35,461 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  357. Traceback (most recent call last):
  358. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  359. self._serial.open()
  360. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  361. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  362. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  363. 2020-06-05 07:51:41,280 [messaging :871 ][WARNING ][667] No reply message with tag 'ec2x/res/b9c70ade-faa6-49df-ac63-9add716abd13' received within timeout of 30 secs
  364. 2020-06-05 07:51:41,286 [messaging :206 ][ERROR ][667] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  365. Traceback (most recent call last):
  366. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  367. self._call_hook_for(message, "workflow", message)
  368. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  369. return True, func(*args, **kwargs)
  370. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  371. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  372. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  373. return True, func(*args, **kwargs)
  374. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  375. return func(*args, **kwargs)
  376. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  377. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  378. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  379. res = query("AT+QGPSLOC={:d}".format(mode))
  380. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  381. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  382. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  383. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  384. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 874, in _recv_reply
  385. "No reply message received within timeout of {:d} secs - please try again and maybe increase timeout value".format(timeout))
  386. CommandExecutionError: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  387. 2020-06-05 07:51:41,521 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  388. Traceback (most recent call last):
  389. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  390. self._serial.open()
  391. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  392. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  393. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  394. 2020-06-05 07:51:42,528 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  395. Traceback (most recent call last):
  396. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  397. self._serial.open()
  398. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  399. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  400. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  401. 2020-06-05 07:51:43,244 [salt.utils :831 ][ERROR ][545] DNS lookup or connection check of 'hub' failed.
  402. 2020-06-05 07:51:43,246 [salt.minion :178 ][ERROR ][545] Master hostname: 'hub' not found or not responsive. Retrying in 30 seconds
  403. 2020-06-05 07:51:43,532 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  404. Traceback (most recent call last):
  405. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  406. self._serial.open()
  407. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  408. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  409. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  410. 2020-06-05 07:51:44,800 [cloud_cache :432 ][WARNING ][708] Temporarily unable to upload batch with 2 entries from queue 'pend': HTTPSConnectionPool(host='api.autopi.io', port=443): Max retries exceeded with url: /logbook/storage (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x74381790>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))
  411. 2020-06-05 07:51:46,254 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  412. 2020-06-05 07:51:46,757 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  413. 2020-06-05 07:51:47,260 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  414. 2020-06-05 07:51:47,263 [spm_conn :139 ][WARNING ][669] Unable to get status: Expected ack '12' but got '255'
  415. 2020-06-05 07:51:47,767 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  416. 2020-06-05 07:51:48,270 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  417. 2020-06-05 07:51:48,773 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  418. 2020-06-05 07:51:48,776 [spm_conn :139 ][WARNING ][669] Unable to get status: Expected ack '12' but got '255'
  419. 2020-06-05 07:51:49,280 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  420. 2020-06-05 07:51:49,713 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  421. Traceback (most recent call last):
  422. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  423. self._serial.open()
  424. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  425. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  426. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  427. 2020-06-05 07:51:49,783 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  428. 2020-06-05 07:51:50,286 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  429. 2020-06-05 07:51:50,289 [spm_conn :139 ][WARNING ][669] Unable to get status: Expected ack '12' but got '255'
  430. 2020-06-05 07:51:50,292 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  431. 2020-06-05 07:51:50,718 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  432. Traceback (most recent call last):
  433. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  434. self._serial.open()
  435. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  436. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  437. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  438. 2020-06-05 07:51:50,796 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  439. 2020-06-05 07:51:51,299 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  440. 2020-06-05 07:51:51,308 [spm_conn :82 ][WARNING ][669] Unable to send noop: Expected ack '12' but got '255'
  441. 2020-06-05 07:51:51,722 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  442. Traceback (most recent call last):
  443. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  444. self._serial.open()
  445. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  446. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  447. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  448. 2020-06-05 07:51:51,812 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  449. 2020-06-05 07:51:52,316 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  450. 2020-06-05 07:51:52,819 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  451. 2020-06-05 07:51:52,821 [spm_conn :82 ][WARNING ][669] Unable to send noop: Expected ack '12' but got '255'
  452. 2020-06-05 07:51:53,324 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  453. 2020-06-05 07:51:53,827 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  454. 2020-06-05 07:51:54,330 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  455. 2020-06-05 07:51:54,332 [spm_conn :82 ][WARNING ][669] Unable to send noop: Expected ack '12' but got '255'
  456. 2020-06-05 07:51:54,334 [messaging :206 ][ERROR ][669] Recurring exception (2 times) in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  457. Traceback (most recent call last):
  458. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  459. self._call_hook_for(message, "workflow", message)
  460. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  461. return True, func(*args, **kwargs)
  462. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  463. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  464. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  465. return True, func(*args, **kwargs)
  466. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  467. return func(*args, **kwargs)
  468. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  469. conn.heartbeat()
  470. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  471. self.noop()
  472. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  473. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  474. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  475. raise attempt.get()
  476. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  477. six.reraise(self.value[0], self.value[1], self.value[2])
  478. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  479. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  480. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  481. self._begin_message()
  482. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  483. self.recv(ack=ACK_MESSAGE_BEGIN)
  484. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  485. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  486. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  487. raise attempt.get()
  488. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  489. six.reraise(self.value[0], self.value[1], self.value[2])
  490. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  491. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  492. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  493. raise Exception(msg)
  494. Exception: Expected ack '12' but got '255'
  495. 2020-06-05 07:51:57,801 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  496. Traceback (most recent call last):
  497. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  498. self._serial.open()
  499. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  500. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  501. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  502. 2020-06-05 07:51:58,806 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  503. Traceback (most recent call last):
  504. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  505. self._serial.open()
  506. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  507. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  508. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  509. 2020-06-05 07:51:59,810 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  510. Traceback (most recent call last):
  511. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  512. self._serial.open()
  513. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  514. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  515. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  516. 2020-06-05 07:52:00,335 [messaging :206 ][ERROR ][666] Recurring exception (11 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  517. Traceback (most recent call last):
  518. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  519. self._call_hook_for(message, "workflow", message)
  520. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  521. return True, func(*args, **kwargs)
  522. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  523. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  524. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  525. return True, func(*args, **kwargs)
  526. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  527. return func(*args, **kwargs)
  528. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  529. res = _exec("AT+CCLK?")
  530. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  531. conn.write_line(cmd)
  532. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  533. self.ensure_open()
  534. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  535. self.open()
  536. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  537. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  538. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  539. raise attempt.get()
  540. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  541. six.reraise(self.value[0], self.value[1], self.value[2])
  542. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  543. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  544. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  545. self._serial.open()
  546. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  547. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  548. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  549. 2020-06-05 07:52:05,911 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  550. Traceback (most recent call last):
  551. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  552. self._serial.open()
  553. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  554. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  555. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  556. 2020-06-05 07:52:06,919 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  557. Traceback (most recent call last):
  558. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  559. self._serial.open()
  560. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  561. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  562. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  563. 2020-06-05 07:52:07,923 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  564. Traceback (most recent call last):
  565. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  566. self._serial.open()
  567. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  568. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  569. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  570. 2020-06-05 07:52:13,281 [salt.utils :831 ][ERROR ][545] DNS lookup or connection check of 'hub' failed.
  571. 2020-06-05 07:52:13,283 [salt.minion :178 ][ERROR ][545] Master hostname: 'hub' not found or not responsive. Retrying in 30 seconds
  572. 2020-06-05 07:52:14,040 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  573. Traceback (most recent call last):
  574. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  575. self._serial.open()
  576. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  577. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  578. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  579. 2020-06-05 07:52:15,045 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  580. Traceback (most recent call last):
  581. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  582. self._serial.open()
  583. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  584. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  585. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  586. 2020-06-05 07:52:16,049 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  587. Traceback (most recent call last):
  588. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  589. self._serial.open()
  590. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  591. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  592. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  593. 2020-06-05 07:52:16,337 [messaging :871 ][WARNING ][667] No reply message with tag 'ec2x/res/19400cdc-87ae-4b16-9d48-d1a0343b9719' received within timeout of 30 secs
  594. 2020-06-05 07:52:16,341 [messaging :206 ][ERROR ][667] Recurring exception (3 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  595. Traceback (most recent call last):
  596. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  597. self._call_hook_for(message, "workflow", message)
  598. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  599. return True, func(*args, **kwargs)
  600. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  601. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  602. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  603. return True, func(*args, **kwargs)
  604. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  605. return func(*args, **kwargs)
  606. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  607. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  608. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  609. res = query("AT+QGPSLOC={:d}".format(mode))
  610. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  611. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  612. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  613. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  614. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 874, in _recv_reply
  615. "No reply message received within timeout of {:d} secs - please try again and maybe increase timeout value".format(timeout))
  616. CommandExecutionError: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  617. 2020-06-05 07:52:22,132 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  618. Traceback (most recent call last):
  619. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  620. self._serial.open()
  621. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  622. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  623. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  624. 2020-06-05 07:52:23,137 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  625. Traceback (most recent call last):
  626. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  627. self._serial.open()
  628. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  629. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  630. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  631. 2020-06-05 07:52:24,141 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  632. Traceback (most recent call last):
  633. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  634. self._serial.open()
  635. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  636. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  637. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  638. 2020-06-05 07:52:30,233 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  639. Traceback (most recent call last):
  640. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  641. self._serial.open()
  642. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  643. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  644. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  645. 2020-06-05 07:52:31,238 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  646. Traceback (most recent call last):
  647. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  648. self._serial.open()
  649. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  650. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  651. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  652. 2020-06-05 07:52:32,242 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  653. Traceback (most recent call last):
  654. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  655. self._serial.open()
  656. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  657. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  658. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  659. 2020-06-05 07:52:38,446 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  660. Traceback (most recent call last):
  661. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  662. self._serial.open()
  663. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  664. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  665. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  666. 2020-06-05 07:52:39,453 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  667. Traceback (most recent call last):
  668. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  669. self._serial.open()
  670. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  671. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  672. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  673. 2020-06-05 07:52:40,458 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  674. Traceback (most recent call last):
  675. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  676. self._serial.open()
  677. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  678. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  679. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  680. 2020-06-05 07:52:43,288 [salt.utils :831 ][ERROR ][545] DNS lookup or connection check of 'hub' failed.
  681. 2020-06-05 07:52:43,290 [salt.minion :178 ][ERROR ][545] Master hostname: 'hub' not found or not responsive. Retrying in 30 seconds
  682. 2020-06-05 07:52:44,822 [cloud_cache :432 ][WARNING ][708] Temporarily unable to upload batch with 2 entries from queue 'pend': HTTPSConnectionPool(host='api.autopi.io', port=443): Max retries exceeded with url: /logbook/storage (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x7354a8d0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))
  683. 2020-06-05 07:52:46,544 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  684. Traceback (most recent call last):
  685. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  686. self._serial.open()
  687. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  688. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  689. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  690. 2020-06-05 07:52:47,549 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  691. Traceback (most recent call last):
  692. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  693. self._serial.open()
  694. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  695. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  696. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  697. 2020-06-05 07:52:48,553 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  698. Traceback (most recent call last):
  699. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  700. self._serial.open()
  701. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  702. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  703. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  704. 2020-06-05 07:52:51,387 [messaging :871 ][WARNING ][667] No reply message with tag 'ec2x/res/2298dbe6-496d-4164-b7b8-c5c9fcadc551' received within timeout of 30 secs
  705. 2020-06-05 07:52:54,341 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  706. 2020-06-05 07:52:54,703 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  707. Traceback (most recent call last):
  708. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  709. self._serial.open()
  710. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  711. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  712. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  713. 2020-06-05 07:52:54,844 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  714. 2020-06-05 07:52:55,346 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  715. 2020-06-05 07:52:55,348 [spm_conn :139 ][WARNING ][669] Unable to get status: Expected ack '12' but got '255'
  716. 2020-06-05 07:52:55,710 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  717. Traceback (most recent call last):
  718. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  719. self._serial.open()
  720. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  721. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  722. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  723. 2020-06-05 07:52:55,852 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  724. 2020-06-05 07:52:56,354 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  725. 2020-06-05 07:52:56,714 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  726. Traceback (most recent call last):
  727. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  728. self._serial.open()
  729. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  730. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  731. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  732. 2020-06-05 07:52:56,857 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  733. 2020-06-05 07:52:56,859 [spm_conn :139 ][WARNING ][669] Unable to get status: Expected ack '12' but got '255'
  734. 2020-06-05 07:52:57,363 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  735. 2020-06-05 07:52:57,865 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  736. 2020-06-05 07:52:58,368 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  737. 2020-06-05 07:52:58,370 [spm_conn :139 ][WARNING ][669] Unable to get status: Expected ack '12' but got '255'
  738. 2020-06-05 07:52:58,373 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  739. 2020-06-05 07:52:58,876 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  740. 2020-06-05 07:52:59,379 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  741. 2020-06-05 07:52:59,381 [spm_conn :82 ][WARNING ][669] Unable to send noop: Expected ack '12' but got '255'
  742. 2020-06-05 07:52:59,890 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  743. 2020-06-05 07:53:00,393 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  744. 2020-06-05 07:53:00,896 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  745. 2020-06-05 07:53:00,898 [spm_conn :82 ][WARNING ][669] Unable to send noop: Expected ack '12' but got '255'
  746. 2020-06-05 07:53:01,402 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  747. 2020-06-05 07:53:01,904 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  748. 2020-06-05 07:53:02,407 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  749. 2020-06-05 07:53:02,409 [spm_conn :82 ][WARNING ][669] Unable to send noop: Expected ack '12' but got '255'
  750. 2020-06-05 07:53:02,412 [messaging :206 ][ERROR ][669] Recurring exception (3 times) in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  751. Traceback (most recent call last):
  752. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  753. self._call_hook_for(message, "workflow", message)
  754. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  755. return True, func(*args, **kwargs)
  756. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  757. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  758. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  759. return True, func(*args, **kwargs)
  760. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  761. return func(*args, **kwargs)
  762. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  763. conn.heartbeat()
  764. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  765. self.noop()
  766. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  767. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  768. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  769. raise attempt.get()
  770. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  771. six.reraise(self.value[0], self.value[1], self.value[2])
  772. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  773. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  774. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  775. self._begin_message()
  776. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  777. self.recv(ack=ACK_MESSAGE_BEGIN)
  778. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  779. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  780. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  781. raise attempt.get()
  782. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  783. six.reraise(self.value[0], self.value[1], self.value[2])
  784. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  785. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  786. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  787. raise Exception(msg)
  788. Exception: Expected ack '12' but got '255'
  789. 2020-06-05 07:53:02,959 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  790. Traceback (most recent call last):
  791. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  792. self._serial.open()
  793. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  794. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  795. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  796. 2020-06-05 07:53:03,964 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  797. Traceback (most recent call last):
  798. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  799. self._serial.open()
  800. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  801. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  802. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  803. 2020-06-05 07:53:04,969 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  804. Traceback (most recent call last):
  805. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  806. self._serial.open()
  807. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  808. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  809. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  810. 2020-06-05 07:53:05,501 [messaging :206 ][ERROR ][666] Recurring exception (19 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  811. Traceback (most recent call last):
  812. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  813. self._call_hook_for(message, "workflow", message)
  814. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  815. return True, func(*args, **kwargs)
  816. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  817. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  818. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  819. return True, func(*args, **kwargs)
  820. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  821. return func(*args, **kwargs)
  822. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  823. res = _exec("AT+CCLK?")
  824. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  825. conn.write_line(cmd)
  826. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  827. self.ensure_open()
  828. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  829. self.open()
  830. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  831. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  832. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  833. raise attempt.get()
  834. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  835. six.reraise(self.value[0], self.value[1], self.value[2])
  836. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  837. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  838. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  839. self._serial.open()
  840. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  841. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  842. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  843. 2020-06-05 07:53:11,083 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  844. Traceback (most recent call last):
  845. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  846. self._serial.open()
  847. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  848. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  849. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  850. 2020-06-05 07:53:12,087 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  851. Traceback (most recent call last):
  852. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  853. self._serial.open()
  854. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  855. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  856. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  857. 2020-06-05 07:53:13,091 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  858. Traceback (most recent call last):
  859. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  860. self._serial.open()
  861. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  862. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  863. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  864. 2020-06-05 07:53:13,319 [salt.utils :831 ][ERROR ][545] DNS lookup or connection check of 'hub' failed.
  865. 2020-06-05 07:53:13,321 [salt.minion :178 ][ERROR ][545] Master hostname: 'hub' not found or not responsive. Retrying in 30 seconds
  866. 2020-06-05 07:53:17,374 [salt.utils.schedule:927 ][ERROR ][771] Unhandled exception running minionutil.status_schedule
  867. Traceback (most recent call last):
  868. File "/usr/lib/python2.7/dist-packages/salt/utils/schedule.py", line 894, in handle_func
  869. ret['return'] = self.functions[func](*args, **kwargs)
  870. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  871. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  872. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  873. raise attempt.get()
  874. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  875. six.reraise(self.value[0], self.value[1], self.value[2])
  876. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  877. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  878. File "/var/cache/salt/minion/extmods/modules/minionutil.py", line 385, in status_schedule
  879. raise salt.exceptions.CommandExecutionError("No enabled schedule found by name '{:}'".format(name))
  880. CommandExecutionError: No enabled schedule found by name '_minion_status'
  881. 2020-06-05 07:53:19,173 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  882. Traceback (most recent call last):
  883. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  884. self._serial.open()
  885. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  886. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  887. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  888. 2020-06-05 07:53:20,179 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  889. Traceback (most recent call last):
  890. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  891. self._serial.open()
  892. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  893. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  894. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  895. 2020-06-05 07:53:21,184 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  896. Traceback (most recent call last):
  897. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  898. self._serial.open()
  899. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  900. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  901. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  902. 2020-06-05 07:53:26,427 [messaging :871 ][WARNING ][667] No reply message with tag 'ec2x/res/a31ee515-2846-4c5e-9d4e-268a0f9ff5e5' received within timeout of 30 secs
  903. 2020-06-05 07:53:26,431 [messaging :206 ][ERROR ][667] Recurring exception (5 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  904. Traceback (most recent call last):
  905. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  906. self._call_hook_for(message, "workflow", message)
  907. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  908. return True, func(*args, **kwargs)
  909. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  910. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  911. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  912. return True, func(*args, **kwargs)
  913. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  914. return func(*args, **kwargs)
  915. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  916. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  917. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  918. res = query("AT+QGPSLOC={:d}".format(mode))
  919. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  920. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  921. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  922. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  923. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 874, in _recv_reply
  924. "No reply message received within timeout of {:d} secs - please try again and maybe increase timeout value".format(timeout))
  925. CommandExecutionError: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  926. 2020-06-05 07:53:27,274 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  927. Traceback (most recent call last):
  928. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  929. self._serial.open()
  930. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  931. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  932. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  933. 2020-06-05 07:53:28,279 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  934. Traceback (most recent call last):
  935. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  936. self._serial.open()
  937. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  938. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  939. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  940. 2020-06-05 07:53:29,283 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  941. Traceback (most recent call last):
  942. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  943. self._serial.open()
  944. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  945. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  946. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  947. 2020-06-05 07:53:35,384 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  948. Traceback (most recent call last):
  949. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  950. self._serial.open()
  951. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  952. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  953. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  954. 2020-06-05 07:53:36,390 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  955. Traceback (most recent call last):
  956. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  957. self._serial.open()
  958. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  959. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  960. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  961. 2020-06-05 07:53:37,394 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  962. Traceback (most recent call last):
  963. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  964. self._serial.open()
  965. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  966. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  967. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  968. 2020-06-05 07:53:43,349 [salt.utils :831 ][ERROR ][545] DNS lookup or connection check of 'hub' failed.
  969. 2020-06-05 07:53:43,351 [salt.minion :178 ][ERROR ][545] Master hostname: 'hub' not found or not responsive. Retrying in 30 seconds
  970. 2020-06-05 07:53:43,532 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  971. Traceback (most recent call last):
  972. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  973. self._serial.open()
  974. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  975. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  976. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  977. 2020-06-05 07:53:44,536 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  978. Traceback (most recent call last):
  979. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  980. self._serial.open()
  981. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  982. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  983. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  984. 2020-06-05 07:53:44,844 [cloud_cache :432 ][WARNING ][708] Temporarily unable to upload batch with 2 entries from queue 'pend': HTTPSConnectionPool(host='api.autopi.io', port=443): Max retries exceeded with url: /logbook/storage (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x735b2af0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))
  985. 2020-06-05 07:53:45,549 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  986. Traceback (most recent call last):
  987. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  988. self._serial.open()
  989. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  990. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  991. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  992. 2020-06-05 07:53:51,662 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  993. Traceback (most recent call last):
  994. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  995. self._serial.open()
  996. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  997. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  998. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  999. 2020-06-05 07:53:52,669 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1000. Traceback (most recent call last):
  1001. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1002. self._serial.open()
  1003. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1004. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1005. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1006. 2020-06-05 07:53:53,673 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1007. Traceback (most recent call last):
  1008. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1009. self._serial.open()
  1010. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1011. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1012. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1013. 2020-06-05 07:53:59,767 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1014. Traceback (most recent call last):
  1015. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1016. self._serial.open()
  1017. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1018. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1019. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1020. 2020-06-05 07:54:00,772 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1021. Traceback (most recent call last):
  1022. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1023. self._serial.open()
  1024. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1025. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1026. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1027. 2020-06-05 07:54:01,477 [messaging :871 ][WARNING ][667] No reply message with tag 'ec2x/res/4552305b-b8f9-4d51-a8f7-94c593b2d205' received within timeout of 30 secs
  1028. 2020-06-05 07:54:01,776 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1029. Traceback (most recent call last):
  1030. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1031. self._serial.open()
  1032. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1033. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1034. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1035. 2020-06-05 07:54:02,418 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1036. 2020-06-05 07:54:02,920 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1037. 2020-06-05 07:54:03,423 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1038. 2020-06-05 07:54:03,425 [spm_conn :139 ][WARNING ][669] Unable to get status: Expected ack '12' but got '255'
  1039. 2020-06-05 07:54:03,929 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1040. 2020-06-05 07:54:04,432 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1041. 2020-06-05 07:54:04,935 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1042. 2020-06-05 07:54:04,937 [spm_conn :139 ][WARNING ][669] Unable to get status: Expected ack '12' but got '255'
  1043. 2020-06-05 07:54:05,441 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1044. 2020-06-05 07:54:05,944 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1045. 2020-06-05 07:54:06,447 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1046. 2020-06-05 07:54:06,449 [spm_conn :139 ][WARNING ][669] Unable to get status: Expected ack '12' but got '255'
  1047. 2020-06-05 07:54:06,453 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1048. 2020-06-05 07:54:06,956 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1049. 2020-06-05 07:54:07,466 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1050. 2020-06-05 07:54:07,468 [spm_conn :82 ][WARNING ][669] Unable to send noop: Expected ack '12' but got '255'
  1051. 2020-06-05 07:54:07,854 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1052. Traceback (most recent call last):
  1053. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1054. self._serial.open()
  1055. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1056. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1057. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1058. 2020-06-05 07:54:07,972 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1059. 2020-06-05 07:54:08,475 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1060. 2020-06-05 07:54:08,860 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1061. Traceback (most recent call last):
  1062. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1063. self._serial.open()
  1064. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1065. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1066. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1067. 2020-06-05 07:54:08,978 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1068. 2020-06-05 07:54:08,980 [spm_conn :82 ][WARNING ][669] Unable to send noop: Expected ack '12' but got '255'
  1069. 2020-06-05 07:54:09,483 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1070. 2020-06-05 07:54:09,864 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1071. Traceback (most recent call last):
  1072. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1073. self._serial.open()
  1074. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1075. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1076. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1077. 2020-06-05 07:54:09,986 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1078. 2020-06-05 07:54:10,370 [messaging :206 ][ERROR ][666] Recurring exception (27 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  1079. Traceback (most recent call last):
  1080. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  1081. self._call_hook_for(message, "workflow", message)
  1082. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1083. return True, func(*args, **kwargs)
  1084. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  1085. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  1086. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1087. return True, func(*args, **kwargs)
  1088. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  1089. return func(*args, **kwargs)
  1090. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  1091. res = _exec("AT+CCLK?")
  1092. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  1093. conn.write_line(cmd)
  1094. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  1095. self.ensure_open()
  1096. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  1097. self.open()
  1098. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  1099. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  1100. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  1101. raise attempt.get()
  1102. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  1103. six.reraise(self.value[0], self.value[1], self.value[2])
  1104. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  1105. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  1106. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1107. self._serial.open()
  1108. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1109. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1110. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1111. 2020-06-05 07:54:10,489 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1112. 2020-06-05 07:54:10,491 [spm_conn :82 ][WARNING ][669] Unable to send noop: Expected ack '12' but got '255'
  1113. 2020-06-05 07:54:10,493 [messaging :206 ][ERROR ][669] Recurring exception (4 times) in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  1114. Traceback (most recent call last):
  1115. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  1116. self._call_hook_for(message, "workflow", message)
  1117. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1118. return True, func(*args, **kwargs)
  1119. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  1120. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  1121. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1122. return True, func(*args, **kwargs)
  1123. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  1124. return func(*args, **kwargs)
  1125. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  1126. conn.heartbeat()
  1127. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  1128. self.noop()
  1129. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  1130. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  1131. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  1132. raise attempt.get()
  1133. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  1134. six.reraise(self.value[0], self.value[1], self.value[2])
  1135. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  1136. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  1137. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  1138. self._begin_message()
  1139. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  1140. self.recv(ack=ACK_MESSAGE_BEGIN)
  1141. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  1142. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  1143. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  1144. raise attempt.get()
  1145. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  1146. six.reraise(self.value[0], self.value[1], self.value[2])
  1147. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  1148. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  1149. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  1150. raise Exception(msg)
  1151. Exception: Expected ack '12' but got '255'
  1152. 2020-06-05 07:54:13,376 [salt.utils :831 ][ERROR ][545] DNS lookup or connection check of 'hub' failed.
  1153. 2020-06-05 07:54:13,380 [salt.minion :178 ][ERROR ][545] Master hostname: 'hub' not found or not responsive. Retrying in 30 seconds
  1154. 2020-06-05 07:54:16,084 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1155. Traceback (most recent call last):
  1156. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1157. self._serial.open()
  1158. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1159. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1160. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1161. 2020-06-05 07:54:17,088 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1162. Traceback (most recent call last):
  1163. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1164. self._serial.open()
  1165. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1166. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1167. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1168. 2020-06-05 07:54:18,092 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1169. Traceback (most recent call last):
  1170. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1171. self._serial.open()
  1172. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1173. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1174. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1175. 2020-06-05 07:54:24,188 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1176. Traceback (most recent call last):
  1177. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1178. self._serial.open()
  1179. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1180. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1181. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1182. 2020-06-05 07:54:25,192 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1183. Traceback (most recent call last):
  1184. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1185. self._serial.open()
  1186. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1187. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1188. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1189. 2020-06-05 07:54:26,198 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1190. Traceback (most recent call last):
  1191. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1192. self._serial.open()
  1193. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1194. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1195. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1196. 2020-06-05 07:54:32,288 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1197. Traceback (most recent call last):
  1198. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1199. self._serial.open()
  1200. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1201. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1202. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1203. 2020-06-05 07:54:33,293 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1204. Traceback (most recent call last):
  1205. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1206. self._serial.open()
  1207. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1208. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1209. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1210. 2020-06-05 07:54:34,297 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1211. Traceback (most recent call last):
  1212. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1213. self._serial.open()
  1214. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1215. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1216. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1217. 2020-06-05 07:54:36,517 [messaging :871 ][WARNING ][667] No reply message with tag 'ec2x/res/e37d840b-69a8-484b-a327-c3ff0636b4cc' received within timeout of 30 secs
  1218. 2020-06-05 07:54:36,522 [messaging :206 ][ERROR ][667] Recurring exception (7 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  1219. Traceback (most recent call last):
  1220. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  1221. self._call_hook_for(message, "workflow", message)
  1222. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1223. return True, func(*args, **kwargs)
  1224. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  1225. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  1226. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1227. return True, func(*args, **kwargs)
  1228. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  1229. return func(*args, **kwargs)
  1230. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  1231. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  1232. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  1233. res = query("AT+QGPSLOC={:d}".format(mode))
  1234. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  1235. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  1236. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  1237. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  1238. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 874, in _recv_reply
  1239. "No reply message received within timeout of {:d} secs - please try again and maybe increase timeout value".format(timeout))
  1240. CommandExecutionError: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  1241. 2020-06-05 07:54:40,372 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1242. Traceback (most recent call last):
  1243. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1244. self._serial.open()
  1245. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1246. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1247. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1248. 2020-06-05 07:54:41,380 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1249. Traceback (most recent call last):
  1250. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1251. self._serial.open()
  1252. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1253. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1254. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1255. 2020-06-05 07:54:42,384 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1256. Traceback (most recent call last):
  1257. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1258. self._serial.open()
  1259. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1260. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1261. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1262. 2020-06-05 07:54:43,409 [salt.utils :831 ][ERROR ][545] DNS lookup or connection check of 'hub' failed.
  1263. 2020-06-05 07:54:43,411 [salt.minion :178 ][ERROR ][545] Master hostname: 'hub' not found or not responsive. Retrying in 30 seconds
  1264. 2020-06-05 07:54:44,866 [cloud_cache :432 ][WARNING ][708] Temporarily unable to upload batch with 2 entries from queue 'pend': HTTPSConnectionPool(host='api.autopi.io', port=443): Max retries exceeded with url: /logbook/storage (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x735b2c10>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))
  1265. 2020-06-05 07:54:48,531 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1266. Traceback (most recent call last):
  1267. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1268. self._serial.open()
  1269. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1270. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1271. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1272. 2020-06-05 07:54:49,536 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1273. Traceback (most recent call last):
  1274. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1275. self._serial.open()
  1276. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1277. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1278. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1279. 2020-06-05 07:54:50,540 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1280. Traceback (most recent call last):
  1281. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1282. self._serial.open()
  1283. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1284. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1285. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1286. 2020-06-05 07:54:56,641 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1287. Traceback (most recent call last):
  1288. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1289. self._serial.open()
  1290. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1291. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1292. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1293. 2020-06-05 07:54:57,646 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1294. Traceback (most recent call last):
  1295. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1296. self._serial.open()
  1297. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1298. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1299. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1300. 2020-06-05 07:54:58,650 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1301. Traceback (most recent call last):
  1302. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1303. self._serial.open()
  1304. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1305. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1306. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1307. 2020-06-05 07:55:04,943 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1308. Traceback (most recent call last):
  1309. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1310. self._serial.open()
  1311. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1312. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1313. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1314. 2020-06-05 07:55:05,948 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1315. Traceback (most recent call last):
  1316. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1317. self._serial.open()
  1318. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1319. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1320. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1321. 2020-06-05 07:55:06,952 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1322. Traceback (most recent call last):
  1323. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1324. self._serial.open()
  1325. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1326. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1327. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1328. 2020-06-05 07:55:08,333 [salt.loaded.int.module.cmdmod:693 ][ERROR ][724] Command '['ping', 'google.com', '-I', 'wwan0', '-c', '1', '-q']' failed with return code: 2
  1329. 2020-06-05 07:55:08,335 [salt.loaded.int.module.cmdmod:697 ][ERROR ][724] stderr: ping: google.com: Temporary failure in name resolution
  1330. 2020-06-05 07:55:08,337 [salt.loaded.int.module.cmdmod:699 ][ERROR ][724] retcode: 2
  1331. 2020-06-05 07:55:10,500 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1332. 2020-06-05 07:55:11,005 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1333. 2020-06-05 07:55:11,511 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1334. 2020-06-05 07:55:11,514 [spm_conn :139 ][WARNING ][669] Unable to get status: Expected ack '12' but got '255'
  1335. 2020-06-05 07:55:11,538 [messaging :871 ][WARNING ][667] No reply message with tag 'ec2x/res/00e15035-6ed2-48f8-8547-b9b3ed7ee7a3' received within timeout of 30 secs
  1336. 2020-06-05 07:55:12,018 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1337. 2020-06-05 07:55:12,521 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1338. 2020-06-05 07:55:13,009 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1339. Traceback (most recent call last):
  1340. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1341. self._serial.open()
  1342. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1343. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1344. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1345. 2020-06-05 07:55:13,025 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1346. 2020-06-05 07:55:13,027 [spm_conn :139 ][WARNING ][669] Unable to get status: Expected ack '12' but got '255'
  1347. 2020-06-05 07:55:13,423 [salt.utils :831 ][ERROR ][545] DNS lookup or connection check of 'hub' failed.
  1348. 2020-06-05 07:55:13,425 [salt.minion :178 ][ERROR ][545] Master hostname: 'hub' not found or not responsive. Retrying in 30 seconds
  1349. 2020-06-05 07:55:13,531 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1350. 2020-06-05 07:55:14,014 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1351. Traceback (most recent call last):
  1352. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1353. self._serial.open()
  1354. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1355. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1356. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1357. 2020-06-05 07:55:14,034 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1358. 2020-06-05 07:55:14,537 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1359. 2020-06-05 07:55:14,539 [spm_conn :139 ][WARNING ][669] Unable to get status: Expected ack '12' but got '255'
  1360. 2020-06-05 07:55:14,542 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1361. 2020-06-05 07:55:15,018 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1362. Traceback (most recent call last):
  1363. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1364. self._serial.open()
  1365. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1366. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1367. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1368. 2020-06-05 07:55:15,044 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1369. 2020-06-05 07:55:15,533 [messaging :206 ][ERROR ][666] Recurring exception (35 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  1370. Traceback (most recent call last):
  1371. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  1372. self._call_hook_for(message, "workflow", message)
  1373. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1374. return True, func(*args, **kwargs)
  1375. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  1376. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  1377. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1378. return True, func(*args, **kwargs)
  1379. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  1380. return func(*args, **kwargs)
  1381. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  1382. res = _exec("AT+CCLK?")
  1383. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  1384. conn.write_line(cmd)
  1385. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  1386. self.ensure_open()
  1387. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  1388. self.open()
  1389. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  1390. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  1391. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  1392. raise attempt.get()
  1393. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  1394. six.reraise(self.value[0], self.value[1], self.value[2])
  1395. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  1396. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  1397. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1398. self._serial.open()
  1399. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1400. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1401. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1402. 2020-06-05 07:55:15,547 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1403. 2020-06-05 07:55:15,549 [spm_conn :82 ][WARNING ][669] Unable to send noop: Expected ack '12' but got '255'
  1404. 2020-06-05 07:55:16,053 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1405. 2020-06-05 07:55:16,556 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1406. 2020-06-05 07:55:17,059 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1407. 2020-06-05 07:55:17,061 [spm_conn :82 ][WARNING ][669] Unable to send noop: Expected ack '12' but got '255'
  1408. 2020-06-05 07:55:17,564 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1409. 2020-06-05 07:55:18,067 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1410. 2020-06-05 07:55:18,570 [gpio_spi_conn :109 ][WARNING ][669] Expected ack '12' but got '255'
  1411. 2020-06-05 07:55:18,572 [spm_conn :82 ][WARNING ][669] Unable to send noop: Expected ack '12' but got '255'
  1412. 2020-06-05 07:55:18,574 [messaging :206 ][ERROR ][669] Recurring exception (5 times) in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  1413. Traceback (most recent call last):
  1414. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  1415. self._call_hook_for(message, "workflow", message)
  1416. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1417. return True, func(*args, **kwargs)
  1418. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  1419. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  1420. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1421. return True, func(*args, **kwargs)
  1422. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  1423. return func(*args, **kwargs)
  1424. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  1425. conn.heartbeat()
  1426. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  1427. self.noop()
  1428. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  1429. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  1430. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  1431. raise attempt.get()
  1432. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  1433. six.reraise(self.value[0], self.value[1], self.value[2])
  1434. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  1435. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  1436. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  1437. self._begin_message()
  1438. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  1439. self.recv(ack=ACK_MESSAGE_BEGIN)
  1440. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  1441. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  1442. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  1443. raise attempt.get()
  1444. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  1445. six.reraise(self.value[0], self.value[1], self.value[2])
  1446. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  1447. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  1448. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  1449. raise Exception(msg)
  1450. Exception: Expected ack '12' but got '255'
  1451. 2020-06-05 07:55:21,100 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1452. Traceback (most recent call last):
  1453. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1454. self._serial.open()
  1455. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1456. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1457. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1458. 2020-06-05 07:55:22,104 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1459. Traceback (most recent call last):
  1460. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1461. self._serial.open()
  1462. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1463. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1464. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1465. 2020-06-05 07:55:23,109 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1466. Traceback (most recent call last):
  1467. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1468. self._serial.open()
  1469. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1470. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1471. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1472. 2020-06-05 07:55:29,167 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1473. Traceback (most recent call last):
  1474. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1475. self._serial.open()
  1476. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1477. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1478. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1479. 2020-06-05 07:55:30,175 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1480. Traceback (most recent call last):
  1481. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1482. self._serial.open()
  1483. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1484. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1485. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1486. 2020-06-05 07:55:31,179 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1487. Traceback (most recent call last):
  1488. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1489. self._serial.open()
  1490. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1491. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1492. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1493. 2020-06-05 07:55:37,305 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1494. Traceback (most recent call last):
  1495. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1496. self._serial.open()
  1497. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1498. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1499. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1500. 2020-06-05 07:55:38,319 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1501. Traceback (most recent call last):
  1502. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1503. self._serial.open()
  1504. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1505. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1506. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1507. 2020-06-05 07:55:38,409 [salt.loaded.int.module.cmdmod:693 ][ERROR ][724] Command '['ping', 'google.com', '-I', 'wwan0', '-c', '1', '-q']' failed with return code: 2
  1508. 2020-06-05 07:55:38,413 [salt.loaded.int.module.cmdmod:697 ][ERROR ][724] stderr: ping: google.com: Temporary failure in name resolution
  1509. 2020-06-05 07:55:38,415 [salt.loaded.int.module.cmdmod:699 ][ERROR ][724] retcode: 2
  1510. 2020-06-05 07:55:39,330 [serial_conn :79 ][ERROR ][666] Failed to open serial connection
  1511. Traceback (most recent call last):
  1512. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1513. self._serial.open()
  1514. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1515. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1516. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1517. 2020-06-05 07:55:43,469 [salt.utils :831 ][ERROR ][545] DNS lookup or connection check of 'hub' failed.
  1518. 2020-06-05 07:55:43,472 [salt.minion :178 ][ERROR ][545] Master hostname: 'hub' not found or not responsive. Retrying in 30 seconds
  1519. 2020-06-05 07:55:45,118 [salt.utils.parsers:1050][WARNING ][545] Minion received a SIGTERM. Exiting.
  1520. 2020-06-05 07:56:02,123 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  1521. 2020-06-05 07:56:02,146 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  1522. 2020-06-05 07:56:02,153 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  1523. 2020-06-05 07:56:02,794 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1524. Traceback (most recent call last):
  1525. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1526. self._serial.open()
  1527. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1528. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1529. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1530. 2020-06-05 07:56:03,808 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1531. Traceback (most recent call last):
  1532. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1533. self._serial.open()
  1534. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1535. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1536. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1537. 2020-06-05 07:56:04,175 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1538. 2020-06-05 07:56:04,678 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1539. 2020-06-05 07:56:04,812 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1540. Traceback (most recent call last):
  1541. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1542. self._serial.open()
  1543. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1544. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1545. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1546. 2020-06-05 07:56:05,181 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1547. 2020-06-05 07:56:05,183 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  1548. 2020-06-05 07:56:05,339 [messaging :208 ][ERROR ][621] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  1549. Traceback (most recent call last):
  1550. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  1551. self._call_hook_for(message, "workflow", message)
  1552. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1553. return True, func(*args, **kwargs)
  1554. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  1555. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  1556. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1557. return True, func(*args, **kwargs)
  1558. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  1559. return func(*args, **kwargs)
  1560. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  1561. res = _exec("AT+CCLK?")
  1562. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  1563. conn.write_line(cmd)
  1564. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  1565. self.ensure_open()
  1566. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  1567. self.open()
  1568. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  1569. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  1570. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  1571. raise attempt.get()
  1572. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  1573. six.reraise(self.value[0], self.value[1], self.value[2])
  1574. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  1575. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  1576. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1577. self._serial.open()
  1578. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1579. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1580. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1581. 2020-06-05 07:56:05,688 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1582. 2020-06-05 07:56:06,192 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1583. 2020-06-05 07:56:06,694 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1584. 2020-06-05 07:56:06,696 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  1585. 2020-06-05 07:56:07,200 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1586. 2020-06-05 07:56:07,703 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1587. 2020-06-05 07:56:08,208 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1588. 2020-06-05 07:56:08,211 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  1589. 2020-06-05 07:56:08,214 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1590. 2020-06-05 07:56:08,717 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1591. 2020-06-05 07:56:09,220 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1592. 2020-06-05 07:56:09,222 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  1593. 2020-06-05 07:56:09,284 [salt.utils :831 ][ERROR ][421] DNS lookup or connection check of 'hub' failed.
  1594. 2020-06-05 07:56:09,290 [salt.minion :178 ][ERROR ][421] Master hostname: 'hub' not found or not responsive. Retrying in 30 seconds
  1595. 2020-06-05 07:56:09,726 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1596. 2020-06-05 07:56:10,229 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1597. 2020-06-05 07:56:10,732 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1598. 2020-06-05 07:56:10,734 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  1599. 2020-06-05 07:56:10,809 [cloud_cache :432 ][WARNING ][665] Temporarily unable to upload batch with 3 entries from queue 'pend': HTTPSConnectionPool(host='api.autopi.io', port=443): Max retries exceeded with url: /logbook/storage (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x735c6a90>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))
  1600. 2020-06-05 07:56:10,981 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1601. Traceback (most recent call last):
  1602. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1603. self._serial.open()
  1604. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1605. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1606. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1607. 2020-06-05 07:56:11,238 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1608. 2020-06-05 07:56:11,740 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1609. 2020-06-05 07:56:11,987 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1610. Traceback (most recent call last):
  1611. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1612. self._serial.open()
  1613. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1614. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1615. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1616. 2020-06-05 07:56:12,244 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1617. 2020-06-05 07:56:12,246 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  1618. 2020-06-05 07:56:12,248 [messaging :208 ][ERROR ][624] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  1619. Traceback (most recent call last):
  1620. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  1621. self._call_hook_for(message, "workflow", message)
  1622. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1623. return True, func(*args, **kwargs)
  1624. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  1625. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  1626. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1627. return True, func(*args, **kwargs)
  1628. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  1629. return func(*args, **kwargs)
  1630. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  1631. conn.heartbeat()
  1632. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  1633. self.noop()
  1634. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  1635. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  1636. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  1637. raise attempt.get()
  1638. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  1639. six.reraise(self.value[0], self.value[1], self.value[2])
  1640. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  1641. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  1642. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  1643. self._begin_message()
  1644. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  1645. self.recv(ack=ACK_MESSAGE_BEGIN)
  1646. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  1647. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  1648. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  1649. raise attempt.get()
  1650. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  1651. six.reraise(self.value[0], self.value[1], self.value[2])
  1652. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  1653. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  1654. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  1655. raise Exception(msg)
  1656. Exception: Expected ack '12' but got '255'
  1657. 2020-06-05 07:56:12,991 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1658. Traceback (most recent call last):
  1659. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1660. self._serial.open()
  1661. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1662. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1663. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1664. 2020-06-05 07:56:13,519 [messaging :206 ][ERROR ][621] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  1665. Traceback (most recent call last):
  1666. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  1667. self._call_hook_for(message, "workflow", message)
  1668. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1669. return True, func(*args, **kwargs)
  1670. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  1671. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  1672. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1673. return True, func(*args, **kwargs)
  1674. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  1675. return func(*args, **kwargs)
  1676. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  1677. res = _exec("AT+CCLK?")
  1678. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  1679. conn.write_line(cmd)
  1680. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  1681. self.ensure_open()
  1682. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  1683. self.open()
  1684. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  1685. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  1686. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  1687. raise attempt.get()
  1688. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  1689. six.reraise(self.value[0], self.value[1], self.value[2])
  1690. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  1691. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  1692. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1693. self._serial.open()
  1694. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1695. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1696. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1697. 2020-06-05 07:56:19,071 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1698. Traceback (most recent call last):
  1699. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1700. self._serial.open()
  1701. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1702. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1703. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1704. 2020-06-05 07:56:20,076 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1705. Traceback (most recent call last):
  1706. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1707. self._serial.open()
  1708. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1709. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1710. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1711. 2020-06-05 07:56:21,080 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1712. Traceback (most recent call last):
  1713. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1714. self._serial.open()
  1715. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1716. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1717. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1718. 2020-06-05 07:56:21,625 [messaging :206 ][ERROR ][621] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  1719. Traceback (most recent call last):
  1720. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  1721. self._call_hook_for(message, "workflow", message)
  1722. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1723. return True, func(*args, **kwargs)
  1724. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  1725. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  1726. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1727. return True, func(*args, **kwargs)
  1728. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  1729. return func(*args, **kwargs)
  1730. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  1731. res = _exec("AT+CCLK?")
  1732. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  1733. conn.write_line(cmd)
  1734. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  1735. self.ensure_open()
  1736. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  1737. self.open()
  1738. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  1739. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  1740. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  1741. raise attempt.get()
  1742. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  1743. six.reraise(self.value[0], self.value[1], self.value[2])
  1744. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  1745. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  1746. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1747. self._serial.open()
  1748. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1749. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1750. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1751. 2020-06-05 07:56:27,216 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1752. Traceback (most recent call last):
  1753. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1754. self._serial.open()
  1755. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1756. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1757. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1758. 2020-06-05 07:56:28,232 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1759. Traceback (most recent call last):
  1760. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1761. self._serial.open()
  1762. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1763. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1764. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1765. 2020-06-05 07:56:29,249 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1766. Traceback (most recent call last):
  1767. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1768. self._serial.open()
  1769. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1770. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1771. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1772. 2020-06-05 07:56:32,233 [messaging :871 ][WARNING ][622] No reply message with tag 'ec2x/res/d9847cf1-8c1e-4aa2-a278-fa8eb1fcfd4a' received within timeout of 30 secs
  1773. 2020-06-05 07:56:32,283 [messaging :208 ][ERROR ][622] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  1774. Traceback (most recent call last):
  1775. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  1776. self._call_hook_for(message, "workflow", message)
  1777. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1778. return True, func(*args, **kwargs)
  1779. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  1780. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  1781. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1782. return True, func(*args, **kwargs)
  1783. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  1784. return func(*args, **kwargs)
  1785. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  1786. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  1787. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  1788. res = query("AT+QGPSLOC={:d}".format(mode))
  1789. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  1790. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  1791. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  1792. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  1793. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 874, in _recv_reply
  1794. "No reply message received within timeout of {:d} secs - please try again and maybe increase timeout value".format(timeout))
  1795. CommandExecutionError: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  1796. 2020-06-05 07:56:35,418 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1797. Traceback (most recent call last):
  1798. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1799. self._serial.open()
  1800. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1801. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1802. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1803. 2020-06-05 07:56:36,424 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1804. Traceback (most recent call last):
  1805. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1806. self._serial.open()
  1807. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1808. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1809. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1810. 2020-06-05 07:56:37,429 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1811. Traceback (most recent call last):
  1812. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1813. self._serial.open()
  1814. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1815. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1816. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1817. 2020-06-05 07:56:39,325 [salt.utils :831 ][ERROR ][421] DNS lookup or connection check of 'hub' failed.
  1818. 2020-06-05 07:56:39,328 [salt.minion :178 ][ERROR ][421] Master hostname: 'hub' not found or not responsive. Retrying in 30 seconds
  1819. 2020-06-05 07:56:43,447 [salt.loaded.int.module.cmdmod:693 ][ERROR ][677] Command '['ping', 'google.com', '-I', 'wwan0', '-c', '1', '-q']' failed with return code: 2
  1820. 2020-06-05 07:56:43,450 [salt.loaded.int.module.cmdmod:697 ][ERROR ][677] stderr: ping: google.com: Temporary failure in name resolution
  1821. 2020-06-05 07:56:43,452 [salt.loaded.int.module.cmdmod:699 ][ERROR ][677] retcode: 2
  1822. 2020-06-05 07:56:43,772 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1823. Traceback (most recent call last):
  1824. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1825. self._serial.open()
  1826. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1827. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1828. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1829. 2020-06-05 07:56:44,788 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1830. Traceback (most recent call last):
  1831. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1832. self._serial.open()
  1833. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1834. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1835. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1836. 2020-06-05 07:56:44,803 [salt.utils.decorators:613 ][WARNING ][677] The function "module.run" is using its deprecated version and will expire in version "Sodium".
  1837. 2020-06-05 07:56:45,799 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1838. Traceback (most recent call last):
  1839. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1840. self._serial.open()
  1841. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1842. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1843. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1844. 2020-06-05 07:56:48,446 [salt.loaded.int.module.cmdmod:693 ][ERROR ][677] Command '['wpa_cli', '-i', 'wlan0', 'status']' failed with return code: 255
  1845. 2020-06-05 07:56:48,454 [salt.loaded.int.module.cmdmod:693 ][ERROR ][677] Command '['wpa_cli', '-i', 'wlan0', 'status']' failed with return code: 255
  1846. 2020-06-05 07:56:48,456 [salt.loaded.int.module.cmdmod:697 ][ERROR ][677] stderr: Failed to connect to non-global ctrl_ifname: wlan0 error: No such file or directory
  1847. 2020-06-05 07:56:48,449 [salt.loaded.int.module.cmdmod:697 ][ERROR ][677] stderr: Failed to connect to non-global ctrl_ifname: wlan0 error: No such file or directory
  1848. 2020-06-05 07:56:48,458 [salt.loaded.int.module.cmdmod:699 ][ERROR ][677] retcode: 255
  1849. 2020-06-05 07:56:48,461 [salt.loaded.int.module.cmdmod:699 ][ERROR ][677] retcode: 255
  1850. 2020-06-05 07:56:48,463 [salt.loaded.ext.engines.api_service:27 ][ERROR ][677] exception occurred: Failed to connect to non-global ctrl_ifname: wlan0 error: No such file or directory
  1851. 2020-06-05 07:56:48,466 [salt.loaded.ext.engines.api_service:27 ][ERROR ][677] exception occurred: Failed to connect to non-global ctrl_ifname: wlan0 error: No such file or directory
  1852. 2020-06-05 07:56:51,955 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1853. Traceback (most recent call last):
  1854. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1855. self._serial.open()
  1856. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1857. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1858. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1859. 2020-06-05 07:56:52,960 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1860. Traceback (most recent call last):
  1861. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1862. self._serial.open()
  1863. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1864. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1865. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1866. 2020-06-05 07:56:53,963 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1867. Traceback (most recent call last):
  1868. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1869. self._serial.open()
  1870. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1871. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1872. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1873. 2020-06-05 07:57:00,018 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1874. Traceback (most recent call last):
  1875. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1876. self._serial.open()
  1877. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1878. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1879. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1880. 2020-06-05 07:57:01,023 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1881. Traceback (most recent call last):
  1882. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1883. self._serial.open()
  1884. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1885. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1886. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1887. 2020-06-05 07:57:02,028 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1888. Traceback (most recent call last):
  1889. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1890. self._serial.open()
  1891. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1892. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1893. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1894. 2020-08-04 11:44:24,025 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1895. 2020-08-04 11:44:24,051 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][661] Timeout after 1.28205128205 second(s) waiting for interrupt
  1896. 2020-08-04 11:44:24,099 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1897. Traceback (most recent call last):
  1898. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1899. self._serial.open()
  1900. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1901. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1902. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1903. 2020-08-04 11:44:24,528 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1904. 2020-08-04 11:44:25,031 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1905. 2020-08-04 11:44:25,033 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  1906. 2020-08-04 11:44:25,104 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1907. Traceback (most recent call last):
  1908. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1909. self._serial.open()
  1910. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1911. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1912. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1913. 2020-08-04 11:44:25,537 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1914. 2020-08-04 11:44:26,040 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1915. 2020-08-04 11:44:26,109 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  1916. Traceback (most recent call last):
  1917. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1918. self._serial.open()
  1919. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1920. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1921. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1922. 2020-08-04 11:44:26,112 [messaging :206 ][ERROR ][621] Recurring exception (9 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  1923. Traceback (most recent call last):
  1924. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  1925. self._call_hook_for(message, "workflow", message)
  1926. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1927. return True, func(*args, **kwargs)
  1928. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  1929. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  1930. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1931. return True, func(*args, **kwargs)
  1932. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  1933. return func(*args, **kwargs)
  1934. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  1935. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  1936. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  1937. conn.write_line(cmd)
  1938. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  1939. self.ensure_open()
  1940. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  1941. self.open()
  1942. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  1943. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  1944. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  1945. raise attempt.get()
  1946. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  1947. six.reraise(self.value[0], self.value[1], self.value[2])
  1948. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  1949. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  1950. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1951. self._serial.open()
  1952. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1953. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1954. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  1955. 2020-08-04 11:44:26,543 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1956. 2020-08-04 11:44:26,545 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  1957. 2020-08-04 11:44:27,049 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1958. 2020-08-04 11:44:27,554 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1959. 2020-08-04 11:44:28,058 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1960. 2020-08-04 11:44:28,060 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  1961. 2020-08-04 11:44:28,065 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1962. 2020-08-04 11:44:28,410 [messaging :871 ][WARNING ][622] No reply message with tag 'ec2x/res/1b72bbe4-22bb-49b3-85ab-2cd527afbc16' received within timeout of 30 secs
  1963. 2020-08-04 11:44:28,413 [messaging :206 ][ERROR ][622] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  1964. Traceback (most recent call last):
  1965. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  1966. self._call_hook_for(message, "workflow", message)
  1967. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1968. return True, func(*args, **kwargs)
  1969. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  1970. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  1971. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  1972. return True, func(*args, **kwargs)
  1973. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  1974. return func(*args, **kwargs)
  1975. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  1976. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  1977. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  1978. res = query("AT+QGPSLOC={:d}".format(mode))
  1979. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  1980. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  1981. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  1982. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  1983. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 874, in _recv_reply
  1984. "No reply message received within timeout of {:d} secs - please try again and maybe increase timeout value".format(timeout))
  1985. CommandExecutionError: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  1986. 2020-08-04 11:44:28,568 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1987. 2020-08-04 11:44:29,071 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  1988. 2020-08-04 11:44:29,074 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  1989. 2020-08-04 11:44:29,683 [salt.utils.parsers:1050][WARNING ][421] Minion received a SIGTERM. Exiting.
  1990. 2020-08-04 11:44:47,012 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  1991. 2020-08-04 11:44:47,024 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  1992. 2020-08-04 11:44:47,034 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  1993. 2020-08-04 11:44:47,683 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  1994. Traceback (most recent call last):
  1995. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  1996. self._serial.open()
  1997. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  1998. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  1999. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2000. 2020-08-04 11:44:48,697 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2001. Traceback (most recent call last):
  2002. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2003. self._serial.open()
  2004. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2005. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2006. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2007. 2020-08-04 11:44:49,067 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2008. 2020-08-04 11:44:49,570 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2009. 2020-08-04 11:44:49,701 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2010. Traceback (most recent call last):
  2011. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2012. self._serial.open()
  2013. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2014. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2015. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2016. 2020-08-04 11:44:50,073 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2017. 2020-08-04 11:44:50,075 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  2018. 2020-08-04 11:44:50,369 [messaging :208 ][ERROR ][617] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  2019. Traceback (most recent call last):
  2020. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  2021. self._call_hook_for(message, "workflow", message)
  2022. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2023. return True, func(*args, **kwargs)
  2024. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  2025. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2026. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2027. return True, func(*args, **kwargs)
  2028. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2029. return func(*args, **kwargs)
  2030. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  2031. res = _exec("AT+CCLK?")
  2032. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  2033. conn.write_line(cmd)
  2034. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  2035. self.ensure_open()
  2036. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  2037. self.open()
  2038. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  2039. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  2040. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  2041. raise attempt.get()
  2042. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  2043. six.reraise(self.value[0], self.value[1], self.value[2])
  2044. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  2045. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  2046. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2047. self._serial.open()
  2048. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2049. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2050. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2051. 2020-08-04 11:44:50,579 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2052. 2020-08-04 11:44:51,083 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2053. 2020-08-04 11:44:51,586 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2054. 2020-08-04 11:44:51,588 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  2055. 2020-08-04 11:44:52,092 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2056. 2020-08-04 11:44:52,606 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2057. 2020-08-04 11:44:53,110 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2058. 2020-08-04 11:44:53,113 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  2059. 2020-08-04 11:44:53,117 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2060. 2020-08-04 11:44:53,620 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2061. 2020-08-04 11:44:54,123 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2062. 2020-08-04 11:44:54,126 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  2063. 2020-08-04 11:44:54,629 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2064. 2020-08-04 11:44:55,133 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2065. 2020-08-04 11:44:55,636 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2066. 2020-08-04 11:44:55,639 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  2067. 2020-08-04 11:44:56,068 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2068. Traceback (most recent call last):
  2069. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2070. self._serial.open()
  2071. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2072. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2073. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2074. 2020-08-04 11:44:56,143 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2075. 2020-08-04 11:44:56,648 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2076. 2020-08-04 11:44:57,077 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2077. Traceback (most recent call last):
  2078. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2079. self._serial.open()
  2080. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2081. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2082. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2083. 2020-08-04 11:44:57,153 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2084. 2020-08-04 11:44:57,155 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  2085. 2020-08-04 11:44:57,157 [messaging :208 ][ERROR ][620] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  2086. Traceback (most recent call last):
  2087. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  2088. self._call_hook_for(message, "workflow", message)
  2089. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2090. return True, func(*args, **kwargs)
  2091. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  2092. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2093. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2094. return True, func(*args, **kwargs)
  2095. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2096. return func(*args, **kwargs)
  2097. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  2098. conn.heartbeat()
  2099. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  2100. self.noop()
  2101. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  2102. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  2103. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  2104. raise attempt.get()
  2105. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  2106. six.reraise(self.value[0], self.value[1], self.value[2])
  2107. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  2108. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  2109. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  2110. self._begin_message()
  2111. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  2112. self.recv(ack=ACK_MESSAGE_BEGIN)
  2113. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  2114. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  2115. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  2116. raise attempt.get()
  2117. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  2118. six.reraise(self.value[0], self.value[1], self.value[2])
  2119. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  2120. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  2121. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  2122. raise Exception(msg)
  2123. Exception: Expected ack '12' but got '255'
  2124. 2020-08-04 11:44:58,081 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2125. Traceback (most recent call last):
  2126. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2127. self._serial.open()
  2128. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2129. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2130. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2131. 2020-08-04 11:44:58,665 [messaging :206 ][ERROR ][617] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  2132. Traceback (most recent call last):
  2133. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  2134. self._call_hook_for(message, "workflow", message)
  2135. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2136. return True, func(*args, **kwargs)
  2137. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  2138. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2139. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2140. return True, func(*args, **kwargs)
  2141. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2142. return func(*args, **kwargs)
  2143. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  2144. res = _exec("AT+CCLK?")
  2145. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  2146. conn.write_line(cmd)
  2147. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  2148. self.ensure_open()
  2149. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  2150. self.open()
  2151. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  2152. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  2153. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  2154. raise attempt.get()
  2155. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  2156. six.reraise(self.value[0], self.value[1], self.value[2])
  2157. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  2158. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  2159. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2160. self._serial.open()
  2161. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2162. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2163. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2164. 2020-08-04 11:44:58,685 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2165. Traceback (most recent call last):
  2166. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2167. self._serial.open()
  2168. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2169. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2170. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2171. 2020-08-04 11:44:58,882 [salt.crypt :624 ][CRITICAL][417] The Salt Master has rejected this minion's public key!
  2172. To repair this issue, delete the public key for this minion on the Salt Master and restart this minion.
  2173. Or restart the Salt Master in open mode to clean out the keys. The Salt Minion will now exit.
  2174. 2020-08-04 11:46:38,222 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][657] Timeout after 1.28205128205 second(s) waiting for interrupt
  2175. 2020-08-04 11:46:38,224 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2176. 2020-08-04 11:46:38,729 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2177. 2020-08-04 11:46:38,867 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2178. Traceback (most recent call last):
  2179. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2180. self._serial.open()
  2181. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2182. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2183. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2184. 2020-08-04 11:46:39,232 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2185. 2020-08-04 11:46:39,234 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  2186. 2020-08-04 11:46:39,738 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2187. 2020-08-04 11:46:39,871 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2188. Traceback (most recent call last):
  2189. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2190. self._serial.open()
  2191. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2192. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2193. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2194. 2020-08-04 11:46:39,874 [messaging :742 ][ERROR ][617] Exception while processing event: {'tag': 'ec2x/req/8a177f98-a2de-40db-a693-f7dfbf89dc17', 'data': {'_stamp': '2020-08-04T11:44:47.084974', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/8a177f98-a2de-40db-a693-f7dfbf89dc17', 'kwargs': {'cooldown_delay': None}}}
  2195. Traceback (most recent call last):
  2196. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  2197. res = self.process(message)
  2198. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  2199. result = func(message, **settings)
  2200. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  2201. found, result = self._call_hook_for(message, "workflow", message)
  2202. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2203. return True, func(*args, **kwargs)
  2204. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  2205. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2206. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2207. return True, func(*args, **kwargs)
  2208. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2209. return func(*args, **kwargs)
  2210. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  2211. return _exec(cmd, **kwargs)
  2212. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  2213. conn.write_line(cmd)
  2214. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  2215. self.ensure_open()
  2216. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  2217. self.open()
  2218. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  2219. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  2220. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  2221. raise attempt.get()
  2222. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  2223. six.reraise(self.value[0], self.value[1], self.value[2])
  2224. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  2225. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  2226. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2227. self._serial.open()
  2228. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2229. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2230. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2231. 2020-08-04 11:46:40,241 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2232. 2020-08-04 11:46:40,438 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2233. Traceback (most recent call last):
  2234. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2235. self._serial.open()
  2236. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2237. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2238. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2239. 2020-08-04 11:46:40,744 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2240. 2020-08-04 11:46:40,746 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  2241. 2020-08-04 11:46:41,250 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2242. 2020-08-04 11:46:41,442 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2243. Traceback (most recent call last):
  2244. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2245. self._serial.open()
  2246. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2247. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2248. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2249. 2020-08-04 11:46:41,753 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2250. 2020-08-04 11:46:42,256 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2251. 2020-08-04 11:46:42,258 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  2252. 2020-08-04 11:46:42,261 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2253. 2020-08-04 11:46:42,446 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2254. Traceback (most recent call last):
  2255. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2256. self._serial.open()
  2257. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2258. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2259. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2260. 2020-08-04 11:46:42,763 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2261. 2020-08-04 11:46:42,948 [messaging :206 ][ERROR ][617] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  2262. Traceback (most recent call last):
  2263. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  2264. self._call_hook_for(message, "workflow", message)
  2265. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2266. return True, func(*args, **kwargs)
  2267. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  2268. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2269. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2270. return True, func(*args, **kwargs)
  2271. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2272. return func(*args, **kwargs)
  2273. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  2274. res = _exec("AT+CCLK?")
  2275. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  2276. conn.write_line(cmd)
  2277. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  2278. self.ensure_open()
  2279. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  2280. self.open()
  2281. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  2282. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  2283. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  2284. raise attempt.get()
  2285. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  2286. six.reraise(self.value[0], self.value[1], self.value[2])
  2287. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  2288. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  2289. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2290. self._serial.open()
  2291. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2292. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2293. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2294. 2020-08-04 11:46:43,266 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2295. 2020-08-04 11:46:43,268 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  2296. 2020-08-04 11:46:43,772 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2297. 2020-08-04 11:46:44,294 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2298. 2020-08-04 11:46:44,796 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2299. 2020-08-04 11:46:44,799 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  2300. 2020-08-04 11:46:45,302 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2301. 2020-08-04 11:46:45,805 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2302. 2020-08-04 11:46:46,308 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2303. 2020-08-04 11:46:46,310 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  2304. 2020-08-04 11:46:46,312 [messaging :206 ][ERROR ][620] Recurring exception (2 times) in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  2305. Traceback (most recent call last):
  2306. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  2307. self._call_hook_for(message, "workflow", message)
  2308. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2309. return True, func(*args, **kwargs)
  2310. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  2311. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2312. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2313. return True, func(*args, **kwargs)
  2314. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2315. return func(*args, **kwargs)
  2316. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  2317. conn.heartbeat()
  2318. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  2319. self.noop()
  2320. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  2321. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  2322. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  2323. raise attempt.get()
  2324. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  2325. six.reraise(self.value[0], self.value[1], self.value[2])
  2326. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  2327. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  2328. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  2329. self._begin_message()
  2330. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  2331. self.recv(ack=ACK_MESSAGE_BEGIN)
  2332. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  2333. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  2334. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  2335. raise attempt.get()
  2336. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  2337. six.reraise(self.value[0], self.value[1], self.value[2])
  2338. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  2339. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  2340. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  2341. raise Exception(msg)
  2342. Exception: Expected ack '12' but got '255'
  2343. 2020-08-04 11:46:48,529 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2344. Traceback (most recent call last):
  2345. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2346. self._serial.open()
  2347. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2348. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2349. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2350. 2020-08-04 11:46:49,534 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2351. Traceback (most recent call last):
  2352. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2353. self._serial.open()
  2354. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2355. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2356. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2357. 2020-08-04 11:46:50,538 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2358. Traceback (most recent call last):
  2359. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2360. self._serial.open()
  2361. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2362. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2363. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2364. 2020-08-04 11:46:56,269 [messaging :871 ][WARNING ][618] No reply message with tag 'ec2x/res/8a177f98-a2de-40db-a693-f7dfbf89dc17' received within timeout of 30 secs
  2365. 2020-08-04 11:46:56,282 [messaging :208 ][ERROR ][618] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  2366. Traceback (most recent call last):
  2367. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  2368. self._call_hook_for(message, "workflow", message)
  2369. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2370. return True, func(*args, **kwargs)
  2371. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  2372. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2373. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2374. return True, func(*args, **kwargs)
  2375. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2376. return func(*args, **kwargs)
  2377. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  2378. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  2379. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  2380. res = query("AT+QGPSLOC={:d}".format(mode))
  2381. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  2382. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  2383. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  2384. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  2385. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 874, in _recv_reply
  2386. "No reply message received within timeout of {:d} secs - please try again and maybe increase timeout value".format(timeout))
  2387. CommandExecutionError: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  2388. 2020-08-04 11:46:56,674 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2389. Traceback (most recent call last):
  2390. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2391. self._serial.open()
  2392. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2393. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2394. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2395. 2020-08-04 11:46:57,679 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2396. Traceback (most recent call last):
  2397. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2398. self._serial.open()
  2399. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2400. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2401. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2402. 2020-08-04 11:46:58,684 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2403. Traceback (most recent call last):
  2404. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2405. self._serial.open()
  2406. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2407. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2408. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2409. 2020-08-04 11:47:04,246 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2410. Traceback (most recent call last):
  2411. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2412. self._serial.open()
  2413. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2414. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2415. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2416. 2020-08-04 11:47:05,250 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2417. Traceback (most recent call last):
  2418. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2419. self._serial.open()
  2420. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2421. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2422. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2423. 2020-08-04 11:47:06,254 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  2424. Traceback (most recent call last):
  2425. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2426. self._serial.open()
  2427. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2428. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2429. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2430. 2020-08-04 11:47:31,345 [messaging :871 ][WARNING ][618] No reply message with tag 'ec2x/res/81413e82-08df-469b-ab78-e2a44e7c32c9' received within timeout of 30 secs
  2431. 2020-08-04 11:47:31,349 [messaging :206 ][ERROR ][618] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  2432. Traceback (most recent call last):
  2433. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  2434. self._call_hook_for(message, "workflow", message)
  2435. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2436. return True, func(*args, **kwargs)
  2437. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  2438. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2439. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2440. return True, func(*args, **kwargs)
  2441. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2442. return func(*args, **kwargs)
  2443. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  2444. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  2445. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  2446. res = query("AT+QGPSLOC={:d}".format(mode))
  2447. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  2448. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  2449. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  2450. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  2451. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 874, in _recv_reply
  2452. "No reply message received within timeout of {:d} secs - please try again and maybe increase timeout value".format(timeout))
  2453. CommandExecutionError: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  2454. 2020-08-04 11:47:39,174 [messaging :208 ][ERROR ][658] Exception in worker thread 'upload' while running workflow for message: {'handler': 'upload'}
  2455. Traceback (most recent call last):
  2456. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  2457. self._call_hook_for(message, "workflow", message)
  2458. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2459. return True, func(*args, **kwargs)
  2460. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  2461. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2462. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2463. return True, func(*args, **kwargs)
  2464. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2465. return func(*args, **kwargs)
  2466. File "/var/cache/salt/minion/extmods/engines/cloud_manager.py", line 92, in upload_handler
  2467. ret["pending"] = cache.upload_pending()
  2468. File "/var/cache/salt/minion/extmods/utils/cloud_cache.py", line 467, in upload_pending
  2469. res = self._upload_batch_continuing(self.PENDING_QUEUE) # Remember this call will raise exception upon server error
  2470. File "/var/cache/salt/minion/extmods/utils/cloud_cache.py", line 226, in _upload_batch_continuing
  2471. res = self._upload_batch(queue) # Remember this call will raise exception upon server error
  2472. File "/var/cache/salt/minion/extmods/utils/cloud_cache.py", line 427, in _upload_batch
  2473. .ltrim(queue, 0, -(len(batch_reversed) + 1)) \
  2474. File "/usr/local/lib/python2.7/dist-packages/redis/client.py", line 2879, in execute
  2475. return execute(conn, stack, raise_on_error)
  2476. File "/usr/local/lib/python2.7/dist-packages/redis/client.py", line 2794, in _execute_transaction
  2477. self.raise_first_error(commands, response)
  2478. File "/usr/local/lib/python2.7/dist-packages/redis/client.py", line 2828, in raise_first_error
  2479. raise r
  2480. ResponseError: Command # 2 (BGSAVE) of pipeline caused error: Background save already in progress
  2481. 2020-08-04 11:47:46,318 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2482. 2020-08-04 11:47:46,821 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2483. 2020-08-04 11:47:47,324 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2484. 2020-08-04 11:47:47,327 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  2485. 2020-08-04 11:47:47,831 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2486. 2020-08-04 11:47:48,334 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2487. 2020-08-04 11:47:48,837 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2488. 2020-08-04 11:47:48,840 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  2489. 2020-08-04 11:47:49,344 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2490. 2020-08-04 11:47:49,847 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2491. 2020-08-04 11:47:50,354 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2492. 2020-08-04 11:47:50,356 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  2493. 2020-08-04 11:47:50,360 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2494. 2020-08-04 11:47:50,863 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2495. 2020-08-04 11:47:51,366 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2496. 2020-08-04 11:47:51,369 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  2497. 2020-08-04 11:47:51,873 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2498. 2020-08-04 11:47:52,376 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2499. 2020-08-04 11:47:52,879 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2500. 2020-08-04 11:47:52,882 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  2501. 2020-08-04 11:47:53,386 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2502. 2020-08-04 11:47:53,889 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2503. 2020-08-04 11:47:54,393 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2504. 2020-08-04 11:47:54,395 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  2505. 2020-08-04 11:47:54,398 [messaging :206 ][ERROR ][620] Recurring exception (3 times) in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  2506. Traceback (most recent call last):
  2507. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  2508. self._call_hook_for(message, "workflow", message)
  2509. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2510. return True, func(*args, **kwargs)
  2511. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  2512. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2513. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2514. return True, func(*args, **kwargs)
  2515. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2516. return func(*args, **kwargs)
  2517. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  2518. conn.heartbeat()
  2519. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  2520. self.noop()
  2521. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  2522. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  2523. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  2524. raise attempt.get()
  2525. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  2526. six.reraise(self.value[0], self.value[1], self.value[2])
  2527. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  2528. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  2529. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  2530. self._begin_message()
  2531. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  2532. self.recv(ack=ACK_MESSAGE_BEGIN)
  2533. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  2534. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  2535. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  2536. raise attempt.get()
  2537. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  2538. six.reraise(self.value[0], self.value[1], self.value[2])
  2539. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  2540. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  2541. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  2542. raise Exception(msg)
  2543. Exception: Expected ack '12' but got '255'
  2544. 2020-08-04 11:48:06,395 [messaging :871 ][WARNING ][618] No reply message with tag 'ec2x/res/97c8ca54-78de-45ba-8350-749284566c86' received within timeout of 30 secs
  2545. 2020-08-04 11:48:06,399 [messaging :206 ][ERROR ][618] Recurring exception (3 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  2546. Traceback (most recent call last):
  2547. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  2548. self._call_hook_for(message, "workflow", message)
  2549. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2550. return True, func(*args, **kwargs)
  2551. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  2552. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2553. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2554. return True, func(*args, **kwargs)
  2555. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2556. return func(*args, **kwargs)
  2557. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  2558. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  2559. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  2560. res = query("AT+QGPSLOC={:d}".format(mode))
  2561. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  2562. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  2563. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  2564. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  2565. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 874, in _recv_reply
  2566. "No reply message received within timeout of {:d} secs - please try again and maybe increase timeout value".format(timeout))
  2567. CommandExecutionError: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  2568. 2020-08-04 11:48:41,439 [messaging :871 ][WARNING ][618] No reply message with tag 'ec2x/res/e734472e-38c6-494d-9e60-e50735b8fda2' received within timeout of 30 secs
  2569. 2020-08-04 11:48:54,404 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2570. 2020-08-04 11:48:54,907 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2571. 2020-08-04 11:48:55,410 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2572. 2020-08-04 11:48:55,413 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  2573. 2020-08-04 11:48:55,916 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2574. 2020-08-04 11:48:56,419 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2575. 2020-08-04 11:48:56,922 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2576. 2020-08-04 11:48:56,925 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  2577. 2020-08-04 11:48:57,429 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2578. 2020-08-04 11:48:57,931 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2579. 2020-08-04 11:48:58,434 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2580. 2020-08-04 11:48:58,437 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  2581. 2020-08-04 11:48:58,440 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2582. 2020-08-04 11:48:58,942 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2583. 2020-08-04 11:48:59,445 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2584. 2020-08-04 11:48:59,448 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  2585. 2020-08-04 11:48:59,951 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2586. 2020-08-04 11:49:00,455 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2587. 2020-08-04 11:49:00,958 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2588. 2020-08-04 11:49:00,960 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  2589. 2020-08-04 11:49:01,464 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2590. 2020-08-04 11:49:01,967 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2591. 2020-08-04 11:49:02,471 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  2592. 2020-08-04 11:49:02,478 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  2593. 2020-08-04 11:49:02,480 [messaging :206 ][ERROR ][620] Recurring exception (4 times) in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  2594. Traceback (most recent call last):
  2595. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  2596. self._call_hook_for(message, "workflow", message)
  2597. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2598. return True, func(*args, **kwargs)
  2599. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  2600. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2601. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2602. return True, func(*args, **kwargs)
  2603. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2604. return func(*args, **kwargs)
  2605. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  2606. conn.heartbeat()
  2607. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  2608. self.noop()
  2609. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  2610. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  2611. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  2612. raise attempt.get()
  2613. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  2614. six.reraise(self.value[0], self.value[1], self.value[2])
  2615. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  2616. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  2617. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  2618. self._begin_message()
  2619. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  2620. self.recv(ack=ACK_MESSAGE_BEGIN)
  2621. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  2622. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  2623. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  2624. raise attempt.get()
  2625. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  2626. six.reraise(self.value[0], self.value[1], self.value[2])
  2627. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  2628. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  2629. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  2630. raise Exception(msg)
  2631. Exception: Expected ack '12' but got '255'
  2632. 2020-08-04 11:49:16,485 [messaging :871 ][WARNING ][618] No reply message with tag 'ec2x/res/13190cd7-575d-4058-8b93-859d0e515021' received within timeout of 30 secs
  2633. 2020-08-04 11:49:16,489 [messaging :206 ][ERROR ][618] Recurring exception (5 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  2634. Traceback (most recent call last):
  2635. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  2636. self._call_hook_for(message, "workflow", message)
  2637. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2638. return True, func(*args, **kwargs)
  2639. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  2640. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2641. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2642. return True, func(*args, **kwargs)
  2643. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2644. return func(*args, **kwargs)
  2645. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  2646. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  2647. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  2648. res = query("AT+QGPSLOC={:d}".format(mode))
  2649. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  2650. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  2651. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  2652. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  2653. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 874, in _recv_reply
  2654. "No reply message received within timeout of {:d} secs - please try again and maybe increase timeout value".format(timeout))
  2655. CommandExecutionError: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  2656. 2020-08-04 11:49:25,813 [salt.loaded.int.module.cmdmod:693 ][ERROR ][723] Command '['ping', 'google.com', '-I', 'wwan0', '-c', '1', '-q']' failed with return code: 2
  2657. 2020-08-04 11:49:25,815 [salt.loaded.int.module.cmdmod:697 ][ERROR ][723] stderr: ping: SO_BINDTODEVICE: Invalid argument
  2658. 2020-08-04 11:49:25,817 [salt.loaded.int.module.cmdmod:699 ][ERROR ][723] retcode: 2
  2659. 2020-08-04 11:49:37,283 [messaging :871 ][WARNING ][723] No reply message with tag 'spm/res/5566fa60-5b50-4f3c-81c7-9cc80ec7b682' received within timeout of 30 secs
  2660. 2020-08-04 11:49:37,287 [salt.loaded.ext.engines.api_service:27 ][ERROR ][723] exception occurred: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  2661. 2020-08-04 11:49:51,516 [messaging :871 ][WARNING ][618] No reply message with tag 'ec2x/res/2d1e897b-f939-41fe-ac3f-29b0bb8e18d1' received within timeout of 30 secs
  2662. 2020-08-04 11:49:56,032 [salt.utils.parsers:1050][WARNING ][417] Minion received a SIGTERM. Exiting.
  2663. 2020-08-04 11:50:13,215 [gpio_spi_conn :42 ][WARNING ][622] Unable to clear buffer - got unexpected value: 255
  2664. 2020-08-04 11:50:13,225 [gpio_spi_conn :42 ][WARNING ][622] Unable to clear buffer - got unexpected value: 255
  2665. 2020-08-04 11:50:13,231 [gpio_spi_conn :42 ][WARNING ][622] Unable to clear buffer - got unexpected value: 255
  2666. 2020-08-04 11:50:13,871 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  2667. Traceback (most recent call last):
  2668. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2669. self._serial.open()
  2670. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2671. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2672. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2673. 2020-08-04 11:50:14,882 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  2674. Traceback (most recent call last):
  2675. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2676. self._serial.open()
  2677. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2678. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2679. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2680. 2020-08-04 11:50:15,258 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2681. 2020-08-04 11:50:15,761 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2682. 2020-08-04 11:50:15,885 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  2683. Traceback (most recent call last):
  2684. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2685. self._serial.open()
  2686. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2687. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2688. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2689. 2020-08-04 11:50:16,264 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2690. 2020-08-04 11:50:16,266 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  2691. 2020-08-04 11:50:16,488 [messaging :208 ][ERROR ][619] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  2692. Traceback (most recent call last):
  2693. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  2694. self._call_hook_for(message, "workflow", message)
  2695. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2696. return True, func(*args, **kwargs)
  2697. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  2698. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2699. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2700. return True, func(*args, **kwargs)
  2701. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2702. return func(*args, **kwargs)
  2703. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  2704. res = _exec("AT+CCLK?")
  2705. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  2706. conn.write_line(cmd)
  2707. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  2708. self.ensure_open()
  2709. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  2710. self.open()
  2711. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  2712. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  2713. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  2714. raise attempt.get()
  2715. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  2716. six.reraise(self.value[0], self.value[1], self.value[2])
  2717. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  2718. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  2719. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2720. self._serial.open()
  2721. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2722. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2723. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2724. 2020-08-04 11:50:16,779 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2725. 2020-08-04 11:50:26,046 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][710] Timeout after 1.28205128205 second(s) waiting for interrupt
  2726. 2020-08-04 11:50:26,133 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  2727. Traceback (most recent call last):
  2728. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2729. self._serial.open()
  2730. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2731. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2732. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2733. 2020-08-04 11:50:26,403 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2734. 2020-08-04 11:50:26,906 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2735. 2020-08-04 11:50:26,911 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  2736. 2020-08-04 11:50:27,138 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  2737. Traceback (most recent call last):
  2738. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2739. self._serial.open()
  2740. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2741. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2742. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2743. 2020-08-04 11:50:27,418 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2744. 2020-08-04 11:50:27,921 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2745. 2020-08-04 11:50:28,143 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  2746. Traceback (most recent call last):
  2747. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2748. self._serial.open()
  2749. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2750. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2751. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2752. 2020-08-04 11:50:28,147 [messaging :206 ][ERROR ][619] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  2753. Traceback (most recent call last):
  2754. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  2755. self._call_hook_for(message, "workflow", message)
  2756. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2757. return True, func(*args, **kwargs)
  2758. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  2759. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2760. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2761. return True, func(*args, **kwargs)
  2762. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2763. return func(*args, **kwargs)
  2764. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  2765. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  2766. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  2767. conn.write_line(cmd)
  2768. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  2769. self.ensure_open()
  2770. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  2771. self.open()
  2772. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  2773. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  2774. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  2775. raise attempt.get()
  2776. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  2777. six.reraise(self.value[0], self.value[1], self.value[2])
  2778. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  2779. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  2780. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2781. self._serial.open()
  2782. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2783. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2784. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2785. 2020-08-04 11:50:28,425 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2786. 2020-08-04 11:50:28,428 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  2787. 2020-08-04 11:50:28,432 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2788. 2020-08-04 11:50:28,935 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2789. 2020-08-04 11:50:29,438 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2790. 2020-08-04 11:50:29,441 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  2791. 2020-08-04 11:50:29,914 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  2792. Traceback (most recent call last):
  2793. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2794. self._serial.open()
  2795. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2796. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2797. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2798. 2020-08-04 11:50:29,945 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2799. 2020-08-04 11:50:30,060 [salt.crypt :624 ][CRITICAL][418] The Salt Master has rejected this minion's public key!
  2800. To repair this issue, delete the public key for this minion on the Salt Master and restart this minion.
  2801. Or restart the Salt Master in open mode to clean out the keys. The Salt Minion will now exit.
  2802. 2020-08-04 11:50:30,449 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2803. 2020-08-04 11:50:30,918 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  2804. Traceback (most recent call last):
  2805. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2806. self._serial.open()
  2807. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2808. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2809. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2810. 2020-08-04 11:50:30,952 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2811. 2020-08-04 11:50:30,954 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  2812. 2020-08-04 11:50:31,458 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2813. 2020-08-04 11:50:31,922 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  2814. Traceback (most recent call last):
  2815. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2816. self._serial.open()
  2817. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2818. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2819. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2820. 2020-08-04 11:50:31,925 [messaging :742 ][ERROR ][619] Exception while processing event: {'tag': 'ec2x/req/c193b153-4e38-4cd4-b5c9-9aee93a29c12', 'data': {'_stamp': '2020-08-04T11:50:13.287366', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/c193b153-4e38-4cd4-b5c9-9aee93a29c12', 'kwargs': {'cooldown_delay': None}}}
  2821. Traceback (most recent call last):
  2822. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  2823. res = self.process(message)
  2824. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  2825. result = func(message, **settings)
  2826. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  2827. found, result = self._call_hook_for(message, "workflow", message)
  2828. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2829. return True, func(*args, **kwargs)
  2830. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  2831. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2832. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2833. return True, func(*args, **kwargs)
  2834. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2835. return func(*args, **kwargs)
  2836. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  2837. return _exec(cmd, **kwargs)
  2838. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  2839. conn.write_line(cmd)
  2840. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  2841. self.ensure_open()
  2842. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  2843. self.open()
  2844. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  2845. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  2846. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  2847. raise attempt.get()
  2848. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  2849. six.reraise(self.value[0], self.value[1], self.value[2])
  2850. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  2851. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  2852. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  2853. self._serial.open()
  2854. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  2855. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  2856. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  2857. 2020-08-04 11:50:31,961 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2858. 2020-08-04 11:50:32,464 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2859. 2020-08-04 11:50:32,467 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  2860. 2020-08-04 11:50:32,469 [messaging :208 ][ERROR ][622] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  2861. Traceback (most recent call last):
  2862. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  2863. self._call_hook_for(message, "workflow", message)
  2864. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2865. return True, func(*args, **kwargs)
  2866. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  2867. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2868. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2869. return True, func(*args, **kwargs)
  2870. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2871. return func(*args, **kwargs)
  2872. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  2873. conn.heartbeat()
  2874. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  2875. self.noop()
  2876. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  2877. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  2878. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  2879. raise attempt.get()
  2880. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  2881. six.reraise(self.value[0], self.value[1], self.value[2])
  2882. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  2883. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  2884. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  2885. self._begin_message()
  2886. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  2887. self.recv(ack=ACK_MESSAGE_BEGIN)
  2888. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  2889. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  2890. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  2891. raise attempt.get()
  2892. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  2893. six.reraise(self.value[0], self.value[1], self.value[2])
  2894. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  2895. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  2896. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  2897. raise Exception(msg)
  2898. Exception: Expected ack '12' but got '255'
  2899. 2020-08-04 11:50:43,294 [messaging :871 ][WARNING ][620] No reply message with tag 'ec2x/res/c193b153-4e38-4cd4-b5c9-9aee93a29c12' received within timeout of 30 secs
  2900. 2020-08-04 11:50:43,304 [messaging :208 ][ERROR ][620] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  2901. Traceback (most recent call last):
  2902. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  2903. self._call_hook_for(message, "workflow", message)
  2904. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2905. return True, func(*args, **kwargs)
  2906. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  2907. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2908. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2909. return True, func(*args, **kwargs)
  2910. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2911. return func(*args, **kwargs)
  2912. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  2913. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  2914. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  2915. res = query("AT+QGPSLOC={:d}".format(mode))
  2916. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  2917. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  2918. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  2919. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  2920. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 874, in _recv_reply
  2921. "No reply message received within timeout of {:d} secs - please try again and maybe increase timeout value".format(timeout))
  2922. CommandExecutionError: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  2923. 2020-08-04 11:51:18,352 [messaging :871 ][WARNING ][620] No reply message with tag 'ec2x/res/1be08e80-b443-453a-963a-bf4b5145f908' received within timeout of 30 secs
  2924. 2020-08-04 11:51:18,356 [messaging :206 ][ERROR ][620] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  2925. Traceback (most recent call last):
  2926. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  2927. self._call_hook_for(message, "workflow", message)
  2928. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2929. return True, func(*args, **kwargs)
  2930. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  2931. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2932. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2933. return True, func(*args, **kwargs)
  2934. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2935. return func(*args, **kwargs)
  2936. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  2937. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  2938. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  2939. res = query("AT+QGPSLOC={:d}".format(mode))
  2940. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  2941. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  2942. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  2943. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  2944. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 874, in _recv_reply
  2945. "No reply message received within timeout of {:d} secs - please try again and maybe increase timeout value".format(timeout))
  2946. CommandExecutionError: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  2947. 2020-08-04 11:51:32,484 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2948. 2020-08-04 11:51:32,987 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2949. 2020-08-04 11:51:33,490 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2950. 2020-08-04 11:51:33,493 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  2951. 2020-08-04 11:51:33,997 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2952. 2020-08-04 11:51:34,500 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2953. 2020-08-04 11:51:35,003 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2954. 2020-08-04 11:51:35,006 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  2955. 2020-08-04 11:51:35,510 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2956. 2020-08-04 11:51:36,013 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2957. 2020-08-04 11:51:36,516 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2958. 2020-08-04 11:51:36,518 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  2959. 2020-08-04 11:51:36,521 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2960. 2020-08-04 11:51:37,032 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2961. 2020-08-04 11:51:37,535 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2962. 2020-08-04 11:51:37,537 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  2963. 2020-08-04 11:51:38,041 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2964. 2020-08-04 11:51:38,544 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2965. 2020-08-04 11:51:39,047 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2966. 2020-08-04 11:51:39,049 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  2967. 2020-08-04 11:51:39,553 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2968. 2020-08-04 11:51:40,056 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2969. 2020-08-04 11:51:40,559 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  2970. 2020-08-04 11:51:40,562 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  2971. 2020-08-04 11:51:40,564 [messaging :206 ][ERROR ][622] Recurring exception (2 times) in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  2972. Traceback (most recent call last):
  2973. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  2974. self._call_hook_for(message, "workflow", message)
  2975. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2976. return True, func(*args, **kwargs)
  2977. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  2978. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  2979. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  2980. return True, func(*args, **kwargs)
  2981. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  2982. return func(*args, **kwargs)
  2983. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  2984. conn.heartbeat()
  2985. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  2986. self.noop()
  2987. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  2988. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  2989. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  2990. raise attempt.get()
  2991. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  2992. six.reraise(self.value[0], self.value[1], self.value[2])
  2993. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  2994. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  2995. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  2996. self._begin_message()
  2997. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  2998. self.recv(ack=ACK_MESSAGE_BEGIN)
  2999. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  3000. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  3001. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  3002. raise attempt.get()
  3003. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  3004. six.reraise(self.value[0], self.value[1], self.value[2])
  3005. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  3006. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  3007. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  3008. raise Exception(msg)
  3009. Exception: Expected ack '12' but got '255'
  3010. 2020-08-04 11:51:53,378 [messaging :871 ][WARNING ][620] No reply message with tag 'ec2x/res/ca7156e3-d28b-4c7f-a312-b54df2503aab' received within timeout of 30 secs
  3011. 2020-08-04 11:51:53,382 [messaging :206 ][ERROR ][620] Recurring exception (3 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  3012. Traceback (most recent call last):
  3013. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  3014. self._call_hook_for(message, "workflow", message)
  3015. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3016. return True, func(*args, **kwargs)
  3017. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  3018. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3019. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3020. return True, func(*args, **kwargs)
  3021. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3022. return func(*args, **kwargs)
  3023. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  3024. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  3025. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  3026. res = query("AT+QGPSLOC={:d}".format(mode))
  3027. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  3028. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  3029. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  3030. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  3031. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 874, in _recv_reply
  3032. "No reply message received within timeout of {:d} secs - please try again and maybe increase timeout value".format(timeout))
  3033. CommandExecutionError: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  3034. 2020-08-04 11:52:13,641 [salt.loaded.int.module.cmdmod:693 ][ERROR ][728] Command '['ping', 'google.com', '-I', 'wwan0', '-c', '1', '-q']' failed with return code: 2
  3035. 2020-08-04 11:52:13,643 [salt.loaded.int.module.cmdmod:697 ][ERROR ][728] stderr: ping: SO_BINDTODEVICE: Invalid argument
  3036. 2020-08-04 11:52:13,645 [salt.loaded.int.module.cmdmod:699 ][ERROR ][728] retcode: 2
  3037. 2020-08-04 11:52:28,427 [messaging :871 ][WARNING ][620] No reply message with tag 'ec2x/res/898bc61d-fa99-4e19-bfbb-cf155d14efcf' received within timeout of 30 secs
  3038. 2020-08-04 11:52:40,571 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3039. 2020-08-04 11:52:41,073 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3040. 2020-08-04 11:52:41,576 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3041. 2020-08-04 11:52:41,579 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  3042. 2020-08-04 11:52:42,084 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3043. 2020-08-04 11:52:42,587 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3044. 2020-08-04 11:52:43,091 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3045. 2020-08-04 11:52:43,093 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  3046. 2020-08-04 11:52:43,597 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3047. 2020-08-04 11:52:43,593 [salt.loaded.int.module.cmdmod:693 ][ERROR ][728] Command '['ping', 'google.com', '-I', 'wwan0', '-c', '1', '-q']' failed with return code: 2
  3048. 2020-08-04 11:52:43,601 [salt.loaded.int.module.cmdmod:697 ][ERROR ][728] stderr: ping: SO_BINDTODEVICE: Invalid argument
  3049. 2020-08-04 11:52:43,605 [salt.loaded.int.module.cmdmod:699 ][ERROR ][728] retcode: 2
  3050. 2020-08-04 11:52:44,100 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3051. 2020-08-04 11:52:44,604 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3052. 2020-08-04 11:52:44,611 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  3053. 2020-08-04 11:52:44,615 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3054. 2020-08-04 11:52:45,117 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3055. 2020-08-04 11:52:45,620 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3056. 2020-08-04 11:52:45,622 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  3057. 2020-08-04 11:52:46,126 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3058. 2020-08-04 11:52:46,629 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3059. 2020-08-04 11:52:47,132 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3060. 2020-08-04 11:52:47,134 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  3061. 2020-08-04 11:52:47,638 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3062. 2020-08-04 11:52:48,140 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3063. 2020-08-04 11:52:48,644 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3064. 2020-08-04 11:52:48,646 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  3065. 2020-08-04 11:52:48,648 [messaging :206 ][ERROR ][622] Recurring exception (3 times) in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  3066. Traceback (most recent call last):
  3067. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  3068. self._call_hook_for(message, "workflow", message)
  3069. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3070. return True, func(*args, **kwargs)
  3071. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  3072. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3073. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3074. return True, func(*args, **kwargs)
  3075. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3076. return func(*args, **kwargs)
  3077. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  3078. conn.heartbeat()
  3079. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  3080. self.noop()
  3081. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  3082. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  3083. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  3084. raise attempt.get()
  3085. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  3086. six.reraise(self.value[0], self.value[1], self.value[2])
  3087. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  3088. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  3089. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  3090. self._begin_message()
  3091. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  3092. self.recv(ack=ACK_MESSAGE_BEGIN)
  3093. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  3094. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  3095. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  3096. raise attempt.get()
  3097. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  3098. six.reraise(self.value[0], self.value[1], self.value[2])
  3099. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  3100. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  3101. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  3102. raise Exception(msg)
  3103. Exception: Expected ack '12' but got '255'
  3104. 2020-08-04 11:53:03,474 [messaging :871 ][WARNING ][620] No reply message with tag 'ec2x/res/13a5ae74-09a0-416d-a122-3ced011d1b74' received within timeout of 30 secs
  3105. 2020-08-04 11:53:03,478 [messaging :206 ][ERROR ][620] Recurring exception (5 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  3106. Traceback (most recent call last):
  3107. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  3108. self._call_hook_for(message, "workflow", message)
  3109. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3110. return True, func(*args, **kwargs)
  3111. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  3112. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3113. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3114. return True, func(*args, **kwargs)
  3115. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3116. return func(*args, **kwargs)
  3117. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  3118. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  3119. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  3120. res = query("AT+QGPSLOC={:d}".format(mode))
  3121. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  3122. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  3123. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  3124. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  3125. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 874, in _recv_reply
  3126. "No reply message received within timeout of {:d} secs - please try again and maybe increase timeout value".format(timeout))
  3127. CommandExecutionError: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  3128. 2020-08-04 11:53:13,611 [salt.loaded.int.module.cmdmod:693 ][ERROR ][728] Command '['ping', 'google.com', '-I', 'wwan0', '-c', '1', '-q']' failed with return code: 2
  3129. 2020-08-04 11:53:13,613 [salt.loaded.int.module.cmdmod:697 ][ERROR ][728] stderr: ping: SO_BINDTODEVICE: Invalid argument
  3130. 2020-08-04 11:53:13,621 [salt.loaded.int.module.cmdmod:699 ][ERROR ][728] retcode: 2
  3131. 2020-08-04 11:53:31,974 [salt.loaded.ext.engines.api_service:27 ][ERROR ][728] exception occurred:
  3132. 2020-08-04 11:53:34,290 [salt.utils.schedule:927 ][ERROR ][775] Unhandled exception running minionutil.status_schedule
  3133. Traceback (most recent call last):
  3134. File "/usr/lib/python2.7/dist-packages/salt/utils/schedule.py", line 894, in handle_func
  3135. ret['return'] = self.functions[func](*args, **kwargs)
  3136. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  3137. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  3138. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  3139. raise attempt.get()
  3140. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  3141. six.reraise(self.value[0], self.value[1], self.value[2])
  3142. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  3143. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  3144. File "/var/cache/salt/minion/extmods/modules/minionutil.py", line 385, in status_schedule
  3145. raise salt.exceptions.CommandExecutionError("No enabled schedule found by name '{:}'".format(name))
  3146. CommandExecutionError: No enabled schedule found by name '_minion_status'
  3147. 2020-08-04 11:53:38,517 [messaging :871 ][WARNING ][620] No reply message with tag 'ec2x/res/0286ab79-e604-4875-aa7f-5e106ef850d8' received within timeout of 30 secs
  3148. 2020-08-04 11:53:41,828 [salt.loaded.ext.engines.api_service:27 ][ERROR ][728] exception occurred:
  3149. 2020-08-04 11:53:43,732 [salt.loaded.int.module.cmdmod:693 ][ERROR ][728] Command '['ping', 'google.com', '-I', 'wwan0', '-c', '1', '-q']' failed with return code: 2
  3150. 2020-08-04 11:53:43,736 [salt.loaded.int.module.cmdmod:697 ][ERROR ][728] stderr: ping: SO_BINDTODEVICE: Invalid argument
  3151. 2020-08-04 11:53:43,738 [salt.loaded.int.module.cmdmod:699 ][ERROR ][728] retcode: 2
  3152. 2020-08-04 11:53:48,654 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3153. 2020-08-04 11:53:49,157 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3154. 2020-08-04 11:53:49,660 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3155. 2020-08-04 11:53:49,662 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  3156. 2020-08-04 11:53:50,166 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3157. 2020-08-04 11:53:50,668 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3158. 2020-08-04 11:53:51,171 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3159. 2020-08-04 11:53:51,174 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  3160. 2020-08-04 11:53:51,677 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3161. 2020-08-04 11:53:52,180 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3162. 2020-08-04 11:53:52,683 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3163. 2020-08-04 11:53:52,686 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  3164. 2020-08-04 11:53:52,689 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3165. 2020-08-04 11:53:53,192 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3166. 2020-08-04 11:53:53,695 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3167. 2020-08-04 11:53:53,697 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  3168. 2020-08-04 11:53:54,201 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3169. 2020-08-04 11:53:54,704 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3170. 2020-08-04 11:53:55,208 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3171. 2020-08-04 11:53:55,210 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  3172. 2020-08-04 11:53:55,715 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3173. 2020-08-04 11:53:56,218 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3174. 2020-08-04 11:53:56,721 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3175. 2020-08-04 11:53:56,724 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  3176. 2020-08-04 11:53:56,727 [messaging :206 ][ERROR ][622] Recurring exception (4 times) in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  3177. Traceback (most recent call last):
  3178. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  3179. self._call_hook_for(message, "workflow", message)
  3180. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3181. return True, func(*args, **kwargs)
  3182. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  3183. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3184. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3185. return True, func(*args, **kwargs)
  3186. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3187. return func(*args, **kwargs)
  3188. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  3189. conn.heartbeat()
  3190. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  3191. self.noop()
  3192. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  3193. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  3194. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  3195. raise attempt.get()
  3196. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  3197. six.reraise(self.value[0], self.value[1], self.value[2])
  3198. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  3199. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  3200. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  3201. self._begin_message()
  3202. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  3203. self.recv(ack=ACK_MESSAGE_BEGIN)
  3204. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  3205. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  3206. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  3207. raise attempt.get()
  3208. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  3209. six.reraise(self.value[0], self.value[1], self.value[2])
  3210. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  3211. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  3212. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  3213. raise Exception(msg)
  3214. Exception: Expected ack '12' but got '255'
  3215. 2020-08-04 11:54:13,557 [messaging :871 ][WARNING ][620] No reply message with tag 'ec2x/res/8052665d-4dc5-4de9-8737-4025c9c39947' received within timeout of 30 secs
  3216. 2020-08-04 11:54:13,562 [messaging :206 ][ERROR ][620] Recurring exception (7 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  3217. Traceback (most recent call last):
  3218. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  3219. self._call_hook_for(message, "workflow", message)
  3220. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3221. return True, func(*args, **kwargs)
  3222. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  3223. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3224. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3225. return True, func(*args, **kwargs)
  3226. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3227. return func(*args, **kwargs)
  3228. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  3229. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  3230. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  3231. res = query("AT+QGPSLOC={:d}".format(mode))
  3232. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  3233. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  3234. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  3235. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  3236. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 874, in _recv_reply
  3237. "No reply message received within timeout of {:d} secs - please try again and maybe increase timeout value".format(timeout))
  3238. CommandExecutionError: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  3239. 2020-08-04 11:54:13,630 [salt.loaded.int.module.cmdmod:693 ][ERROR ][728] Command '['ping', 'google.com', '-I', 'wwan0', '-c', '1', '-q']' failed with return code: 2
  3240. 2020-08-04 11:54:13,637 [salt.loaded.int.module.cmdmod:697 ][ERROR ][728] stderr: ping: SO_BINDTODEVICE: Invalid argument
  3241. 2020-08-04 11:54:13,643 [salt.loaded.int.module.cmdmod:699 ][ERROR ][728] retcode: 2
  3242. 2020-08-04 11:54:43,599 [salt.loaded.int.module.cmdmod:693 ][ERROR ][728] Command '['ping', 'google.com', '-I', 'wwan0', '-c', '1', '-q']' failed with return code: 2
  3243. 2020-08-04 11:54:43,623 [salt.loaded.int.module.cmdmod:697 ][ERROR ][728] stderr: ping: SO_BINDTODEVICE: Invalid argument
  3244. 2020-08-04 11:54:43,629 [salt.loaded.int.module.cmdmod:699 ][ERROR ][728] retcode: 2
  3245. 2020-08-04 11:54:48,609 [messaging :871 ][WARNING ][620] No reply message with tag 'ec2x/res/4fa40c94-0114-4c2d-bac6-47fc8b09bea9' received within timeout of 30 secs
  3246. 2020-08-04 11:54:56,734 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3247. 2020-08-04 11:54:57,237 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3248. 2020-08-04 11:54:57,740 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3249. 2020-08-04 11:54:57,743 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  3250. 2020-08-04 11:54:58,247 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3251. 2020-08-04 11:54:58,750 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3252. 2020-08-04 11:54:59,259 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3253. 2020-08-04 11:54:59,261 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  3254. 2020-08-04 11:54:59,765 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3255. 2020-08-04 11:55:00,269 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3256. 2020-08-04 11:55:00,772 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3257. 2020-08-04 11:55:00,775 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  3258. 2020-08-04 11:55:00,778 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3259. 2020-08-04 11:55:01,282 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3260. 2020-08-04 11:55:01,786 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3261. 2020-08-04 11:55:01,791 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  3262. 2020-08-04 11:55:02,295 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3263. 2020-08-04 11:55:02,799 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3264. 2020-08-04 11:55:03,302 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3265. 2020-08-04 11:55:03,305 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  3266. 2020-08-04 11:55:03,809 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3267. 2020-08-04 11:55:04,317 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3268. 2020-08-04 11:55:04,821 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  3269. 2020-08-04 11:55:04,823 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  3270. 2020-08-04 11:55:04,827 [messaging :206 ][ERROR ][622] Recurring exception (5 times) in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  3271. Traceback (most recent call last):
  3272. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  3273. self._call_hook_for(message, "workflow", message)
  3274. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3275. return True, func(*args, **kwargs)
  3276. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  3277. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3278. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3279. return True, func(*args, **kwargs)
  3280. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3281. return func(*args, **kwargs)
  3282. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  3283. conn.heartbeat()
  3284. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  3285. self.noop()
  3286. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  3287. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  3288. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  3289. raise attempt.get()
  3290. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  3291. six.reraise(self.value[0], self.value[1], self.value[2])
  3292. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  3293. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  3294. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  3295. self._begin_message()
  3296. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  3297. self.recv(ack=ACK_MESSAGE_BEGIN)
  3298. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  3299. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  3300. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  3301. raise attempt.get()
  3302. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  3303. six.reraise(self.value[0], self.value[1], self.value[2])
  3304. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  3305. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  3306. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  3307. raise Exception(msg)
  3308. Exception: Expected ack '12' but got '255'
  3309. 2020-08-04 11:55:13,728 [salt.loaded.int.module.cmdmod:693 ][ERROR ][728] Command '['ping', 'google.com', '-I', 'wwan0', '-c', '1', '-q']' failed with return code: 2
  3310. 2020-08-04 11:55:13,732 [salt.loaded.int.module.cmdmod:697 ][ERROR ][728] stderr: ping: SO_BINDTODEVICE: Invalid argument
  3311. 2020-08-04 11:55:13,736 [salt.loaded.int.module.cmdmod:699 ][ERROR ][728] retcode: 2
  3312. 2020-08-04 11:55:22,287 [salt.utils.parsers:1050][WARNING ][418] Minion received a SIGTERM. Exiting.
  3313. 2020-08-04 11:55:39,049 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  3314. 2020-08-04 11:55:39,063 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  3315. 2020-08-04 11:55:39,068 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  3316. 2020-08-04 11:55:39,760 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3317. Traceback (most recent call last):
  3318. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3319. self._serial.open()
  3320. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3321. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3322. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3323. 2020-08-04 11:55:40,777 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3324. Traceback (most recent call last):
  3325. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3326. self._serial.open()
  3327. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3328. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3329. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3330. 2020-08-04 11:55:41,116 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  3331. 2020-08-04 11:55:41,619 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  3332. 2020-08-04 11:55:41,782 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3333. Traceback (most recent call last):
  3334. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3335. self._serial.open()
  3336. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3337. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3338. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3339. 2020-08-04 11:55:42,121 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  3340. 2020-08-04 11:55:42,124 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  3341. 2020-08-04 11:55:42,382 [messaging :208 ][ERROR ][621] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  3342. Traceback (most recent call last):
  3343. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  3344. self._call_hook_for(message, "workflow", message)
  3345. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3346. return True, func(*args, **kwargs)
  3347. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  3348. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3349. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3350. return True, func(*args, **kwargs)
  3351. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3352. return func(*args, **kwargs)
  3353. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  3354. res = _exec("AT+CCLK?")
  3355. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  3356. conn.write_line(cmd)
  3357. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  3358. self.ensure_open()
  3359. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  3360. self.open()
  3361. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  3362. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  3363. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  3364. raise attempt.get()
  3365. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  3366. six.reraise(self.value[0], self.value[1], self.value[2])
  3367. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  3368. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  3369. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3370. self._serial.open()
  3371. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3372. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3373. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3374. 2020-08-04 11:55:42,628 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  3375. 2020-08-04 11:55:43,131 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  3376. 2020-08-04 11:55:43,634 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  3377. 2020-08-04 11:55:43,636 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  3378. 2020-08-04 11:55:44,140 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  3379. 2020-08-04 11:55:44,643 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  3380. 2020-08-04 11:55:45,146 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  3381. 2020-08-04 11:55:45,148 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  3382. 2020-08-04 11:55:45,151 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  3383. 2020-08-04 11:55:45,655 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  3384. 2020-08-04 11:55:46,143 [salt.utils :831 ][ERROR ][422] DNS lookup or connection check of 'hub' failed.
  3385. 2020-08-04 11:55:46,158 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  3386. 2020-08-04 11:55:46,160 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  3387. 2020-08-04 11:55:46,429 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3388. Traceback (most recent call last):
  3389. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3390. self._serial.open()
  3391. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3392. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3393. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3394. 2020-08-04 11:55:46,664 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  3395. 2020-08-04 11:55:47,167 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  3396. 2020-08-04 11:55:47,434 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3397. Traceback (most recent call last):
  3398. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3399. self._serial.open()
  3400. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3401. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3402. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3403. 2020-08-04 11:55:47,670 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  3404. 2020-08-04 11:55:47,674 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  3405. 2020-08-04 11:55:47,756 [cloud_cache :432 ][WARNING ][662] Temporarily unable to upload batch with 3 entries from queue 'pend': HTTPSConnectionPool(host='api.autopi.io', port=443): Max retries exceeded with url: /logbook/storage (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x735c6a30>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))
  3406. 2020-08-04 11:55:48,179 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  3407. 2020-08-04 11:55:48,438 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3408. Traceback (most recent call last):
  3409. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3410. self._serial.open()
  3411. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3412. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3413. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3414. 2020-08-04 11:55:48,442 [messaging :742 ][ERROR ][621] Exception while processing event: {'tag': 'ec2x/req/c13e97e1-4469-47c8-bf69-f048670d8737', 'data': {'_stamp': '2020-08-04T11:55:39.119604', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/c13e97e1-4469-47c8-bf69-f048670d8737', 'kwargs': {'cooldown_delay': None}}}
  3415. Traceback (most recent call last):
  3416. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  3417. res = self.process(message)
  3418. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  3419. result = func(message, **settings)
  3420. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  3421. found, result = self._call_hook_for(message, "workflow", message)
  3422. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3423. return True, func(*args, **kwargs)
  3424. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  3425. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3426. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3427. return True, func(*args, **kwargs)
  3428. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3429. return func(*args, **kwargs)
  3430. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  3431. return _exec(cmd, **kwargs)
  3432. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  3433. conn.write_line(cmd)
  3434. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  3435. self.ensure_open()
  3436. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  3437. self.open()
  3438. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  3439. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  3440. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  3441. raise attempt.get()
  3442. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  3443. six.reraise(self.value[0], self.value[1], self.value[2])
  3444. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  3445. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  3446. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3447. self._serial.open()
  3448. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3449. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3450. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3451. 2020-08-04 11:55:48,516 [messaging :208 ][ERROR ][622] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  3452. Traceback (most recent call last):
  3453. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  3454. self._call_hook_for(message, "workflow", message)
  3455. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3456. return True, func(*args, **kwargs)
  3457. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  3458. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3459. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3460. return True, func(*args, **kwargs)
  3461. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3462. return func(*args, **kwargs)
  3463. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  3464. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  3465. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  3466. res = query("AT+QGPSLOC={:d}".format(mode))
  3467. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  3468. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  3469. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  3470. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  3471. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  3472. raise salt.exceptions.CommandExecutionError(message["error"])
  3473. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3474. 2020-08-04 11:55:48,682 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  3475. 2020-08-04 11:55:49,067 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3476. Traceback (most recent call last):
  3477. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3478. self._serial.open()
  3479. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3480. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3481. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3482. 2020-08-04 11:55:49,185 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  3483. 2020-08-04 11:55:49,188 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  3484. 2020-08-04 11:55:49,190 [messaging :208 ][ERROR ][624] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  3485. Traceback (most recent call last):
  3486. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  3487. self._call_hook_for(message, "workflow", message)
  3488. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3489. return True, func(*args, **kwargs)
  3490. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  3491. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3492. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3493. return True, func(*args, **kwargs)
  3494. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3495. return func(*args, **kwargs)
  3496. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  3497. conn.heartbeat()
  3498. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  3499. self.noop()
  3500. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  3501. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  3502. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  3503. raise attempt.get()
  3504. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  3505. six.reraise(self.value[0], self.value[1], self.value[2])
  3506. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  3507. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  3508. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  3509. self._begin_message()
  3510. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  3511. self.recv(ack=ACK_MESSAGE_BEGIN)
  3512. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  3513. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  3514. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  3515. raise attempt.get()
  3516. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  3517. six.reraise(self.value[0], self.value[1], self.value[2])
  3518. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  3519. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  3520. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  3521. raise Exception(msg)
  3522. Exception: Expected ack '12' but got '255'
  3523. 2020-08-04 11:55:50,072 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3524. Traceback (most recent call last):
  3525. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3526. self._serial.open()
  3527. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3528. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3529. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3530. 2020-08-04 11:55:51,076 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3531. Traceback (most recent call last):
  3532. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3533. self._serial.open()
  3534. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3535. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3536. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3537. 2020-08-04 11:55:51,580 [messaging :206 ][ERROR ][621] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  3538. Traceback (most recent call last):
  3539. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  3540. self._call_hook_for(message, "workflow", message)
  3541. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3542. return True, func(*args, **kwargs)
  3543. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  3544. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3545. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3546. return True, func(*args, **kwargs)
  3547. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3548. return func(*args, **kwargs)
  3549. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  3550. res = _exec("AT+CCLK?")
  3551. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  3552. conn.write_line(cmd)
  3553. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  3554. self.ensure_open()
  3555. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  3556. self.open()
  3557. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  3558. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  3559. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  3560. raise attempt.get()
  3561. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  3562. six.reraise(self.value[0], self.value[1], self.value[2])
  3563. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  3564. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  3565. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3566. self._serial.open()
  3567. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3568. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3569. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3570. 2020-08-04 11:55:53,577 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3571. Traceback (most recent call last):
  3572. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3573. self._serial.open()
  3574. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3575. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3576. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3577. 2020-08-04 11:55:54,581 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3578. Traceback (most recent call last):
  3579. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3580. self._serial.open()
  3581. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3582. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3583. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3584. 2020-08-04 11:55:55,594 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3585. Traceback (most recent call last):
  3586. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3587. self._serial.open()
  3588. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3589. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3590. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3591. 2020-08-04 11:55:55,597 [messaging :742 ][ERROR ][621] Exception while processing event: {'tag': 'ec2x/req/ac7a7664-3868-4635-8672-89e40de40081', 'data': {'_stamp': '2020-08-04T11:55:53.559319', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/ac7a7664-3868-4635-8672-89e40de40081', 'kwargs': {'cooldown_delay': None}}}
  3592. Traceback (most recent call last):
  3593. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  3594. res = self.process(message)
  3595. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  3596. result = func(message, **settings)
  3597. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  3598. found, result = self._call_hook_for(message, "workflow", message)
  3599. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3600. return True, func(*args, **kwargs)
  3601. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  3602. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3603. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3604. return True, func(*args, **kwargs)
  3605. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3606. return func(*args, **kwargs)
  3607. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  3608. return _exec(cmd, **kwargs)
  3609. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  3610. conn.write_line(cmd)
  3611. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  3612. self.ensure_open()
  3613. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  3614. self.open()
  3615. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  3616. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  3617. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  3618. raise attempt.get()
  3619. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  3620. six.reraise(self.value[0], self.value[1], self.value[2])
  3621. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  3622. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  3623. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3624. self._serial.open()
  3625. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3626. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3627. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3628. 2020-08-04 11:55:55,612 [messaging :206 ][ERROR ][622] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  3629. Traceback (most recent call last):
  3630. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  3631. self._call_hook_for(message, "workflow", message)
  3632. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3633. return True, func(*args, **kwargs)
  3634. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  3635. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3636. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3637. return True, func(*args, **kwargs)
  3638. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3639. return func(*args, **kwargs)
  3640. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  3641. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  3642. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  3643. res = query("AT+QGPSLOC={:d}".format(mode))
  3644. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  3645. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  3646. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  3647. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  3648. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  3649. raise salt.exceptions.CommandExecutionError(message["error"])
  3650. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3651. 2020-08-04 11:55:57,132 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3652. Traceback (most recent call last):
  3653. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3654. self._serial.open()
  3655. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3656. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3657. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3658. 2020-08-04 11:55:58,137 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3659. Traceback (most recent call last):
  3660. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3661. self._serial.open()
  3662. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3663. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3664. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3665. 2020-08-04 11:55:59,141 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3666. Traceback (most recent call last):
  3667. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3668. self._serial.open()
  3669. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3670. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3671. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3672. 2020-08-04 11:55:59,746 [messaging :206 ][ERROR ][621] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  3673. Traceback (most recent call last):
  3674. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  3675. self._call_hook_for(message, "workflow", message)
  3676. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3677. return True, func(*args, **kwargs)
  3678. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  3679. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3680. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3681. return True, func(*args, **kwargs)
  3682. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3683. return func(*args, **kwargs)
  3684. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  3685. res = _exec("AT+CCLK?")
  3686. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  3687. conn.write_line(cmd)
  3688. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  3689. self.ensure_open()
  3690. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  3691. self.open()
  3692. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  3693. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  3694. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  3695. raise attempt.get()
  3696. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  3697. six.reraise(self.value[0], self.value[1], self.value[2])
  3698. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  3699. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  3700. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3701. self._serial.open()
  3702. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3703. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3704. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3705. 2020-08-04 11:56:09,802 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][659] Timeout after 1.28205128205 second(s) waiting for interrupt
  3706. 2020-08-04 11:56:09,908 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3707. Traceback (most recent call last):
  3708. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3709. self._serial.open()
  3710. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3711. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3712. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3713. 2020-08-04 11:56:10,919 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3714. Traceback (most recent call last):
  3715. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3716. self._serial.open()
  3717. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3718. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3719. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3720. 2020-08-04 11:56:11,924 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3721. Traceback (most recent call last):
  3722. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3723. self._serial.open()
  3724. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3725. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3726. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3727. 2020-08-04 11:56:11,929 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3728. Traceback (most recent call last):
  3729. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3730. self._serial.open()
  3731. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3732. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3733. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3734. 2020-08-04 11:56:12,933 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3735. Traceback (most recent call last):
  3736. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3737. self._serial.open()
  3738. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3739. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3740. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3741. 2020-08-04 11:56:13,938 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3742. Traceback (most recent call last):
  3743. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3744. self._serial.open()
  3745. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3746. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3747. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3748. 2020-08-04 11:56:13,941 [messaging :742 ][ERROR ][621] Exception while processing event: {'tag': 'ec2x/req/45a047ef-233e-4e97-a0ba-186200ec05e2', 'data': {'_stamp': '2020-08-04T11:56:09.816000', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/45a047ef-233e-4e97-a0ba-186200ec05e2', 'kwargs': {'cooldown_delay': None}}}
  3749. Traceback (most recent call last):
  3750. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  3751. res = self.process(message)
  3752. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  3753. result = func(message, **settings)
  3754. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  3755. found, result = self._call_hook_for(message, "workflow", message)
  3756. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3757. return True, func(*args, **kwargs)
  3758. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  3759. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3760. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3761. return True, func(*args, **kwargs)
  3762. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3763. return func(*args, **kwargs)
  3764. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  3765. return _exec(cmd, **kwargs)
  3766. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  3767. conn.write_line(cmd)
  3768. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  3769. self.ensure_open()
  3770. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  3771. self.open()
  3772. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  3773. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  3774. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  3775. raise attempt.get()
  3776. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  3777. six.reraise(self.value[0], self.value[1], self.value[2])
  3778. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  3779. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  3780. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3781. self._serial.open()
  3782. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3783. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3784. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3785. 2020-08-04 11:56:13,978 [messaging :206 ][ERROR ][622] Recurring exception (3 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  3786. Traceback (most recent call last):
  3787. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  3788. self._call_hook_for(message, "workflow", message)
  3789. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3790. return True, func(*args, **kwargs)
  3791. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  3792. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3793. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3794. return True, func(*args, **kwargs)
  3795. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3796. return func(*args, **kwargs)
  3797. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  3798. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  3799. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  3800. res = query("AT+QGPSLOC={:d}".format(mode))
  3801. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  3802. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  3803. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  3804. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  3805. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  3806. raise salt.exceptions.CommandExecutionError(message["error"])
  3807. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3808. 2020-08-04 11:56:19,016 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3809. Traceback (most recent call last):
  3810. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3811. self._serial.open()
  3812. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3813. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3814. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3815. 2020-08-04 11:56:20,020 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3816. Traceback (most recent call last):
  3817. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3818. self._serial.open()
  3819. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3820. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3821. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3822. 2020-08-04 11:56:21,024 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3823. Traceback (most recent call last):
  3824. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3825. self._serial.open()
  3826. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3827. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3828. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3829. 2020-08-04 11:56:21,027 [messaging :742 ][ERROR ][621] Exception while processing event: {'tag': 'ec2x/req/bf0c2023-7615-4e5f-a8a5-eea68acd81b8', 'data': {'_stamp': '2020-08-04T11:56:18.994086', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/bf0c2023-7615-4e5f-a8a5-eea68acd81b8', 'kwargs': {'cooldown_delay': None}}}
  3830. Traceback (most recent call last):
  3831. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  3832. res = self.process(message)
  3833. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  3834. result = func(message, **settings)
  3835. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  3836. found, result = self._call_hook_for(message, "workflow", message)
  3837. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3838. return True, func(*args, **kwargs)
  3839. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  3840. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3841. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3842. return True, func(*args, **kwargs)
  3843. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3844. return func(*args, **kwargs)
  3845. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  3846. return _exec(cmd, **kwargs)
  3847. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  3848. conn.write_line(cmd)
  3849. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  3850. self.ensure_open()
  3851. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  3852. self.open()
  3853. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  3854. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  3855. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  3856. raise attempt.get()
  3857. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  3858. six.reraise(self.value[0], self.value[1], self.value[2])
  3859. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  3860. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  3861. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3862. self._serial.open()
  3863. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3864. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3865. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3866. 2020-08-04 11:56:26,086 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3867. Traceback (most recent call last):
  3868. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3869. self._serial.open()
  3870. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3871. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3872. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3873. 2020-08-04 11:56:27,090 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  3874. Traceback (most recent call last):
  3875. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3876. self._serial.open()
  3877. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3878. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3879. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3880. 2020-08-04 11:56:28,098 [obd.obd :107 ][ERROR ][658] Failed to use explicit port '/dev/serial0'
  3881. Traceback (most recent call last):
  3882. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  3883. self.interface.open(baudrate, protocol=protocol)
  3884. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  3885. self.set_protocol(prot.pop("id", None), **prot)
  3886. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  3887. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  3888. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  3889. self._protocol = self._auto_protocol(**kwargs)
  3890. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  3891. res_0100 = self._verify_protocol("auto", test=not verify)
  3892. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  3893. for line in self.query("0100", parse=False, read_timeout=10):
  3894. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  3895. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  3896. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  3897. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  3898. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  3899. data = self._port.read(self._port.in_waiting or 1)
  3900. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  3901. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  3902. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  3903. sys.exit(salt.defaults.exitcodes.EX_OK)
  3904. SystemExit: 0
  3905. 2020-08-04 11:56:28,123 [obd.obd :120 ][WARNING ][658] Cannot load commands - no connection to bus
  3906. 2020-08-04 11:56:28,156 [obd.interfaces.elm327:730 ][ERROR ][658] Failed to relay command 'STSLCS' to interface
  3907. Traceback (most recent call last):
  3908. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  3909. lines = self.send(cmd, raw_response=raw_response)
  3910. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  3911. raise ELM327Error(self.ERRORS[line], code=line)
  3912. ELM327Error: Operation interrupted by a received RS232 character
  3913. 2020-08-04 11:56:28,159 [messaging :742 ][ERROR ][658] Exception while processing event: {'tag': 'obd/req/e1dbf5e1-5fad-4e31-a439-0841d04c08b0', 'data': {'_stamp': '2020-08-04T11:56:22.494343', 'handler': 'execute', '_event_tag': 'obd/req/e1dbf5e1-5fad-4e31-a439-0841d04c08b0', 'args': ['STSLCS']}}
  3914. Traceback (most recent call last):
  3915. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  3916. res = self.process(message)
  3917. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  3918. result = func(message, **settings)
  3919. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  3920. found, result = self._call_hook_for(message, "workflow", message)
  3921. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3922. return True, func(*args, **kwargs)
  3923. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  3924. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3925. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3926. return True, func(*args, **kwargs)
  3927. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3928. return func(*args, **kwargs)
  3929. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  3930. res = conn.execute(cmd)
  3931. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  3932. return func(self, *args, **kwargs)
  3933. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  3934. return self._obd.execute(cmd, **kwargs)
  3935. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  3936. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  3937. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  3938. lines = self.send(cmd, raw_response=raw_response)
  3939. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  3940. raise ELM327Error(self.ERRORS[line], code=line)
  3941. ELM327Error: Operation interrupted by a received RS232 character
  3942. 2020-08-04 11:56:28,175 [messaging :753 ][WARNING ][621] No reply to send back for event: {'tag': 'ec2x/req/fb9a4ca0-8bcc-4b17-94a3-a85720b231d0', 'data': {'_stamp': '2020-08-04T11:56:26.069835', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/fb9a4ca0-8bcc-4b17-94a3-a85720b231d0', 'kwargs': {'cooldown_delay': None}}}
  3943. 2020-08-04 11:56:28,945 [salt.utils.parsers:1050][WARNING ][422] Minion received a SIGTERM. Exiting.
  3944. 2020-08-04 11:56:29,486 [messaging :871 ][WARNING ][894] No reply message with tag 'obd/res/e1dbf5e1-5fad-4e31-a439-0841d04c08b0' received within timeout of 30 secs
  3945. 2020-08-04 11:56:29,489 [salt.state :292 ][ERROR ][894] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  3946. 2020-08-04 11:56:46,149 [gpio_spi_conn :42 ][WARNING ][618] Unable to clear buffer - got unexpected value: 255
  3947. 2020-08-04 11:56:46,159 [gpio_spi_conn :42 ][WARNING ][618] Unable to clear buffer - got unexpected value: 255
  3948. 2020-08-04 11:56:46,163 [gpio_spi_conn :42 ][WARNING ][618] Unable to clear buffer - got unexpected value: 255
  3949. 2020-08-04 11:56:46,791 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  3950. Traceback (most recent call last):
  3951. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3952. self._serial.open()
  3953. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3954. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3955. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3956. 2020-08-04 11:56:47,805 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  3957. Traceback (most recent call last):
  3958. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3959. self._serial.open()
  3960. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3961. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3962. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3963. 2020-08-04 11:56:48,204 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  3964. 2020-08-04 11:56:48,707 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  3965. 2020-08-04 11:56:48,808 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  3966. Traceback (most recent call last):
  3967. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  3968. self._serial.open()
  3969. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  3970. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  3971. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  3972. 2020-08-04 11:56:49,210 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  3973. 2020-08-04 11:56:49,217 [spm_conn :139 ][WARNING ][618] Unable to get status: Expected ack '12' but got '255'
  3974. 2020-08-04 11:56:49,458 [messaging :208 ][ERROR ][615] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  3975. Traceback (most recent call last):
  3976. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  3977. self._call_hook_for(message, "workflow", message)
  3978. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3979. return True, func(*args, **kwargs)
  3980. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  3981. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  3982. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  3983. return True, func(*args, **kwargs)
  3984. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  3985. return func(*args, **kwargs)
  3986. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  3987. res = _exec("AT+CCLK?")
  3988. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  3989. conn.write_line(cmd)
  3990. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  3991. self.ensure_open()
  3992. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  3993. self.open()
  3994. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  3995. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  3996. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  3997. raise attempt.get()
  3998. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  3999. six.reraise(self.value[0], self.value[1], self.value[2])
  4000. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  4001. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  4002. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4003. self._serial.open()
  4004. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4005. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4006. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4007. 2020-08-04 11:56:49,737 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  4008. 2020-08-04 11:56:59,248 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][705] Timeout after 1.28205128205 second(s) waiting for interrupt
  4009. 2020-08-04 11:56:59,323 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  4010. Traceback (most recent call last):
  4011. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4012. self._serial.open()
  4013. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4014. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4015. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4016. 2020-08-04 11:56:59,686 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  4017. 2020-08-04 11:57:00,195 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  4018. 2020-08-04 11:57:00,200 [spm_conn :139 ][WARNING ][618] Unable to get status: Expected ack '12' but got '255'
  4019. 2020-08-04 11:57:00,328 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  4020. Traceback (most recent call last):
  4021. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4022. self._serial.open()
  4023. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4024. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4025. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4026. 2020-08-04 11:57:00,707 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  4027. 2020-08-04 11:57:01,211 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  4028. 2020-08-04 11:57:01,332 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  4029. Traceback (most recent call last):
  4030. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4031. self._serial.open()
  4032. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4033. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4034. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4035. 2020-08-04 11:57:01,347 [messaging :206 ][ERROR ][615] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  4036. Traceback (most recent call last):
  4037. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  4038. self._call_hook_for(message, "workflow", message)
  4039. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4040. return True, func(*args, **kwargs)
  4041. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  4042. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4043. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4044. return True, func(*args, **kwargs)
  4045. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4046. return func(*args, **kwargs)
  4047. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  4048. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  4049. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  4050. conn.write_line(cmd)
  4051. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  4052. self.ensure_open()
  4053. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  4054. self.open()
  4055. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  4056. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  4057. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  4058. raise attempt.get()
  4059. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  4060. six.reraise(self.value[0], self.value[1], self.value[2])
  4061. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  4062. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  4063. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4064. self._serial.open()
  4065. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4066. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4067. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4068. 2020-08-04 11:57:01,714 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  4069. 2020-08-04 11:57:01,716 [spm_conn :139 ][WARNING ][618] Unable to get status: Expected ack '12' but got '255'
  4070. 2020-08-04 11:57:01,720 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  4071. 2020-08-04 11:57:02,223 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  4072. 2020-08-04 11:57:02,726 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  4073. 2020-08-04 11:57:02,728 [spm_conn :82 ][WARNING ][618] Unable to send noop: Expected ack '12' but got '255'
  4074. 2020-08-04 11:57:03,231 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  4075. 2020-08-04 11:57:03,355 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  4076. Traceback (most recent call last):
  4077. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4078. self._serial.open()
  4079. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4080. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4081. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4082. 2020-08-04 11:57:03,734 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  4083. 2020-08-04 11:57:04,237 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  4084. 2020-08-04 11:57:04,239 [spm_conn :82 ][WARNING ][618] Unable to send noop: Expected ack '12' but got '255'
  4085. 2020-08-04 11:57:04,403 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  4086. Traceback (most recent call last):
  4087. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4088. self._serial.open()
  4089. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4090. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4091. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4092. 2020-08-04 11:57:04,743 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  4093. 2020-08-04 11:57:05,246 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  4094. 2020-08-04 11:57:05,408 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  4095. Traceback (most recent call last):
  4096. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4097. self._serial.open()
  4098. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4099. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4100. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4101. 2020-08-04 11:57:05,412 [messaging :742 ][ERROR ][615] Exception while processing event: {'tag': 'ec2x/req/c8592ccb-bce0-48c7-b25a-36830f344d91', 'data': {'_stamp': '2020-08-04T11:56:46.228500', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/c8592ccb-bce0-48c7-b25a-36830f344d91', 'kwargs': {'cooldown_delay': None}}}
  4102. Traceback (most recent call last):
  4103. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  4104. res = self.process(message)
  4105. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  4106. result = func(message, **settings)
  4107. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  4108. found, result = self._call_hook_for(message, "workflow", message)
  4109. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4110. return True, func(*args, **kwargs)
  4111. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  4112. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4113. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4114. return True, func(*args, **kwargs)
  4115. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4116. return func(*args, **kwargs)
  4117. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  4118. return _exec(cmd, **kwargs)
  4119. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  4120. conn.write_line(cmd)
  4121. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  4122. self.ensure_open()
  4123. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  4124. self.open()
  4125. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  4126. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  4127. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  4128. raise attempt.get()
  4129. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  4130. six.reraise(self.value[0], self.value[1], self.value[2])
  4131. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  4132. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  4133. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4134. self._serial.open()
  4135. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4136. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4137. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4138. 2020-08-04 11:57:05,748 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  4139. 2020-08-04 11:57:05,751 [spm_conn :82 ][WARNING ][618] Unable to send noop: Expected ack '12' but got '255'
  4140. 2020-08-04 11:57:05,753 [messaging :208 ][ERROR ][618] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  4141. Traceback (most recent call last):
  4142. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  4143. self._call_hook_for(message, "workflow", message)
  4144. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4145. return True, func(*args, **kwargs)
  4146. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  4147. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4148. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4149. return True, func(*args, **kwargs)
  4150. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4151. return func(*args, **kwargs)
  4152. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  4153. conn.heartbeat()
  4154. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  4155. self.noop()
  4156. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  4157. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  4158. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  4159. raise attempt.get()
  4160. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  4161. six.reraise(self.value[0], self.value[1], self.value[2])
  4162. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  4163. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  4164. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  4165. self._begin_message()
  4166. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  4167. self.recv(ack=ACK_MESSAGE_BEGIN)
  4168. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  4169. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  4170. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  4171. raise attempt.get()
  4172. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  4173. six.reraise(self.value[0], self.value[1], self.value[2])
  4174. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  4175. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  4176. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  4177. raise Exception(msg)
  4178. Exception: Expected ack '12' but got '255'
  4179. 2020-08-04 11:57:09,858 [messaging :208 ][ERROR ][616] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  4180. Traceback (most recent call last):
  4181. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  4182. self._call_hook_for(message, "workflow", message)
  4183. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4184. return True, func(*args, **kwargs)
  4185. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  4186. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4187. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4188. return True, func(*args, **kwargs)
  4189. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4190. return func(*args, **kwargs)
  4191. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  4192. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  4193. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  4194. res = query("AT+QGPSLOC={:d}".format(mode))
  4195. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  4196. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  4197. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  4198. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  4199. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  4200. raise salt.exceptions.CommandExecutionError(message["error"])
  4201. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4202. 2020-08-04 11:57:14,934 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  4203. Traceback (most recent call last):
  4204. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4205. self._serial.open()
  4206. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4207. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4208. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4209. 2020-08-04 11:57:15,939 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  4210. Traceback (most recent call last):
  4211. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4212. self._serial.open()
  4213. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4214. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4215. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4216. 2020-08-04 11:57:16,943 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  4217. Traceback (most recent call last):
  4218. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4219. self._serial.open()
  4220. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4221. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4222. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4223. 2020-08-04 11:57:16,946 [messaging :742 ][ERROR ][615] Exception while processing event: {'tag': 'ec2x/req/106fa031-8801-43ba-b037-2bdfd1915327', 'data': {'_stamp': '2020-08-04T11:57:14.889214', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/106fa031-8801-43ba-b037-2bdfd1915327', 'kwargs': {'cooldown_delay': None}}}
  4224. Traceback (most recent call last):
  4225. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  4226. res = self.process(message)
  4227. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  4228. result = func(message, **settings)
  4229. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  4230. found, result = self._call_hook_for(message, "workflow", message)
  4231. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4232. return True, func(*args, **kwargs)
  4233. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  4234. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4235. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4236. return True, func(*args, **kwargs)
  4237. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4238. return func(*args, **kwargs)
  4239. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  4240. return _exec(cmd, **kwargs)
  4241. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  4242. conn.write_line(cmd)
  4243. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  4244. self.ensure_open()
  4245. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  4246. self.open()
  4247. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  4248. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  4249. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  4250. raise attempt.get()
  4251. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  4252. six.reraise(self.value[0], self.value[1], self.value[2])
  4253. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  4254. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  4255. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4256. self._serial.open()
  4257. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4258. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4259. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4260. 2020-08-04 11:57:16,980 [messaging :206 ][ERROR ][616] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  4261. Traceback (most recent call last):
  4262. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  4263. self._call_hook_for(message, "workflow", message)
  4264. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4265. return True, func(*args, **kwargs)
  4266. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  4267. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4268. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4269. return True, func(*args, **kwargs)
  4270. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4271. return func(*args, **kwargs)
  4272. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  4273. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  4274. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  4275. res = query("AT+QGPSLOC={:d}".format(mode))
  4276. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  4277. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  4278. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  4279. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  4280. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  4281. raise salt.exceptions.CommandExecutionError(message["error"])
  4282. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4283. 2020-08-04 11:57:20,466 [obd.obd :107 ][ERROR ][704] Failed to use explicit port '/dev/serial0'
  4284. Traceback (most recent call last):
  4285. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  4286. self.interface.open(baudrate, protocol=protocol)
  4287. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  4288. self.set_protocol(prot.pop("id", None), **prot)
  4289. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  4290. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  4291. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  4292. self._protocol = self._auto_protocol(**kwargs)
  4293. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  4294. res_0100 = self._verify_protocol("auto", test=not verify)
  4295. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  4296. for line in self.query("0100", parse=False, read_timeout=10):
  4297. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  4298. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  4299. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  4300. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  4301. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  4302. data = self._port.read(self._port.in_waiting or 1)
  4303. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  4304. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  4305. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  4306. sys.exit(salt.defaults.exitcodes.EX_OK)
  4307. SystemExit: 0
  4308. 2020-08-04 11:57:20,505 [obd.obd :120 ][WARNING ][704] Cannot load commands - no connection to bus
  4309. 2020-08-04 11:57:20,532 [obd.interfaces.elm327:730 ][ERROR ][704] Failed to relay command 'STSLCS' to interface
  4310. Traceback (most recent call last):
  4311. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  4312. lines = self.send(cmd, raw_response=raw_response)
  4313. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  4314. raise ELM327Error(self.ERRORS[line], code=line)
  4315. ELM327Error: Operation interrupted by a received RS232 character
  4316. 2020-08-04 11:57:20,535 [messaging :742 ][ERROR ][704] Exception while processing event: {'tag': 'obd/req/4426a4f1-5506-4b75-90ea-920e4a70a72c', 'data': {'_stamp': '2020-08-04T11:57:14.888876', 'handler': 'execute', '_event_tag': 'obd/req/4426a4f1-5506-4b75-90ea-920e4a70a72c', 'args': ['STSLCS']}}
  4317. Traceback (most recent call last):
  4318. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  4319. res = self.process(message)
  4320. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  4321. result = func(message, **settings)
  4322. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  4323. found, result = self._call_hook_for(message, "workflow", message)
  4324. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4325. return True, func(*args, **kwargs)
  4326. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  4327. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4328. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4329. return True, func(*args, **kwargs)
  4330. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4331. return func(*args, **kwargs)
  4332. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  4333. res = conn.execute(cmd)
  4334. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  4335. return func(self, *args, **kwargs)
  4336. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  4337. return self._obd.execute(cmd, **kwargs)
  4338. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  4339. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  4340. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  4341. lines = self.send(cmd, raw_response=raw_response)
  4342. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  4343. raise ELM327Error(self.ERRORS[line], code=line)
  4344. ELM327Error: Operation interrupted by a received RS232 character
  4345. 2020-08-04 11:57:21,259 [salt.utils.parsers:1050][WARNING ][413] Minion received a SIGTERM. Exiting.
  4346. 2020-08-04 11:57:21,799 [messaging :871 ][WARNING ][844] No reply message with tag 'obd/res/4426a4f1-5506-4b75-90ea-920e4a70a72c' received within timeout of 30 secs
  4347. 2020-08-04 11:57:21,803 [salt.state :292 ][ERROR ][844] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  4348. 2020-08-04 11:57:38,208 [gpio_spi_conn :42 ][WARNING ][630] Unable to clear buffer - got unexpected value: 255
  4349. 2020-08-04 11:57:38,229 [gpio_spi_conn :42 ][WARNING ][630] Unable to clear buffer - got unexpected value: 255
  4350. 2020-08-04 11:57:38,234 [gpio_spi_conn :42 ][WARNING ][630] Unable to clear buffer - got unexpected value: 255
  4351. 2020-08-04 11:57:38,894 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  4352. Traceback (most recent call last):
  4353. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4354. self._serial.open()
  4355. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4356. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4357. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4358. 2020-08-04 11:57:39,909 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  4359. Traceback (most recent call last):
  4360. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4361. self._serial.open()
  4362. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4363. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4364. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4365. 2020-08-04 11:57:40,260 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  4366. 2020-08-04 11:57:40,763 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  4367. 2020-08-04 11:57:40,914 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  4368. Traceback (most recent call last):
  4369. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4370. self._serial.open()
  4371. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4372. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4373. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4374. 2020-08-04 11:57:41,266 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  4375. 2020-08-04 11:57:41,268 [spm_conn :139 ][WARNING ][630] Unable to get status: Expected ack '12' but got '255'
  4376. 2020-08-04 11:57:41,463 [messaging :208 ][ERROR ][627] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  4377. Traceback (most recent call last):
  4378. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  4379. self._call_hook_for(message, "workflow", message)
  4380. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4381. return True, func(*args, **kwargs)
  4382. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  4383. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4384. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4385. return True, func(*args, **kwargs)
  4386. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4387. return func(*args, **kwargs)
  4388. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  4389. res = _exec("AT+CCLK?")
  4390. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  4391. conn.write_line(cmd)
  4392. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  4393. self.ensure_open()
  4394. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  4395. self.open()
  4396. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  4397. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  4398. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  4399. raise attempt.get()
  4400. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  4401. six.reraise(self.value[0], self.value[1], self.value[2])
  4402. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  4403. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  4404. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4405. self._serial.open()
  4406. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4407. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4408. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4409. 2020-08-04 11:57:41,773 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  4410. 2020-08-04 11:57:51,657 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  4411. Traceback (most recent call last):
  4412. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4413. self._serial.open()
  4414. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4415. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4416. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4417. 2020-08-04 11:57:52,015 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  4418. 2020-08-04 11:57:52,518 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  4419. 2020-08-04 11:57:52,520 [spm_conn :139 ][WARNING ][630] Unable to get status: Expected ack '12' but got '255'
  4420. 2020-08-04 11:57:52,662 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  4421. Traceback (most recent call last):
  4422. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4423. self._serial.open()
  4424. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4425. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4426. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4427. 2020-08-04 11:57:53,024 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  4428. 2020-08-04 11:57:53,537 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  4429. 2020-08-04 11:57:53,666 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  4430. Traceback (most recent call last):
  4431. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4432. self._serial.open()
  4433. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4434. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4435. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4436. 2020-08-04 11:57:53,679 [messaging :206 ][ERROR ][627] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  4437. Traceback (most recent call last):
  4438. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  4439. self._call_hook_for(message, "workflow", message)
  4440. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4441. return True, func(*args, **kwargs)
  4442. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  4443. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4444. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4445. return True, func(*args, **kwargs)
  4446. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4447. return func(*args, **kwargs)
  4448. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  4449. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  4450. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  4451. conn.write_line(cmd)
  4452. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  4453. self.ensure_open()
  4454. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  4455. self.open()
  4456. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  4457. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  4458. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  4459. raise attempt.get()
  4460. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  4461. six.reraise(self.value[0], self.value[1], self.value[2])
  4462. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  4463. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  4464. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4465. self._serial.open()
  4466. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4467. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4468. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4469. 2020-08-04 11:57:54,043 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  4470. 2020-08-04 11:57:54,045 [spm_conn :139 ][WARNING ][630] Unable to get status: Expected ack '12' but got '255'
  4471. 2020-08-04 11:57:54,052 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  4472. 2020-08-04 11:57:54,555 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  4473. 2020-08-04 11:57:55,059 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  4474. 2020-08-04 11:57:55,063 [spm_conn :82 ][WARNING ][630] Unable to send noop: Expected ack '12' but got '255'
  4475. 2020-08-04 11:57:55,479 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  4476. Traceback (most recent call last):
  4477. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4478. self._serial.open()
  4479. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4480. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4481. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4482. 2020-08-04 11:57:55,569 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  4483. 2020-08-04 11:57:56,073 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  4484. 2020-08-04 11:57:56,483 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  4485. Traceback (most recent call last):
  4486. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4487. self._serial.open()
  4488. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4489. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4490. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4491. 2020-08-04 11:57:56,576 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  4492. 2020-08-04 11:57:56,579 [spm_conn :82 ][WARNING ][630] Unable to send noop: Expected ack '12' but got '255'
  4493. 2020-08-04 11:57:57,083 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  4494. 2020-08-04 11:57:57,487 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  4495. Traceback (most recent call last):
  4496. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4497. self._serial.open()
  4498. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4499. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4500. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4501. 2020-08-04 11:57:57,490 [messaging :742 ][ERROR ][627] Exception while processing event: {'tag': 'ec2x/req/4f350a09-6718-46bc-b9df-4b8099099f3d', 'data': {'_stamp': '2020-08-04T11:57:38.302120', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/4f350a09-6718-46bc-b9df-4b8099099f3d', 'kwargs': {'cooldown_delay': None}}}
  4502. Traceback (most recent call last):
  4503. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  4504. res = self.process(message)
  4505. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  4506. result = func(message, **settings)
  4507. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  4508. found, result = self._call_hook_for(message, "workflow", message)
  4509. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4510. return True, func(*args, **kwargs)
  4511. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  4512. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4513. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4514. return True, func(*args, **kwargs)
  4515. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4516. return func(*args, **kwargs)
  4517. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  4518. return _exec(cmd, **kwargs)
  4519. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  4520. conn.write_line(cmd)
  4521. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  4522. self.ensure_open()
  4523. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  4524. self.open()
  4525. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  4526. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  4527. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  4528. raise attempt.get()
  4529. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  4530. six.reraise(self.value[0], self.value[1], self.value[2])
  4531. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  4532. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  4533. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4534. self._serial.open()
  4535. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4536. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4537. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4538. 2020-08-04 11:57:57,587 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  4539. 2020-08-04 11:57:58,090 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  4540. 2020-08-04 11:57:58,093 [spm_conn :82 ][WARNING ][630] Unable to send noop: Expected ack '12' but got '255'
  4541. 2020-08-04 11:57:58,095 [messaging :208 ][ERROR ][630] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  4542. Traceback (most recent call last):
  4543. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  4544. self._call_hook_for(message, "workflow", message)
  4545. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4546. return True, func(*args, **kwargs)
  4547. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  4548. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4549. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4550. return True, func(*args, **kwargs)
  4551. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4552. return func(*args, **kwargs)
  4553. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  4554. conn.heartbeat()
  4555. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  4556. self.noop()
  4557. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  4558. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  4559. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  4560. raise attempt.get()
  4561. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  4562. six.reraise(self.value[0], self.value[1], self.value[2])
  4563. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  4564. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  4565. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  4566. self._begin_message()
  4567. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  4568. self.recv(ack=ACK_MESSAGE_BEGIN)
  4569. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  4570. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  4571. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  4572. raise attempt.get()
  4573. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  4574. six.reraise(self.value[0], self.value[1], self.value[2])
  4575. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  4576. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  4577. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  4578. raise Exception(msg)
  4579. Exception: Expected ack '12' but got '255'
  4580. 2020-08-04 11:57:59,605 [messaging :208 ][ERROR ][628] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  4581. Traceback (most recent call last):
  4582. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  4583. self._call_hook_for(message, "workflow", message)
  4584. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4585. return True, func(*args, **kwargs)
  4586. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  4587. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4588. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4589. return True, func(*args, **kwargs)
  4590. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4591. return func(*args, **kwargs)
  4592. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  4593. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  4594. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  4595. res = query("AT+QGPSLOC={:d}".format(mode))
  4596. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  4597. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  4598. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  4599. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  4600. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  4601. raise salt.exceptions.CommandExecutionError(message["error"])
  4602. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4603. 2020-08-04 11:58:04,668 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  4604. Traceback (most recent call last):
  4605. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4606. self._serial.open()
  4607. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4608. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4609. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4610. 2020-08-04 11:58:05,681 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  4611. Traceback (most recent call last):
  4612. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4613. self._serial.open()
  4614. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4615. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4616. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4617. 2020-08-04 11:58:06,685 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  4618. Traceback (most recent call last):
  4619. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4620. self._serial.open()
  4621. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4622. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4623. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4624. 2020-08-04 11:58:06,688 [messaging :742 ][ERROR ][627] Exception while processing event: {'tag': 'ec2x/req/7bdd4043-034b-4e40-9cea-974e30db41d8', 'data': {'_stamp': '2020-08-04T11:58:04.661335', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/7bdd4043-034b-4e40-9cea-974e30db41d8', 'kwargs': {'cooldown_delay': None}}}
  4625. Traceback (most recent call last):
  4626. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  4627. res = self.process(message)
  4628. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  4629. result = func(message, **settings)
  4630. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  4631. found, result = self._call_hook_for(message, "workflow", message)
  4632. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4633. return True, func(*args, **kwargs)
  4634. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  4635. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4636. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4637. return True, func(*args, **kwargs)
  4638. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4639. return func(*args, **kwargs)
  4640. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  4641. return _exec(cmd, **kwargs)
  4642. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  4643. conn.write_line(cmd)
  4644. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  4645. self.ensure_open()
  4646. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  4647. self.open()
  4648. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  4649. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  4650. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  4651. raise attempt.get()
  4652. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  4653. six.reraise(self.value[0], self.value[1], self.value[2])
  4654. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  4655. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  4656. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4657. self._serial.open()
  4658. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4659. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4660. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4661. 2020-08-04 11:58:06,717 [messaging :206 ][ERROR ][628] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  4662. Traceback (most recent call last):
  4663. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  4664. self._call_hook_for(message, "workflow", message)
  4665. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4666. return True, func(*args, **kwargs)
  4667. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  4668. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4669. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4670. return True, func(*args, **kwargs)
  4671. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4672. return func(*args, **kwargs)
  4673. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  4674. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  4675. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  4676. res = query("AT+QGPSLOC={:d}".format(mode))
  4677. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  4678. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  4679. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  4680. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  4681. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  4682. raise salt.exceptions.CommandExecutionError(message["error"])
  4683. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4684. 2020-08-04 11:58:09,875 [obd.obd :107 ][ERROR ][666] Failed to use explicit port '/dev/serial0'
  4685. Traceback (most recent call last):
  4686. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  4687. self.interface.open(baudrate, protocol=protocol)
  4688. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  4689. self.set_protocol(prot.pop("id", None), **prot)
  4690. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  4691. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  4692. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  4693. self._protocol = self._auto_protocol(**kwargs)
  4694. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  4695. res_0100 = self._verify_protocol("auto", test=not verify)
  4696. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  4697. for line in self.query("0100", parse=False, read_timeout=10):
  4698. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  4699. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  4700. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  4701. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  4702. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  4703. data = self._port.read(self._port.in_waiting or 1)
  4704. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  4705. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  4706. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  4707. sys.exit(salt.defaults.exitcodes.EX_OK)
  4708. SystemExit: 0
  4709. 2020-08-04 11:58:09,913 [obd.obd :120 ][WARNING ][666] Cannot load commands - no connection to bus
  4710. 2020-08-04 11:58:09,938 [obd.interfaces.elm327:730 ][ERROR ][666] Failed to relay command 'STSLCS' to interface
  4711. Traceback (most recent call last):
  4712. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  4713. lines = self.send(cmd, raw_response=raw_response)
  4714. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  4715. raise ELM327Error(self.ERRORS[line], code=line)
  4716. ELM327Error: Operation interrupted by a received RS232 character
  4717. 2020-08-04 11:58:09,941 [messaging :742 ][ERROR ][666] Exception while processing event: {'tag': 'obd/req/064f2ffe-8738-41ec-bcf5-05f57b577694', 'data': {'_stamp': '2020-08-04T11:58:04.716755', 'handler': 'execute', '_event_tag': 'obd/req/064f2ffe-8738-41ec-bcf5-05f57b577694', 'args': ['STSLCS']}}
  4718. Traceback (most recent call last):
  4719. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  4720. res = self.process(message)
  4721. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  4722. result = func(message, **settings)
  4723. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  4724. found, result = self._call_hook_for(message, "workflow", message)
  4725. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4726. return True, func(*args, **kwargs)
  4727. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  4728. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4729. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4730. return True, func(*args, **kwargs)
  4731. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4732. return func(*args, **kwargs)
  4733. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  4734. res = conn.execute(cmd)
  4735. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  4736. return func(self, *args, **kwargs)
  4737. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  4738. return self._obd.execute(cmd, **kwargs)
  4739. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  4740. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  4741. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  4742. lines = self.send(cmd, raw_response=raw_response)
  4743. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  4744. raise ELM327Error(self.ERRORS[line], code=line)
  4745. ELM327Error: Operation interrupted by a received RS232 character
  4746. 2020-08-04 11:58:10,679 [salt.utils.parsers:1050][WARNING ][427] Minion received a SIGTERM. Exiting.
  4747. 2020-08-04 11:58:11,219 [messaging :871 ][WARNING ][827] No reply message with tag 'obd/res/064f2ffe-8738-41ec-bcf5-05f57b577694' received within timeout of 30 secs
  4748. 2020-08-04 11:58:11,223 [salt.state :292 ][ERROR ][827] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  4749. 2020-08-04 11:58:28,080 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  4750. 2020-08-04 11:58:28,102 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  4751. 2020-08-04 11:58:28,107 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  4752. 2020-08-04 11:58:28,768 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  4753. Traceback (most recent call last):
  4754. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4755. self._serial.open()
  4756. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4757. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4758. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4759. 2020-08-04 11:58:29,790 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  4760. Traceback (most recent call last):
  4761. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4762. self._serial.open()
  4763. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4764. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4765. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4766. 2020-08-04 11:58:30,139 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  4767. 2020-08-04 11:58:30,642 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  4768. 2020-08-04 11:58:30,795 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  4769. Traceback (most recent call last):
  4770. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4771. self._serial.open()
  4772. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4773. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4774. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4775. 2020-08-04 11:58:31,145 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  4776. 2020-08-04 11:58:31,147 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  4777. 2020-08-04 11:58:31,337 [messaging :208 ][ERROR ][618] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  4778. Traceback (most recent call last):
  4779. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  4780. self._call_hook_for(message, "workflow", message)
  4781. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4782. return True, func(*args, **kwargs)
  4783. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  4784. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4785. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4786. return True, func(*args, **kwargs)
  4787. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4788. return func(*args, **kwargs)
  4789. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  4790. res = _exec("AT+CCLK?")
  4791. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  4792. conn.write_line(cmd)
  4793. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  4794. self.ensure_open()
  4795. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  4796. self.open()
  4797. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  4798. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  4799. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  4800. raise attempt.get()
  4801. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  4802. six.reraise(self.value[0], self.value[1], self.value[2])
  4803. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  4804. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  4805. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4806. self._serial.open()
  4807. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4808. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4809. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4810. 2020-08-04 11:58:31,656 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  4811. 2020-08-04 11:58:32,159 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  4812. 2020-08-04 11:58:32,662 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  4813. 2020-08-04 11:58:32,664 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  4814. 2020-08-04 11:58:33,168 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  4815. 2020-08-04 11:58:33,671 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  4816. 2020-08-04 11:58:34,175 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  4817. 2020-08-04 11:58:34,177 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  4818. 2020-08-04 11:58:34,181 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  4819. 2020-08-04 11:58:34,684 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  4820. 2020-08-04 11:58:35,187 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  4821. 2020-08-04 11:58:35,190 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  4822. 2020-08-04 11:58:35,523 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  4823. Traceback (most recent call last):
  4824. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4825. self._serial.open()
  4826. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4827. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4828. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4829. 2020-08-04 11:58:35,694 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  4830. 2020-08-04 11:58:36,198 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  4831. 2020-08-04 11:58:36,527 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  4832. Traceback (most recent call last):
  4833. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4834. self._serial.open()
  4835. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4836. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4837. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4838. 2020-08-04 11:58:36,701 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  4839. 2020-08-04 11:58:36,704 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  4840. 2020-08-04 11:58:37,208 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  4841. 2020-08-04 11:58:37,532 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  4842. Traceback (most recent call last):
  4843. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4844. self._serial.open()
  4845. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4846. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4847. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4848. 2020-08-04 11:58:37,536 [messaging :742 ][ERROR ][618] Exception while processing event: {'tag': 'ec2x/req/152f6b6e-969d-4174-a010-55a8cb951149', 'data': {'_stamp': '2020-08-04T11:58:28.149877', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/152f6b6e-969d-4174-a010-55a8cb951149', 'kwargs': {'cooldown_delay': None}}}
  4849. Traceback (most recent call last):
  4850. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  4851. res = self.process(message)
  4852. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  4853. result = func(message, **settings)
  4854. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  4855. found, result = self._call_hook_for(message, "workflow", message)
  4856. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4857. return True, func(*args, **kwargs)
  4858. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  4859. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4860. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4861. return True, func(*args, **kwargs)
  4862. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4863. return func(*args, **kwargs)
  4864. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  4865. return _exec(cmd, **kwargs)
  4866. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  4867. conn.write_line(cmd)
  4868. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  4869. self.ensure_open()
  4870. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  4871. self.open()
  4872. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  4873. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  4874. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  4875. raise attempt.get()
  4876. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  4877. six.reraise(self.value[0], self.value[1], self.value[2])
  4878. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  4879. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  4880. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4881. self._serial.open()
  4882. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4883. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4884. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4885. 2020-08-04 11:58:37,713 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  4886. 2020-08-04 11:58:38,143 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  4887. Traceback (most recent call last):
  4888. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4889. self._serial.open()
  4890. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4891. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4892. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4893. 2020-08-04 11:58:38,217 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  4894. 2020-08-04 11:58:38,220 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  4895. 2020-08-04 11:58:38,223 [messaging :208 ][ERROR ][621] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  4896. Traceback (most recent call last):
  4897. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  4898. self._call_hook_for(message, "workflow", message)
  4899. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4900. return True, func(*args, **kwargs)
  4901. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  4902. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4903. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4904. return True, func(*args, **kwargs)
  4905. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4906. return func(*args, **kwargs)
  4907. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  4908. conn.heartbeat()
  4909. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  4910. self.noop()
  4911. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  4912. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  4913. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  4914. raise attempt.get()
  4915. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  4916. six.reraise(self.value[0], self.value[1], self.value[2])
  4917. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  4918. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  4919. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  4920. self._begin_message()
  4921. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  4922. self.recv(ack=ACK_MESSAGE_BEGIN)
  4923. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  4924. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  4925. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  4926. raise attempt.get()
  4927. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  4928. six.reraise(self.value[0], self.value[1], self.value[2])
  4929. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  4930. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  4931. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  4932. raise Exception(msg)
  4933. Exception: Expected ack '12' but got '255'
  4934. 2020-08-04 11:58:39,148 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  4935. Traceback (most recent call last):
  4936. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4937. self._serial.open()
  4938. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4939. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4940. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4941. 2020-08-04 11:58:39,756 [messaging :208 ][ERROR ][619] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  4942. Traceback (most recent call last):
  4943. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  4944. self._call_hook_for(message, "workflow", message)
  4945. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4946. return True, func(*args, **kwargs)
  4947. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  4948. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4949. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4950. return True, func(*args, **kwargs)
  4951. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4952. return func(*args, **kwargs)
  4953. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  4954. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  4955. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  4956. res = query("AT+QGPSLOC={:d}".format(mode))
  4957. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  4958. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  4959. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  4960. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  4961. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  4962. raise salt.exceptions.CommandExecutionError(message["error"])
  4963. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4964. 2020-08-04 11:58:40,152 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  4965. Traceback (most recent call last):
  4966. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  4967. self._serial.open()
  4968. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  4969. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  4970. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  4971. 2020-08-04 11:58:40,671 [messaging :206 ][ERROR ][618] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  4972. Traceback (most recent call last):
  4973. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  4974. self._call_hook_for(message, "workflow", message)
  4975. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4976. return True, func(*args, **kwargs)
  4977. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  4978. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  4979. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  4980. return True, func(*args, **kwargs)
  4981. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  4982. return func(*args, **kwargs)
  4983. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  4984. res = _exec("AT+CCLK?")
  4985. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  4986. conn.write_line(cmd)
  4987. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  4988. self.ensure_open()
  4989. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  4990. self.open()
  4991. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  4992. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  4993. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  4994. raise attempt.get()
  4995. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  4996. six.reraise(self.value[0], self.value[1], self.value[2])
  4997. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  4998. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  4999. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5000. self._serial.open()
  5001. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5002. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5003. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5004. 2020-08-04 11:58:50,294 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][658] Timeout after 1.28205128205 second(s) waiting for interrupt
  5005. 2020-08-04 11:58:50,361 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  5006. Traceback (most recent call last):
  5007. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5008. self._serial.open()
  5009. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5010. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5011. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5012. 2020-08-04 11:58:51,378 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  5013. Traceback (most recent call last):
  5014. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5015. self._serial.open()
  5016. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5017. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5018. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5019. 2020-08-04 11:58:52,382 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  5020. Traceback (most recent call last):
  5021. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5022. self._serial.open()
  5023. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5024. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5025. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5026. 2020-08-04 11:58:52,385 [messaging :206 ][ERROR ][618] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  5027. Traceback (most recent call last):
  5028. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  5029. self._call_hook_for(message, "workflow", message)
  5030. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5031. return True, func(*args, **kwargs)
  5032. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  5033. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5034. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5035. return True, func(*args, **kwargs)
  5036. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5037. return func(*args, **kwargs)
  5038. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  5039. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  5040. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  5041. conn.write_line(cmd)
  5042. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  5043. self.ensure_open()
  5044. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  5045. self.open()
  5046. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  5047. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  5048. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  5049. raise attempt.get()
  5050. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  5051. six.reraise(self.value[0], self.value[1], self.value[2])
  5052. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  5053. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  5054. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5055. self._serial.open()
  5056. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5057. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5058. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5059. 2020-08-04 11:58:52,387 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  5060. Traceback (most recent call last):
  5061. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5062. self._serial.open()
  5063. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5064. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5065. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5066. 2020-08-04 11:58:53,403 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  5067. Traceback (most recent call last):
  5068. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5069. self._serial.open()
  5070. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5071. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5072. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5073. 2020-08-04 11:58:54,407 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  5074. Traceback (most recent call last):
  5075. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5076. self._serial.open()
  5077. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5078. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5079. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5080. 2020-08-04 11:58:54,410 [messaging :742 ][ERROR ][618] Exception while processing event: {'tag': 'ec2x/req/09f54514-8268-4306-9181-286cbf23c520', 'data': {'_stamp': '2020-08-04T11:58:50.296885', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/09f54514-8268-4306-9181-286cbf23c520', 'kwargs': {'cooldown_delay': None}}}
  5081. Traceback (most recent call last):
  5082. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  5083. res = self.process(message)
  5084. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  5085. result = func(message, **settings)
  5086. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  5087. found, result = self._call_hook_for(message, "workflow", message)
  5088. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5089. return True, func(*args, **kwargs)
  5090. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  5091. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5092. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5093. return True, func(*args, **kwargs)
  5094. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5095. return func(*args, **kwargs)
  5096. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  5097. return _exec(cmd, **kwargs)
  5098. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  5099. conn.write_line(cmd)
  5100. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  5101. self.ensure_open()
  5102. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  5103. self.open()
  5104. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  5105. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  5106. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  5107. raise attempt.get()
  5108. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  5109. six.reraise(self.value[0], self.value[1], self.value[2])
  5110. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  5111. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  5112. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5113. self._serial.open()
  5114. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5115. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5116. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5117. 2020-08-04 11:58:54,446 [messaging :206 ][ERROR ][619] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  5118. Traceback (most recent call last):
  5119. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  5120. self._call_hook_for(message, "workflow", message)
  5121. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5122. return True, func(*args, **kwargs)
  5123. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  5124. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5125. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5126. return True, func(*args, **kwargs)
  5127. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5128. return func(*args, **kwargs)
  5129. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  5130. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  5131. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  5132. res = query("AT+QGPSLOC={:d}".format(mode))
  5133. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  5134. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  5135. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  5136. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  5137. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  5138. raise salt.exceptions.CommandExecutionError(message["error"])
  5139. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5140. 2020-08-04 11:58:59,441 [obd.obd :107 ][ERROR ][655] Failed to use explicit port '/dev/serial0'
  5141. Traceback (most recent call last):
  5142. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  5143. self.interface.open(baudrate, protocol=protocol)
  5144. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  5145. self.set_protocol(prot.pop("id", None), **prot)
  5146. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  5147. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  5148. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  5149. self._protocol = self._auto_protocol(**kwargs)
  5150. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  5151. res_0100 = self._verify_protocol("auto", test=not verify)
  5152. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  5153. for line in self.query("0100", parse=False, read_timeout=10):
  5154. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  5155. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  5156. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  5157. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  5158. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  5159. data = self._port.read(self._port.in_waiting or 1)
  5160. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  5161. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  5162. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  5163. sys.exit(salt.defaults.exitcodes.EX_OK)
  5164. SystemExit: 0
  5165. 2020-08-04 11:58:59,468 [obd.obd :120 ][WARNING ][655] Cannot load commands - no connection to bus
  5166. 2020-08-04 11:58:59,504 [obd.interfaces.elm327:730 ][ERROR ][655] Failed to relay command 'STSLCS' to interface
  5167. Traceback (most recent call last):
  5168. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  5169. lines = self.send(cmd, raw_response=raw_response)
  5170. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  5171. raise ELM327Error(self.ERRORS[line], code=line)
  5172. ELM327Error: Operation interrupted by a received RS232 character
  5173. 2020-08-04 11:58:59,508 [messaging :742 ][ERROR ][655] Exception while processing event: {'tag': 'obd/req/e3834a53-193e-4402-86ba-70d644cc1eb7', 'data': {'_stamp': '2020-08-04T11:58:53.966714', 'handler': 'execute', '_event_tag': 'obd/req/e3834a53-193e-4402-86ba-70d644cc1eb7', 'args': ['STSLCS']}}
  5174. Traceback (most recent call last):
  5175. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  5176. res = self.process(message)
  5177. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  5178. result = func(message, **settings)
  5179. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  5180. found, result = self._call_hook_for(message, "workflow", message)
  5181. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5182. return True, func(*args, **kwargs)
  5183. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  5184. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5185. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5186. return True, func(*args, **kwargs)
  5187. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5188. return func(*args, **kwargs)
  5189. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  5190. res = conn.execute(cmd)
  5191. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  5192. return func(self, *args, **kwargs)
  5193. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  5194. return self._obd.execute(cmd, **kwargs)
  5195. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  5196. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  5197. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  5198. lines = self.send(cmd, raw_response=raw_response)
  5199. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  5200. raise ELM327Error(self.ERRORS[line], code=line)
  5201. ELM327Error: Operation interrupted by a received RS232 character
  5202. 2020-08-04 11:59:00,295 [salt.utils.parsers:1050][WARNING ][416] Minion received a SIGTERM. Exiting.
  5203. 2020-08-04 11:59:00,835 [messaging :871 ][WARNING ][832] No reply message with tag 'obd/res/e3834a53-193e-4402-86ba-70d644cc1eb7' received within timeout of 30 secs
  5204. 2020-08-04 11:59:00,839 [salt.state :292 ][ERROR ][832] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  5205. 2020-08-04 11:59:17,964 [gpio_spi_conn :42 ][WARNING ][617] Unable to clear buffer - got unexpected value: 255
  5206. 2020-08-04 11:59:17,973 [gpio_spi_conn :42 ][WARNING ][617] Unable to clear buffer - got unexpected value: 255
  5207. 2020-08-04 11:59:17,981 [gpio_spi_conn :42 ][WARNING ][617] Unable to clear buffer - got unexpected value: 255
  5208. 2020-08-04 11:59:18,657 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  5209. Traceback (most recent call last):
  5210. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5211. self._serial.open()
  5212. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5213. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5214. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5215. 2020-08-04 11:59:19,672 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  5216. Traceback (most recent call last):
  5217. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5218. self._serial.open()
  5219. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5220. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5221. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5222. 2020-08-04 11:59:20,003 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  5223. 2020-08-04 11:59:20,506 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  5224. 2020-08-04 11:59:20,676 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  5225. Traceback (most recent call last):
  5226. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5227. self._serial.open()
  5228. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5229. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5230. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5231. 2020-08-04 11:59:21,009 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  5232. 2020-08-04 11:59:21,012 [spm_conn :139 ][WARNING ][617] Unable to get status: Expected ack '12' but got '255'
  5233. 2020-08-04 11:59:21,205 [messaging :208 ][ERROR ][614] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  5234. Traceback (most recent call last):
  5235. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  5236. self._call_hook_for(message, "workflow", message)
  5237. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5238. return True, func(*args, **kwargs)
  5239. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  5240. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5241. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5242. return True, func(*args, **kwargs)
  5243. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5244. return func(*args, **kwargs)
  5245. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  5246. res = _exec("AT+CCLK?")
  5247. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  5248. conn.write_line(cmd)
  5249. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  5250. self.ensure_open()
  5251. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  5252. self.open()
  5253. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  5254. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  5255. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  5256. raise attempt.get()
  5257. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  5258. six.reraise(self.value[0], self.value[1], self.value[2])
  5259. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  5260. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  5261. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5262. self._serial.open()
  5263. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5264. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5265. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5266. 2020-08-04 11:59:21,516 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  5267. 2020-08-04 11:59:30,448 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][705] Timeout after 1.28205128205 second(s) waiting for interrupt
  5268. 2020-08-04 11:59:30,540 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  5269. Traceback (most recent call last):
  5270. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5271. self._serial.open()
  5272. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5273. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5274. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5275. 2020-08-04 11:59:30,831 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  5276. 2020-08-04 11:59:31,335 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  5277. 2020-08-04 11:59:31,338 [spm_conn :139 ][WARNING ][617] Unable to get status: Expected ack '12' but got '255'
  5278. 2020-08-04 11:59:31,544 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  5279. Traceback (most recent call last):
  5280. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5281. self._serial.open()
  5282. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5283. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5284. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5285. 2020-08-04 11:59:31,843 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  5286. 2020-08-04 11:59:32,346 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  5287. 2020-08-04 11:59:32,548 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  5288. Traceback (most recent call last):
  5289. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5290. self._serial.open()
  5291. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5292. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5293. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5294. 2020-08-04 11:59:32,551 [messaging :206 ][ERROR ][614] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  5295. Traceback (most recent call last):
  5296. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  5297. self._call_hook_for(message, "workflow", message)
  5298. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5299. return True, func(*args, **kwargs)
  5300. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  5301. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5302. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5303. return True, func(*args, **kwargs)
  5304. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5305. return func(*args, **kwargs)
  5306. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  5307. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  5308. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  5309. conn.write_line(cmd)
  5310. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  5311. self.ensure_open()
  5312. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  5313. self.open()
  5314. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  5315. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  5316. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  5317. raise attempt.get()
  5318. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  5319. six.reraise(self.value[0], self.value[1], self.value[2])
  5320. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  5321. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  5322. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5323. self._serial.open()
  5324. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5325. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5326. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5327. 2020-08-04 11:59:32,850 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  5328. 2020-08-04 11:59:32,852 [spm_conn :139 ][WARNING ][617] Unable to get status: Expected ack '12' but got '255'
  5329. 2020-08-04 11:59:32,856 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  5330. 2020-08-04 11:59:33,360 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  5331. 2020-08-04 11:59:33,863 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  5332. 2020-08-04 11:59:33,866 [spm_conn :82 ][WARNING ][617] Unable to send noop: Expected ack '12' but got '255'
  5333. 2020-08-04 11:59:34,317 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  5334. Traceback (most recent call last):
  5335. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5336. self._serial.open()
  5337. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5338. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5339. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5340. 2020-08-04 11:59:34,370 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  5341. 2020-08-04 11:59:34,874 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  5342. 2020-08-04 11:59:35,321 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  5343. Traceback (most recent call last):
  5344. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5345. self._serial.open()
  5346. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5347. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5348. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5349. 2020-08-04 11:59:35,377 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  5350. 2020-08-04 11:59:35,382 [spm_conn :82 ][WARNING ][617] Unable to send noop: Expected ack '12' but got '255'
  5351. 2020-08-04 11:59:35,886 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  5352. 2020-08-04 11:59:36,325 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  5353. Traceback (most recent call last):
  5354. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5355. self._serial.open()
  5356. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5357. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5358. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5359. 2020-08-04 11:59:36,328 [messaging :742 ][ERROR ][614] Exception while processing event: {'tag': 'ec2x/req/cc2670fc-20a8-42a7-8e4c-5fea291f43ab', 'data': {'_stamp': '2020-08-04T11:59:18.029826', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/cc2670fc-20a8-42a7-8e4c-5fea291f43ab', 'kwargs': {'cooldown_delay': None}}}
  5360. Traceback (most recent call last):
  5361. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  5362. res = self.process(message)
  5363. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  5364. result = func(message, **settings)
  5365. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  5366. found, result = self._call_hook_for(message, "workflow", message)
  5367. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5368. return True, func(*args, **kwargs)
  5369. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  5370. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5371. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5372. return True, func(*args, **kwargs)
  5373. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5374. return func(*args, **kwargs)
  5375. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  5376. return _exec(cmd, **kwargs)
  5377. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  5378. conn.write_line(cmd)
  5379. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  5380. self.ensure_open()
  5381. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  5382. self.open()
  5383. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  5384. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  5385. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  5386. raise attempt.get()
  5387. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  5388. six.reraise(self.value[0], self.value[1], self.value[2])
  5389. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  5390. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  5391. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5392. self._serial.open()
  5393. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5394. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5395. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5396. 2020-08-04 11:59:36,391 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  5397. 2020-08-04 11:59:36,895 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  5398. 2020-08-04 11:59:36,898 [spm_conn :82 ][WARNING ][617] Unable to send noop: Expected ack '12' but got '255'
  5399. 2020-08-04 11:59:36,900 [messaging :208 ][ERROR ][617] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  5400. Traceback (most recent call last):
  5401. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  5402. self._call_hook_for(message, "workflow", message)
  5403. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5404. return True, func(*args, **kwargs)
  5405. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  5406. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5407. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5408. return True, func(*args, **kwargs)
  5409. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5410. return func(*args, **kwargs)
  5411. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  5412. conn.heartbeat()
  5413. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  5414. self.noop()
  5415. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  5416. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  5417. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  5418. raise attempt.get()
  5419. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  5420. six.reraise(self.value[0], self.value[1], self.value[2])
  5421. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  5422. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  5423. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  5424. self._begin_message()
  5425. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  5426. self.recv(ack=ACK_MESSAGE_BEGIN)
  5427. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  5428. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  5429. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  5430. raise attempt.get()
  5431. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  5432. six.reraise(self.value[0], self.value[1], self.value[2])
  5433. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  5434. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  5435. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  5436. raise Exception(msg)
  5437. Exception: Expected ack '12' but got '255'
  5438. 2020-08-04 11:59:38,565 [messaging :208 ][ERROR ][615] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  5439. Traceback (most recent call last):
  5440. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  5441. self._call_hook_for(message, "workflow", message)
  5442. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5443. return True, func(*args, **kwargs)
  5444. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  5445. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5446. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5447. return True, func(*args, **kwargs)
  5448. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5449. return func(*args, **kwargs)
  5450. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  5451. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  5452. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  5453. res = query("AT+QGPSLOC={:d}".format(mode))
  5454. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  5455. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  5456. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  5457. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  5458. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  5459. raise salt.exceptions.CommandExecutionError(message["error"])
  5460. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5461. 2020-08-04 11:59:43,613 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  5462. Traceback (most recent call last):
  5463. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5464. self._serial.open()
  5465. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5466. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5467. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5468. 2020-08-04 11:59:44,625 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  5469. Traceback (most recent call last):
  5470. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5471. self._serial.open()
  5472. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5473. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5474. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5475. 2020-08-04 11:59:45,630 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  5476. Traceback (most recent call last):
  5477. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5478. self._serial.open()
  5479. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5480. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5481. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5482. 2020-08-04 11:59:45,633 [messaging :742 ][ERROR ][614] Exception while processing event: {'tag': 'ec2x/req/300e97a9-e494-4a96-b2e7-86f1b551b4bc', 'data': {'_stamp': '2020-08-04T11:59:43.606655', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/300e97a9-e494-4a96-b2e7-86f1b551b4bc', 'kwargs': {'cooldown_delay': None}}}
  5483. Traceback (most recent call last):
  5484. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  5485. res = self.process(message)
  5486. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  5487. result = func(message, **settings)
  5488. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  5489. found, result = self._call_hook_for(message, "workflow", message)
  5490. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5491. return True, func(*args, **kwargs)
  5492. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  5493. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5494. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5495. return True, func(*args, **kwargs)
  5496. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5497. return func(*args, **kwargs)
  5498. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  5499. return _exec(cmd, **kwargs)
  5500. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  5501. conn.write_line(cmd)
  5502. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  5503. self.ensure_open()
  5504. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  5505. self.open()
  5506. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  5507. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  5508. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  5509. raise attempt.get()
  5510. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  5511. six.reraise(self.value[0], self.value[1], self.value[2])
  5512. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  5513. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  5514. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5515. self._serial.open()
  5516. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5517. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5518. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5519. 2020-08-04 11:59:45,649 [messaging :206 ][ERROR ][615] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  5520. Traceback (most recent call last):
  5521. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  5522. self._call_hook_for(message, "workflow", message)
  5523. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5524. return True, func(*args, **kwargs)
  5525. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  5526. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5527. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5528. return True, func(*args, **kwargs)
  5529. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5530. return func(*args, **kwargs)
  5531. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  5532. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  5533. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  5534. res = query("AT+QGPSLOC={:d}".format(mode))
  5535. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  5536. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  5537. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  5538. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  5539. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  5540. raise salt.exceptions.CommandExecutionError(message["error"])
  5541. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5542. 2020-08-04 11:59:50,770 [obd.obd :107 ][ERROR ][703] Failed to use explicit port '/dev/serial0'
  5543. Traceback (most recent call last):
  5544. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  5545. self.interface.open(baudrate, protocol=protocol)
  5546. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  5547. self.set_protocol(prot.pop("id", None), **prot)
  5548. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  5549. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  5550. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  5551. self._protocol = self._auto_protocol(**kwargs)
  5552. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  5553. res_0100 = self._verify_protocol("auto", test=not verify)
  5554. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  5555. for line in self.query("0100", parse=False, read_timeout=10):
  5556. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  5557. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  5558. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  5559. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  5560. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  5561. data = self._port.read(self._port.in_waiting or 1)
  5562. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  5563. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  5564. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  5565. sys.exit(salt.defaults.exitcodes.EX_OK)
  5566. SystemExit: 0
  5567. 2020-08-04 11:59:50,794 [obd.obd :120 ][WARNING ][703] Cannot load commands - no connection to bus
  5568. 2020-08-04 11:59:50,823 [obd.interfaces.elm327:730 ][ERROR ][703] Failed to relay command 'STSLCS' to interface
  5569. Traceback (most recent call last):
  5570. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  5571. lines = self.send(cmd, raw_response=raw_response)
  5572. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  5573. raise ELM327Error(self.ERRORS[line], code=line)
  5574. ELM327Error: Operation interrupted by a received RS232 character
  5575. 2020-08-04 11:59:50,826 [messaging :742 ][ERROR ][703] Exception while processing event: {'tag': 'obd/req/dbd6b4af-998b-4052-bc17-771d94477120', 'data': {'_stamp': '2020-08-04T11:59:45.198914', 'handler': 'execute', '_event_tag': 'obd/req/dbd6b4af-998b-4052-bc17-771d94477120', 'args': ['STSLCS']}}
  5576. Traceback (most recent call last):
  5577. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  5578. res = self.process(message)
  5579. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  5580. result = func(message, **settings)
  5581. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  5582. found, result = self._call_hook_for(message, "workflow", message)
  5583. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5584. return True, func(*args, **kwargs)
  5585. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  5586. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5587. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5588. return True, func(*args, **kwargs)
  5589. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5590. return func(*args, **kwargs)
  5591. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  5592. res = conn.execute(cmd)
  5593. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  5594. return func(self, *args, **kwargs)
  5595. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  5596. return self._obd.execute(cmd, **kwargs)
  5597. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  5598. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  5599. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  5600. lines = self.send(cmd, raw_response=raw_response)
  5601. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  5602. raise ELM327Error(self.ERRORS[line], code=line)
  5603. ELM327Error: Operation interrupted by a received RS232 character
  5604. 2020-08-04 11:59:51,508 [salt.utils.parsers:1050][WARNING ][414] Minion received a SIGTERM. Exiting.
  5605. 2020-08-04 11:59:52,048 [messaging :871 ][WARNING ][814] No reply message with tag 'obd/res/dbd6b4af-998b-4052-bc17-771d94477120' received within timeout of 30 secs
  5606. 2020-08-04 11:59:52,052 [salt.state :292 ][ERROR ][814] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  5607. 2020-08-04 12:00:09,182 [gpio_spi_conn :42 ][WARNING ][627] Unable to clear buffer - got unexpected value: 255
  5608. 2020-08-04 12:00:09,199 [gpio_spi_conn :42 ][WARNING ][627] Unable to clear buffer - got unexpected value: 255
  5609. 2020-08-04 12:00:09,204 [gpio_spi_conn :42 ][WARNING ][627] Unable to clear buffer - got unexpected value: 255
  5610. 2020-08-04 12:00:09,929 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  5611. Traceback (most recent call last):
  5612. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5613. self._serial.open()
  5614. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5615. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5616. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5617. 2020-08-04 12:00:10,944 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  5618. Traceback (most recent call last):
  5619. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5620. self._serial.open()
  5621. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5622. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5623. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5624. 2020-08-04 12:00:11,234 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  5625. 2020-08-04 12:00:11,737 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  5626. 2020-08-04 12:00:11,948 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  5627. Traceback (most recent call last):
  5628. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5629. self._serial.open()
  5630. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5631. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5632. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5633. 2020-08-04 12:00:12,240 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  5634. 2020-08-04 12:00:12,246 [spm_conn :139 ][WARNING ][627] Unable to get status: Expected ack '12' but got '255'
  5635. 2020-08-04 12:00:12,651 [messaging :208 ][ERROR ][624] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  5636. Traceback (most recent call last):
  5637. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  5638. self._call_hook_for(message, "workflow", message)
  5639. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5640. return True, func(*args, **kwargs)
  5641. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  5642. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5643. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5644. return True, func(*args, **kwargs)
  5645. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5646. return func(*args, **kwargs)
  5647. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  5648. res = _exec("AT+CCLK?")
  5649. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  5650. conn.write_line(cmd)
  5651. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  5652. self.ensure_open()
  5653. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  5654. self.open()
  5655. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  5656. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  5657. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  5658. raise attempt.get()
  5659. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  5660. six.reraise(self.value[0], self.value[1], self.value[2])
  5661. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  5662. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  5663. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5664. self._serial.open()
  5665. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5666. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5667. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5668. 2020-08-04 12:00:12,768 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  5669. 2020-08-04 12:00:22,154 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][714] Timeout after 1.28205128205 second(s) waiting for interrupt
  5670. 2020-08-04 12:00:22,222 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  5671. Traceback (most recent call last):
  5672. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5673. self._serial.open()
  5674. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5675. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5676. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5677. 2020-08-04 12:00:22,278 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  5678. 2020-08-04 12:00:22,781 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  5679. 2020-08-04 12:00:22,784 [spm_conn :139 ][WARNING ][627] Unable to get status: Expected ack '12' but got '255'
  5680. 2020-08-04 12:00:23,227 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  5681. Traceback (most recent call last):
  5682. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5683. self._serial.open()
  5684. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5685. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5686. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5687. 2020-08-04 12:00:23,288 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  5688. 2020-08-04 12:00:23,792 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  5689. 2020-08-04 12:00:24,231 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  5690. Traceback (most recent call last):
  5691. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5692. self._serial.open()
  5693. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5694. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5695. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5696. 2020-08-04 12:00:24,235 [messaging :206 ][ERROR ][624] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  5697. Traceback (most recent call last):
  5698. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  5699. self._call_hook_for(message, "workflow", message)
  5700. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5701. return True, func(*args, **kwargs)
  5702. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  5703. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5704. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5705. return True, func(*args, **kwargs)
  5706. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5707. return func(*args, **kwargs)
  5708. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  5709. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  5710. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  5711. conn.write_line(cmd)
  5712. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  5713. self.ensure_open()
  5714. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  5715. self.open()
  5716. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  5717. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  5718. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  5719. raise attempt.get()
  5720. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  5721. six.reraise(self.value[0], self.value[1], self.value[2])
  5722. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  5723. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  5724. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5725. self._serial.open()
  5726. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5727. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5728. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5729. 2020-08-04 12:00:24,295 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  5730. 2020-08-04 12:00:24,298 [spm_conn :139 ][WARNING ][627] Unable to get status: Expected ack '12' but got '255'
  5731. 2020-08-04 12:00:24,302 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  5732. 2020-08-04 12:00:24,805 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  5733. 2020-08-04 12:00:25,309 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  5734. 2020-08-04 12:00:25,311 [spm_conn :82 ][WARNING ][627] Unable to send noop: Expected ack '12' but got '255'
  5735. 2020-08-04 12:00:25,816 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  5736. 2020-08-04 12:00:25,923 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  5737. Traceback (most recent call last):
  5738. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5739. self._serial.open()
  5740. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5741. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5742. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5743. 2020-08-04 12:00:26,319 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  5744. 2020-08-04 12:00:26,822 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  5745. 2020-08-04 12:00:26,825 [spm_conn :82 ][WARNING ][627] Unable to send noop: Expected ack '12' but got '255'
  5746. 2020-08-04 12:00:26,928 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  5747. Traceback (most recent call last):
  5748. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5749. self._serial.open()
  5750. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5751. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5752. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5753. 2020-08-04 12:00:27,330 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  5754. 2020-08-04 12:00:27,833 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  5755. 2020-08-04 12:00:27,932 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  5756. Traceback (most recent call last):
  5757. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5758. self._serial.open()
  5759. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5760. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5761. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5762. 2020-08-04 12:00:27,935 [messaging :742 ][ERROR ][624] Exception while processing event: {'tag': 'ec2x/req/754736bb-d541-4c00-bd63-35133bb38b87', 'data': {'_stamp': '2020-08-04T12:00:09.245470', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/754736bb-d541-4c00-bd63-35133bb38b87', 'kwargs': {'cooldown_delay': None}}}
  5763. Traceback (most recent call last):
  5764. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  5765. res = self.process(message)
  5766. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  5767. result = func(message, **settings)
  5768. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  5769. found, result = self._call_hook_for(message, "workflow", message)
  5770. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5771. return True, func(*args, **kwargs)
  5772. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  5773. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5774. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5775. return True, func(*args, **kwargs)
  5776. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5777. return func(*args, **kwargs)
  5778. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  5779. return _exec(cmd, **kwargs)
  5780. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  5781. conn.write_line(cmd)
  5782. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  5783. self.ensure_open()
  5784. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  5785. self.open()
  5786. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  5787. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  5788. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  5789. raise attempt.get()
  5790. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  5791. six.reraise(self.value[0], self.value[1], self.value[2])
  5792. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  5793. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  5794. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5795. self._serial.open()
  5796. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5797. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5798. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5799. 2020-08-04 12:00:28,337 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  5800. 2020-08-04 12:00:28,339 [spm_conn :82 ][WARNING ][627] Unable to send noop: Expected ack '12' but got '255'
  5801. 2020-08-04 12:00:28,341 [messaging :208 ][ERROR ][627] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  5802. Traceback (most recent call last):
  5803. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  5804. self._call_hook_for(message, "workflow", message)
  5805. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5806. return True, func(*args, **kwargs)
  5807. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  5808. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5809. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5810. return True, func(*args, **kwargs)
  5811. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5812. return func(*args, **kwargs)
  5813. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  5814. conn.heartbeat()
  5815. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  5816. self.noop()
  5817. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  5818. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  5819. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  5820. raise attempt.get()
  5821. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  5822. six.reraise(self.value[0], self.value[1], self.value[2])
  5823. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  5824. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  5825. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  5826. self._begin_message()
  5827. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  5828. self.recv(ack=ACK_MESSAGE_BEGIN)
  5829. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  5830. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  5831. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  5832. raise attempt.get()
  5833. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  5834. six.reraise(self.value[0], self.value[1], self.value[2])
  5835. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  5836. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  5837. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  5838. raise Exception(msg)
  5839. Exception: Expected ack '12' but got '255'
  5840. 2020-08-04 12:00:30,850 [messaging :208 ][ERROR ][625] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  5841. Traceback (most recent call last):
  5842. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  5843. self._call_hook_for(message, "workflow", message)
  5844. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5845. return True, func(*args, **kwargs)
  5846. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  5847. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5848. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5849. return True, func(*args, **kwargs)
  5850. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5851. return func(*args, **kwargs)
  5852. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  5853. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  5854. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  5855. res = query("AT+QGPSLOC={:d}".format(mode))
  5856. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  5857. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  5858. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  5859. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  5860. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  5861. raise salt.exceptions.CommandExecutionError(message["error"])
  5862. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5863. 2020-08-04 12:00:35,913 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  5864. Traceback (most recent call last):
  5865. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5866. self._serial.open()
  5867. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5868. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5869. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5870. 2020-08-04 12:00:36,934 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  5871. Traceback (most recent call last):
  5872. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5873. self._serial.open()
  5874. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5875. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5876. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5877. 2020-08-04 12:00:37,938 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  5878. Traceback (most recent call last):
  5879. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5880. self._serial.open()
  5881. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5882. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5883. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5884. 2020-08-04 12:00:37,942 [messaging :742 ][ERROR ][624] Exception while processing event: {'tag': 'ec2x/req/8250992e-f299-42cd-8fd2-8cffa3c0dc6e', 'data': {'_stamp': '2020-08-04T12:00:35.906359', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/8250992e-f299-42cd-8fd2-8cffa3c0dc6e', 'kwargs': {'cooldown_delay': None}}}
  5885. Traceback (most recent call last):
  5886. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  5887. res = self.process(message)
  5888. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  5889. result = func(message, **settings)
  5890. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  5891. found, result = self._call_hook_for(message, "workflow", message)
  5892. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5893. return True, func(*args, **kwargs)
  5894. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  5895. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5896. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5897. return True, func(*args, **kwargs)
  5898. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5899. return func(*args, **kwargs)
  5900. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  5901. return _exec(cmd, **kwargs)
  5902. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  5903. conn.write_line(cmd)
  5904. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  5905. self.ensure_open()
  5906. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  5907. self.open()
  5908. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  5909. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  5910. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  5911. raise attempt.get()
  5912. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  5913. six.reraise(self.value[0], self.value[1], self.value[2])
  5914. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  5915. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  5916. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  5917. self._serial.open()
  5918. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  5919. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  5920. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5921. 2020-08-04 12:00:37,965 [messaging :206 ][ERROR ][625] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  5922. Traceback (most recent call last):
  5923. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  5924. self._call_hook_for(message, "workflow", message)
  5925. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5926. return True, func(*args, **kwargs)
  5927. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  5928. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5929. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5930. return True, func(*args, **kwargs)
  5931. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5932. return func(*args, **kwargs)
  5933. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  5934. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  5935. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  5936. res = query("AT+QGPSLOC={:d}".format(mode))
  5937. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  5938. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  5939. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  5940. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  5941. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  5942. raise salt.exceptions.CommandExecutionError(message["error"])
  5943. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  5944. 2020-08-04 12:00:41,536 [obd.obd :107 ][ERROR ][713] Failed to use explicit port '/dev/serial0'
  5945. Traceback (most recent call last):
  5946. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  5947. self.interface.open(baudrate, protocol=protocol)
  5948. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  5949. self.set_protocol(prot.pop("id", None), **prot)
  5950. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  5951. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  5952. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  5953. self._protocol = self._auto_protocol(**kwargs)
  5954. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  5955. res_0100 = self._verify_protocol("auto", test=not verify)
  5956. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  5957. for line in self.query("0100", parse=False, read_timeout=10):
  5958. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  5959. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  5960. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  5961. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  5962. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  5963. data = self._port.read(self._port.in_waiting or 1)
  5964. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  5965. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  5966. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  5967. sys.exit(salt.defaults.exitcodes.EX_OK)
  5968. SystemExit: 0
  5969. 2020-08-04 12:00:41,561 [obd.obd :120 ][WARNING ][713] Cannot load commands - no connection to bus
  5970. 2020-08-04 12:00:41,586 [obd.interfaces.elm327:730 ][ERROR ][713] Failed to relay command 'STSLCS' to interface
  5971. Traceback (most recent call last):
  5972. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  5973. lines = self.send(cmd, raw_response=raw_response)
  5974. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  5975. raise ELM327Error(self.ERRORS[line], code=line)
  5976. ELM327Error: Operation interrupted by a received RS232 character
  5977. 2020-08-04 12:00:41,589 [messaging :742 ][ERROR ][713] Exception while processing event: {'tag': 'obd/req/782aee0d-1356-4bba-a2ce-0dc67baa1a40', 'data': {'_stamp': '2020-08-04T12:00:35.988865', 'handler': 'execute', '_event_tag': 'obd/req/782aee0d-1356-4bba-a2ce-0dc67baa1a40', 'args': ['STSLCS']}}
  5978. Traceback (most recent call last):
  5979. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  5980. res = self.process(message)
  5981. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  5982. result = func(message, **settings)
  5983. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  5984. found, result = self._call_hook_for(message, "workflow", message)
  5985. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5986. return True, func(*args, **kwargs)
  5987. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  5988. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  5989. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  5990. return True, func(*args, **kwargs)
  5991. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  5992. return func(*args, **kwargs)
  5993. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  5994. res = conn.execute(cmd)
  5995. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  5996. return func(self, *args, **kwargs)
  5997. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  5998. return self._obd.execute(cmd, **kwargs)
  5999. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  6000. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  6001. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  6002. lines = self.send(cmd, raw_response=raw_response)
  6003. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  6004. raise ELM327Error(self.ERRORS[line], code=line)
  6005. ELM327Error: Operation interrupted by a received RS232 character
  6006. 2020-08-04 12:00:42,310 [salt.utils.parsers:1050][WARNING ][424] Minion received a SIGTERM. Exiting.
  6007. 2020-08-04 12:00:42,851 [messaging :871 ][WARNING ][841] No reply message with tag 'obd/res/782aee0d-1356-4bba-a2ce-0dc67baa1a40' received within timeout of 30 secs
  6008. 2020-08-04 12:00:42,855 [salt.state :292 ][ERROR ][841] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  6009. 2020-08-04 12:01:00,167 [gpio_spi_conn :42 ][WARNING ][629] Unable to clear buffer - got unexpected value: 255
  6010. 2020-08-04 12:01:00,182 [gpio_spi_conn :42 ][WARNING ][629] Unable to clear buffer - got unexpected value: 255
  6011. 2020-08-04 12:01:00,185 [gpio_spi_conn :42 ][WARNING ][629] Unable to clear buffer - got unexpected value: 255
  6012. 2020-08-04 12:01:00,912 [serial_conn :79 ][ERROR ][626] Failed to open serial connection
  6013. Traceback (most recent call last):
  6014. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6015. self._serial.open()
  6016. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6017. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6018. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6019. 2020-08-04 12:01:01,926 [serial_conn :79 ][ERROR ][626] Failed to open serial connection
  6020. Traceback (most recent call last):
  6021. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6022. self._serial.open()
  6023. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6024. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6025. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6026. 2020-08-04 12:01:02,210 [gpio_spi_conn :109 ][WARNING ][629] Expected ack '12' but got '255'
  6027. 2020-08-04 12:01:02,713 [gpio_spi_conn :109 ][WARNING ][629] Expected ack '12' but got '255'
  6028. 2020-08-04 12:01:02,930 [serial_conn :79 ][ERROR ][626] Failed to open serial connection
  6029. Traceback (most recent call last):
  6030. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6031. self._serial.open()
  6032. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6033. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6034. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6035. 2020-08-04 12:01:03,216 [gpio_spi_conn :109 ][WARNING ][629] Expected ack '12' but got '255'
  6036. 2020-08-04 12:01:03,219 [spm_conn :139 ][WARNING ][629] Unable to get status: Expected ack '12' but got '255'
  6037. 2020-08-04 12:01:03,511 [messaging :208 ][ERROR ][626] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  6038. Traceback (most recent call last):
  6039. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  6040. self._call_hook_for(message, "workflow", message)
  6041. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6042. return True, func(*args, **kwargs)
  6043. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  6044. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6045. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6046. return True, func(*args, **kwargs)
  6047. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6048. return func(*args, **kwargs)
  6049. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  6050. res = _exec("AT+CCLK?")
  6051. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  6052. conn.write_line(cmd)
  6053. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  6054. self.ensure_open()
  6055. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  6056. self.open()
  6057. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  6058. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  6059. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  6060. raise attempt.get()
  6061. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  6062. six.reraise(self.value[0], self.value[1], self.value[2])
  6063. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  6064. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  6065. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6066. self._serial.open()
  6067. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6068. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6069. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6070. 2020-08-04 12:01:03,727 [gpio_spi_conn :109 ][WARNING ][629] Expected ack '12' but got '255'
  6071. 2020-08-04 12:01:18,093 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][666] Timeout after 1.28205128205 second(s) waiting for interrupt
  6072. 2020-08-04 12:01:18,159 [serial_conn :79 ][ERROR ][626] Failed to open serial connection
  6073. Traceback (most recent call last):
  6074. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6075. self._serial.open()
  6076. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6077. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6078. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6079. 2020-08-04 12:01:18,333 [gpio_spi_conn :109 ][WARNING ][629] Expected ack '12' but got '255'
  6080. 2020-08-04 12:01:18,836 [gpio_spi_conn :109 ][WARNING ][629] Expected ack '12' but got '255'
  6081. 2020-08-04 12:01:18,841 [spm_conn :139 ][WARNING ][629] Unable to get status: Expected ack '12' but got '255'
  6082. 2020-08-04 12:01:19,164 [serial_conn :79 ][ERROR ][626] Failed to open serial connection
  6083. Traceback (most recent call last):
  6084. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6085. self._serial.open()
  6086. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6087. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6088. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6089. 2020-08-04 12:01:19,347 [gpio_spi_conn :109 ][WARNING ][629] Expected ack '12' but got '255'
  6090. 2020-08-04 12:01:19,852 [gpio_spi_conn :109 ][WARNING ][629] Expected ack '12' but got '255'
  6091. 2020-08-04 12:01:20,168 [serial_conn :79 ][ERROR ][626] Failed to open serial connection
  6092. Traceback (most recent call last):
  6093. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6094. self._serial.open()
  6095. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6096. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6097. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6098. 2020-08-04 12:01:20,182 [messaging :206 ][ERROR ][626] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  6099. Traceback (most recent call last):
  6100. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  6101. self._call_hook_for(message, "workflow", message)
  6102. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6103. return True, func(*args, **kwargs)
  6104. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  6105. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6106. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6107. return True, func(*args, **kwargs)
  6108. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6109. return func(*args, **kwargs)
  6110. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  6111. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  6112. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  6113. conn.write_line(cmd)
  6114. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  6115. self.ensure_open()
  6116. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  6117. self.open()
  6118. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  6119. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  6120. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  6121. raise attempt.get()
  6122. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  6123. six.reraise(self.value[0], self.value[1], self.value[2])
  6124. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  6125. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  6126. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6127. self._serial.open()
  6128. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6129. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6130. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6131. 2020-08-04 12:01:20,356 [gpio_spi_conn :109 ][WARNING ][629] Expected ack '12' but got '255'
  6132. 2020-08-04 12:01:20,358 [spm_conn :139 ][WARNING ][629] Unable to get status: Expected ack '12' but got '255'
  6133. 2020-08-04 12:01:20,362 [gpio_spi_conn :109 ][WARNING ][629] Expected ack '12' but got '255'
  6134. 2020-08-04 12:01:20,865 [gpio_spi_conn :109 ][WARNING ][629] Expected ack '12' but got '255'
  6135. 2020-08-04 12:01:21,369 [gpio_spi_conn :109 ][WARNING ][629] Expected ack '12' but got '255'
  6136. 2020-08-04 12:01:21,371 [spm_conn :82 ][WARNING ][629] Unable to send noop: Expected ack '12' but got '255'
  6137. 2020-08-04 12:01:21,874 [gpio_spi_conn :109 ][WARNING ][629] Expected ack '12' but got '255'
  6138. 2020-08-04 12:01:21,897 [serial_conn :79 ][ERROR ][626] Failed to open serial connection
  6139. Traceback (most recent call last):
  6140. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6141. self._serial.open()
  6142. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6143. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6144. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6145. 2020-08-04 12:01:22,379 [gpio_spi_conn :109 ][WARNING ][629] Expected ack '12' but got '255'
  6146. 2020-08-04 12:01:22,882 [gpio_spi_conn :109 ][WARNING ][629] Expected ack '12' but got '255'
  6147. 2020-08-04 12:01:22,885 [spm_conn :82 ][WARNING ][629] Unable to send noop: Expected ack '12' but got '255'
  6148. 2020-08-04 12:01:22,920 [serial_conn :79 ][ERROR ][626] Failed to open serial connection
  6149. Traceback (most recent call last):
  6150. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6151. self._serial.open()
  6152. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6153. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6154. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6155. 2020-08-04 12:01:23,389 [gpio_spi_conn :109 ][WARNING ][629] Expected ack '12' but got '255'
  6156. 2020-08-04 12:01:23,892 [gpio_spi_conn :109 ][WARNING ][629] Expected ack '12' but got '255'
  6157. 2020-08-04 12:01:23,924 [serial_conn :79 ][ERROR ][626] Failed to open serial connection
  6158. Traceback (most recent call last):
  6159. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6160. self._serial.open()
  6161. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6162. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6163. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6164. 2020-08-04 12:01:23,928 [messaging :742 ][ERROR ][626] Exception while processing event: {'tag': 'ec2x/req/9a7ece2e-d214-48e4-813c-90fab714589e', 'data': {'_stamp': '2020-08-04T12:01:00.233161', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/9a7ece2e-d214-48e4-813c-90fab714589e', 'kwargs': {'cooldown_delay': None}}}
  6165. Traceback (most recent call last):
  6166. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  6167. res = self.process(message)
  6168. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  6169. result = func(message, **settings)
  6170. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  6171. found, result = self._call_hook_for(message, "workflow", message)
  6172. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6173. return True, func(*args, **kwargs)
  6174. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  6175. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6176. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6177. return True, func(*args, **kwargs)
  6178. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6179. return func(*args, **kwargs)
  6180. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  6181. return _exec(cmd, **kwargs)
  6182. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  6183. conn.write_line(cmd)
  6184. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  6185. self.ensure_open()
  6186. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  6187. self.open()
  6188. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  6189. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  6190. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  6191. raise attempt.get()
  6192. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  6193. six.reraise(self.value[0], self.value[1], self.value[2])
  6194. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  6195. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  6196. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6197. self._serial.open()
  6198. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6199. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6200. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6201. 2020-08-04 12:01:24,402 [gpio_spi_conn :109 ][WARNING ][629] Expected ack '12' but got '255'
  6202. 2020-08-04 12:01:24,404 [spm_conn :82 ][WARNING ][629] Unable to send noop: Expected ack '12' but got '255'
  6203. 2020-08-04 12:01:24,407 [messaging :208 ][ERROR ][629] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  6204. Traceback (most recent call last):
  6205. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  6206. self._call_hook_for(message, "workflow", message)
  6207. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6208. return True, func(*args, **kwargs)
  6209. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  6210. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6211. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6212. return True, func(*args, **kwargs)
  6213. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6214. return func(*args, **kwargs)
  6215. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  6216. conn.heartbeat()
  6217. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  6218. self.noop()
  6219. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  6220. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  6221. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  6222. raise attempt.get()
  6223. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  6224. six.reraise(self.value[0], self.value[1], self.value[2])
  6225. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  6226. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  6227. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  6228. self._begin_message()
  6229. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  6230. self.recv(ack=ACK_MESSAGE_BEGIN)
  6231. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  6232. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  6233. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  6234. raise attempt.get()
  6235. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  6236. six.reraise(self.value[0], self.value[1], self.value[2])
  6237. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  6238. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  6239. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  6240. raise Exception(msg)
  6241. Exception: Expected ack '12' but got '255'
  6242. 2020-08-04 12:01:26,270 [messaging :208 ][ERROR ][627] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  6243. Traceback (most recent call last):
  6244. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  6245. self._call_hook_for(message, "workflow", message)
  6246. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6247. return True, func(*args, **kwargs)
  6248. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  6249. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6250. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6251. return True, func(*args, **kwargs)
  6252. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6253. return func(*args, **kwargs)
  6254. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  6255. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  6256. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  6257. res = query("AT+QGPSLOC={:d}".format(mode))
  6258. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  6259. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  6260. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  6261. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  6262. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  6263. raise salt.exceptions.CommandExecutionError(message["error"])
  6264. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6265. 2020-08-04 12:01:31,327 [serial_conn :79 ][ERROR ][626] Failed to open serial connection
  6266. Traceback (most recent call last):
  6267. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6268. self._serial.open()
  6269. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6270. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6271. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6272. 2020-08-04 12:01:32,332 [serial_conn :79 ][ERROR ][626] Failed to open serial connection
  6273. Traceback (most recent call last):
  6274. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6275. self._serial.open()
  6276. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6277. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6278. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6279. 2020-08-04 12:01:33,348 [serial_conn :79 ][ERROR ][626] Failed to open serial connection
  6280. Traceback (most recent call last):
  6281. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6282. self._serial.open()
  6283. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6284. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6285. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6286. 2020-08-04 12:01:33,353 [messaging :742 ][ERROR ][626] Exception while processing event: {'tag': 'ec2x/req/d544f92b-6bfa-41ca-81ef-7664e53da67e', 'data': {'_stamp': '2020-08-04T12:01:31.320690', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/d544f92b-6bfa-41ca-81ef-7664e53da67e', 'kwargs': {'cooldown_delay': None}}}
  6287. Traceback (most recent call last):
  6288. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  6289. res = self.process(message)
  6290. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  6291. result = func(message, **settings)
  6292. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  6293. found, result = self._call_hook_for(message, "workflow", message)
  6294. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6295. return True, func(*args, **kwargs)
  6296. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  6297. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6298. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6299. return True, func(*args, **kwargs)
  6300. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6301. return func(*args, **kwargs)
  6302. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  6303. return _exec(cmd, **kwargs)
  6304. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  6305. conn.write_line(cmd)
  6306. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  6307. self.ensure_open()
  6308. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  6309. self.open()
  6310. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  6311. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  6312. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  6313. raise attempt.get()
  6314. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  6315. six.reraise(self.value[0], self.value[1], self.value[2])
  6316. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  6317. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  6318. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6319. self._serial.open()
  6320. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6321. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6322. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6323. 2020-08-04 12:01:33,390 [messaging :206 ][ERROR ][627] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  6324. Traceback (most recent call last):
  6325. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  6326. self._call_hook_for(message, "workflow", message)
  6327. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6328. return True, func(*args, **kwargs)
  6329. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  6330. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6331. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6332. return True, func(*args, **kwargs)
  6333. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6334. return func(*args, **kwargs)
  6335. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  6336. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  6337. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  6338. res = query("AT+QGPSLOC={:d}".format(mode))
  6339. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  6340. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  6341. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  6342. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  6343. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  6344. raise salt.exceptions.CommandExecutionError(message["error"])
  6345. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6346. 2020-08-04 12:01:36,794 [obd.obd :107 ][ERROR ][665] Failed to use explicit port '/dev/serial0'
  6347. Traceback (most recent call last):
  6348. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  6349. self.interface.open(baudrate, protocol=protocol)
  6350. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  6351. self.set_protocol(prot.pop("id", None), **prot)
  6352. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  6353. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  6354. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  6355. self._protocol = self._auto_protocol(**kwargs)
  6356. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  6357. res_0100 = self._verify_protocol("auto", test=not verify)
  6358. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  6359. for line in self.query("0100", parse=False, read_timeout=10):
  6360. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  6361. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  6362. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  6363. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  6364. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  6365. data = self._port.read(self._port.in_waiting or 1)
  6366. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  6367. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  6368. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  6369. sys.exit(salt.defaults.exitcodes.EX_OK)
  6370. SystemExit: 0
  6371. 2020-08-04 12:01:36,819 [obd.obd :120 ][WARNING ][665] Cannot load commands - no connection to bus
  6372. 2020-08-04 12:01:36,848 [obd.interfaces.elm327:730 ][ERROR ][665] Failed to relay command 'STSLCS' to interface
  6373. Traceback (most recent call last):
  6374. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  6375. lines = self.send(cmd, raw_response=raw_response)
  6376. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  6377. raise ELM327Error(self.ERRORS[line], code=line)
  6378. ELM327Error: Operation interrupted by a received RS232 character
  6379. 2020-08-04 12:01:36,851 [messaging :742 ][ERROR ][665] Exception while processing event: {'tag': 'obd/req/9db543d5-d22c-4627-9c36-776ff814e157', 'data': {'_stamp': '2020-08-04T12:01:31.237327', 'handler': 'execute', '_event_tag': 'obd/req/9db543d5-d22c-4627-9c36-776ff814e157', 'args': ['STSLCS']}}
  6380. Traceback (most recent call last):
  6381. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  6382. res = self.process(message)
  6383. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  6384. result = func(message, **settings)
  6385. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  6386. found, result = self._call_hook_for(message, "workflow", message)
  6387. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6388. return True, func(*args, **kwargs)
  6389. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  6390. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6391. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6392. return True, func(*args, **kwargs)
  6393. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6394. return func(*args, **kwargs)
  6395. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  6396. res = conn.execute(cmd)
  6397. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  6398. return func(self, *args, **kwargs)
  6399. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  6400. return self._obd.execute(cmd, **kwargs)
  6401. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  6402. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  6403. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  6404. lines = self.send(cmd, raw_response=raw_response)
  6405. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  6406. raise ELM327Error(self.ERRORS[line], code=line)
  6407. ELM327Error: Operation interrupted by a received RS232 character
  6408. 2020-08-04 12:01:37,581 [salt.utils.parsers:1050][WARNING ][426] Minion received a SIGTERM. Exiting.
  6409. 2020-08-04 12:01:38,118 [messaging :871 ][WARNING ][826] No reply message with tag 'obd/res/9db543d5-d22c-4627-9c36-776ff814e157' received within timeout of 30 secs
  6410. 2020-08-04 12:01:38,122 [salt.state :292 ][ERROR ][826] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  6411. 2020-08-04 12:01:55,084 [gpio_spi_conn :42 ][WARNING ][623] Unable to clear buffer - got unexpected value: 255
  6412. 2020-08-04 12:01:55,093 [gpio_spi_conn :42 ][WARNING ][623] Unable to clear buffer - got unexpected value: 255
  6413. 2020-08-04 12:01:55,104 [gpio_spi_conn :42 ][WARNING ][623] Unable to clear buffer - got unexpected value: 255
  6414. 2020-08-04 12:01:55,798 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6415. Traceback (most recent call last):
  6416. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6417. self._serial.open()
  6418. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6419. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6420. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6421. 2020-08-04 12:01:56,814 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6422. Traceback (most recent call last):
  6423. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6424. self._serial.open()
  6425. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6426. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6427. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6428. 2020-08-04 12:01:57,144 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6429. 2020-08-04 12:01:57,647 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6430. 2020-08-04 12:01:57,818 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6431. Traceback (most recent call last):
  6432. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6433. self._serial.open()
  6434. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6435. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6436. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6437. 2020-08-04 12:01:58,150 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6438. 2020-08-04 12:01:58,152 [spm_conn :139 ][WARNING ][623] Unable to get status: Expected ack '12' but got '255'
  6439. 2020-08-04 12:01:58,436 [messaging :208 ][ERROR ][620] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  6440. Traceback (most recent call last):
  6441. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  6442. self._call_hook_for(message, "workflow", message)
  6443. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6444. return True, func(*args, **kwargs)
  6445. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  6446. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6447. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6448. return True, func(*args, **kwargs)
  6449. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6450. return func(*args, **kwargs)
  6451. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  6452. res = _exec("AT+CCLK?")
  6453. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  6454. conn.write_line(cmd)
  6455. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  6456. self.ensure_open()
  6457. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  6458. self.open()
  6459. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  6460. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  6461. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  6462. raise attempt.get()
  6463. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  6464. six.reraise(self.value[0], self.value[1], self.value[2])
  6465. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  6466. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  6467. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6468. self._serial.open()
  6469. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6470. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6471. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6472. 2020-08-04 12:01:58,657 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6473. 2020-08-04 12:02:13,286 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][660] Timeout after 1.28205128205 second(s) waiting for interrupt
  6474. 2020-08-04 12:02:13,332 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6475. Traceback (most recent call last):
  6476. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6477. self._serial.open()
  6478. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6479. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6480. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6481. 2020-08-04 12:02:13,569 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6482. 2020-08-04 12:02:14,072 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6483. 2020-08-04 12:02:14,075 [spm_conn :139 ][WARNING ][623] Unable to get status: Expected ack '12' but got '255'
  6484. 2020-08-04 12:02:14,337 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6485. Traceback (most recent call last):
  6486. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6487. self._serial.open()
  6488. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6489. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6490. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6491. 2020-08-04 12:02:14,579 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6492. 2020-08-04 12:02:15,082 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6493. 2020-08-04 12:02:15,341 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6494. Traceback (most recent call last):
  6495. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6496. self._serial.open()
  6497. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6498. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6499. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6500. 2020-08-04 12:02:15,344 [messaging :206 ][ERROR ][620] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  6501. Traceback (most recent call last):
  6502. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  6503. self._call_hook_for(message, "workflow", message)
  6504. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6505. return True, func(*args, **kwargs)
  6506. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  6507. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6508. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6509. return True, func(*args, **kwargs)
  6510. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6511. return func(*args, **kwargs)
  6512. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  6513. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  6514. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  6515. conn.write_line(cmd)
  6516. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  6517. self.ensure_open()
  6518. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  6519. self.open()
  6520. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  6521. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  6522. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  6523. raise attempt.get()
  6524. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  6525. six.reraise(self.value[0], self.value[1], self.value[2])
  6526. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  6527. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  6528. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6529. self._serial.open()
  6530. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6531. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6532. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6533. 2020-08-04 12:02:15,585 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6534. 2020-08-04 12:02:15,587 [spm_conn :139 ][WARNING ][623] Unable to get status: Expected ack '12' but got '255'
  6535. 2020-08-04 12:02:15,591 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6536. 2020-08-04 12:02:16,094 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6537. 2020-08-04 12:02:16,597 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6538. 2020-08-04 12:02:16,599 [spm_conn :82 ][WARNING ][623] Unable to send noop: Expected ack '12' but got '255'
  6539. 2020-08-04 12:02:17,103 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6540. 2020-08-04 12:02:17,155 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6541. Traceback (most recent call last):
  6542. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6543. self._serial.open()
  6544. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6545. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6546. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6547. 2020-08-04 12:02:17,608 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6548. 2020-08-04 12:02:18,111 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6549. 2020-08-04 12:02:18,113 [spm_conn :82 ][WARNING ][623] Unable to send noop: Expected ack '12' but got '255'
  6550. 2020-08-04 12:02:18,207 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6551. Traceback (most recent call last):
  6552. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6553. self._serial.open()
  6554. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6555. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6556. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6557. 2020-08-04 12:02:18,617 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6558. 2020-08-04 12:02:19,120 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6559. 2020-08-04 12:02:19,211 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6560. Traceback (most recent call last):
  6561. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6562. self._serial.open()
  6563. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6564. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6565. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6566. 2020-08-04 12:02:19,215 [messaging :742 ][ERROR ][620] Exception while processing event: {'tag': 'ec2x/req/c1c7829c-0f64-4b14-a3dc-899d4a5395fb', 'data': {'_stamp': '2020-08-04T12:01:55.151145', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/c1c7829c-0f64-4b14-a3dc-899d4a5395fb', 'kwargs': {'cooldown_delay': None}}}
  6567. Traceback (most recent call last):
  6568. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  6569. res = self.process(message)
  6570. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  6571. result = func(message, **settings)
  6572. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  6573. found, result = self._call_hook_for(message, "workflow", message)
  6574. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6575. return True, func(*args, **kwargs)
  6576. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  6577. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6578. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6579. return True, func(*args, **kwargs)
  6580. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6581. return func(*args, **kwargs)
  6582. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  6583. return _exec(cmd, **kwargs)
  6584. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  6585. conn.write_line(cmd)
  6586. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  6587. self.ensure_open()
  6588. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  6589. self.open()
  6590. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  6591. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  6592. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  6593. raise attempt.get()
  6594. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  6595. six.reraise(self.value[0], self.value[1], self.value[2])
  6596. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  6597. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  6598. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6599. self._serial.open()
  6600. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6601. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6602. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6603. 2020-08-04 12:02:19,630 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6604. 2020-08-04 12:02:19,632 [spm_conn :82 ][WARNING ][623] Unable to send noop: Expected ack '12' but got '255'
  6605. 2020-08-04 12:02:19,636 [messaging :208 ][ERROR ][623] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  6606. Traceback (most recent call last):
  6607. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  6608. self._call_hook_for(message, "workflow", message)
  6609. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6610. return True, func(*args, **kwargs)
  6611. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  6612. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6613. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6614. return True, func(*args, **kwargs)
  6615. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6616. return func(*args, **kwargs)
  6617. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  6618. conn.heartbeat()
  6619. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  6620. self.noop()
  6621. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  6622. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  6623. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  6624. raise attempt.get()
  6625. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  6626. six.reraise(self.value[0], self.value[1], self.value[2])
  6627. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  6628. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  6629. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  6630. self._begin_message()
  6631. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  6632. self.recv(ack=ACK_MESSAGE_BEGIN)
  6633. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  6634. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  6635. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  6636. raise attempt.get()
  6637. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  6638. six.reraise(self.value[0], self.value[1], self.value[2])
  6639. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  6640. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  6641. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  6642. raise Exception(msg)
  6643. Exception: Expected ack '12' but got '255'
  6644. 2020-08-04 12:02:21,333 [messaging :208 ][ERROR ][621] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  6645. Traceback (most recent call last):
  6646. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  6647. self._call_hook_for(message, "workflow", message)
  6648. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6649. return True, func(*args, **kwargs)
  6650. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  6651. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6652. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6653. return True, func(*args, **kwargs)
  6654. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6655. return func(*args, **kwargs)
  6656. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  6657. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  6658. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  6659. res = query("AT+QGPSLOC={:d}".format(mode))
  6660. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  6661. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  6662. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  6663. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  6664. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  6665. raise salt.exceptions.CommandExecutionError(message["error"])
  6666. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6667. 2020-08-04 12:02:26,412 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6668. Traceback (most recent call last):
  6669. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6670. self._serial.open()
  6671. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6672. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6673. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6674. 2020-08-04 12:02:27,429 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6675. Traceback (most recent call last):
  6676. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6677. self._serial.open()
  6678. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6679. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6680. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6681. 2020-08-04 12:02:28,432 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6682. Traceback (most recent call last):
  6683. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6684. self._serial.open()
  6685. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6686. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6687. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6688. 2020-08-04 12:02:28,436 [messaging :742 ][ERROR ][620] Exception while processing event: {'tag': 'ec2x/req/9ac4b8f6-2527-4cb5-8ad0-931fb9d203a0', 'data': {'_stamp': '2020-08-04T12:02:26.405589', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/9ac4b8f6-2527-4cb5-8ad0-931fb9d203a0', 'kwargs': {'cooldown_delay': None}}}
  6689. Traceback (most recent call last):
  6690. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  6691. res = self.process(message)
  6692. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  6693. result = func(message, **settings)
  6694. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  6695. found, result = self._call_hook_for(message, "workflow", message)
  6696. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6697. return True, func(*args, **kwargs)
  6698. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  6699. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6700. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6701. return True, func(*args, **kwargs)
  6702. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6703. return func(*args, **kwargs)
  6704. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  6705. return _exec(cmd, **kwargs)
  6706. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  6707. conn.write_line(cmd)
  6708. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  6709. self.ensure_open()
  6710. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  6711. self.open()
  6712. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  6713. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  6714. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  6715. raise attempt.get()
  6716. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  6717. six.reraise(self.value[0], self.value[1], self.value[2])
  6718. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  6719. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  6720. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6721. self._serial.open()
  6722. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6723. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6724. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6725. 2020-08-04 12:02:28,467 [messaging :206 ][ERROR ][621] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  6726. Traceback (most recent call last):
  6727. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  6728. self._call_hook_for(message, "workflow", message)
  6729. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6730. return True, func(*args, **kwargs)
  6731. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  6732. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6733. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6734. return True, func(*args, **kwargs)
  6735. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6736. return func(*args, **kwargs)
  6737. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  6738. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  6739. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  6740. res = query("AT+QGPSLOC={:d}".format(mode))
  6741. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  6742. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  6743. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  6744. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  6745. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  6746. raise salt.exceptions.CommandExecutionError(message["error"])
  6747. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6748. 2020-08-04 12:02:31,726 [obd.obd :107 ][ERROR ][659] Failed to use explicit port '/dev/serial0'
  6749. Traceback (most recent call last):
  6750. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  6751. self.interface.open(baudrate, protocol=protocol)
  6752. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  6753. self.set_protocol(prot.pop("id", None), **prot)
  6754. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  6755. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  6756. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  6757. self._protocol = self._auto_protocol(**kwargs)
  6758. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  6759. res_0100 = self._verify_protocol("auto", test=not verify)
  6760. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  6761. for line in self.query("0100", parse=False, read_timeout=10):
  6762. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  6763. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  6764. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  6765. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  6766. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  6767. data = self._port.read(self._port.in_waiting or 1)
  6768. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  6769. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  6770. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  6771. sys.exit(salt.defaults.exitcodes.EX_OK)
  6772. SystemExit: 0
  6773. 2020-08-04 12:02:31,751 [obd.obd :120 ][WARNING ][659] Cannot load commands - no connection to bus
  6774. 2020-08-04 12:02:31,776 [obd.interfaces.elm327:730 ][ERROR ][659] Failed to relay command 'STSLCS' to interface
  6775. Traceback (most recent call last):
  6776. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  6777. lines = self.send(cmd, raw_response=raw_response)
  6778. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  6779. raise ELM327Error(self.ERRORS[line], code=line)
  6780. ELM327Error: Operation interrupted by a received RS232 character
  6781. 2020-08-04 12:02:31,779 [messaging :742 ][ERROR ][659] Exception while processing event: {'tag': 'obd/req/c7e00263-6c92-4401-9aee-2d7205c22901', 'data': {'_stamp': '2020-08-04T12:02:26.214945', 'handler': 'execute', '_event_tag': 'obd/req/c7e00263-6c92-4401-9aee-2d7205c22901', 'args': ['STSLCS']}}
  6782. Traceback (most recent call last):
  6783. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  6784. res = self.process(message)
  6785. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  6786. result = func(message, **settings)
  6787. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  6788. found, result = self._call_hook_for(message, "workflow", message)
  6789. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6790. return True, func(*args, **kwargs)
  6791. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  6792. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6793. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6794. return True, func(*args, **kwargs)
  6795. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6796. return func(*args, **kwargs)
  6797. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  6798. res = conn.execute(cmd)
  6799. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  6800. return func(self, *args, **kwargs)
  6801. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  6802. return self._obd.execute(cmd, **kwargs)
  6803. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  6804. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  6805. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  6806. lines = self.send(cmd, raw_response=raw_response)
  6807. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  6808. raise ELM327Error(self.ERRORS[line], code=line)
  6809. ELM327Error: Operation interrupted by a received RS232 character
  6810. 2020-08-04 12:02:32,516 [salt.utils.parsers:1050][WARNING ][419] Minion received a SIGTERM. Exiting.
  6811. 2020-08-04 12:02:33,056 [messaging :871 ][WARNING ][820] No reply message with tag 'obd/res/c7e00263-6c92-4401-9aee-2d7205c22901' received within timeout of 30 secs
  6812. 2020-08-04 12:02:33,060 [salt.state :292 ][ERROR ][820] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  6813. 2020-08-04 12:02:50,077 [gpio_spi_conn :42 ][WARNING ][623] Unable to clear buffer - got unexpected value: 255
  6814. 2020-08-04 12:02:50,095 [gpio_spi_conn :42 ][WARNING ][623] Unable to clear buffer - got unexpected value: 255
  6815. 2020-08-04 12:02:50,102 [gpio_spi_conn :42 ][WARNING ][623] Unable to clear buffer - got unexpected value: 255
  6816. 2020-08-04 12:02:50,709 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6817. Traceback (most recent call last):
  6818. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6819. self._serial.open()
  6820. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6821. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6822. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6823. 2020-08-04 12:02:51,721 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6824. Traceback (most recent call last):
  6825. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6826. self._serial.open()
  6827. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6828. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6829. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6830. 2020-08-04 12:02:52,139 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6831. 2020-08-04 12:02:52,643 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6832. 2020-08-04 12:02:52,725 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6833. Traceback (most recent call last):
  6834. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6835. self._serial.open()
  6836. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6837. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6838. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6839. 2020-08-04 12:02:53,146 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6840. 2020-08-04 12:02:53,149 [spm_conn :139 ][WARNING ][623] Unable to get status: Expected ack '12' but got '255'
  6841. 2020-08-04 12:02:53,303 [messaging :208 ][ERROR ][620] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  6842. Traceback (most recent call last):
  6843. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  6844. self._call_hook_for(message, "workflow", message)
  6845. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6846. return True, func(*args, **kwargs)
  6847. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  6848. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6849. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6850. return True, func(*args, **kwargs)
  6851. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6852. return func(*args, **kwargs)
  6853. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  6854. res = _exec("AT+CCLK?")
  6855. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  6856. conn.write_line(cmd)
  6857. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  6858. self.ensure_open()
  6859. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  6860. self.open()
  6861. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  6862. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  6863. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  6864. raise attempt.get()
  6865. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  6866. six.reraise(self.value[0], self.value[1], self.value[2])
  6867. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  6868. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  6869. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6870. self._serial.open()
  6871. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6872. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6873. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6874. 2020-08-04 12:02:53,654 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6875. 2020-08-04 12:03:08,065 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][711] Timeout after 1.28205128205 second(s) waiting for interrupt
  6876. 2020-08-04 12:03:08,171 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6877. Traceback (most recent call last):
  6878. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6879. self._serial.open()
  6880. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6881. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6882. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6883. 2020-08-04 12:03:08,505 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6884. 2020-08-04 12:03:09,010 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6885. 2020-08-04 12:03:09,014 [spm_conn :139 ][WARNING ][623] Unable to get status: Expected ack '12' but got '255'
  6886. 2020-08-04 12:03:09,176 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6887. Traceback (most recent call last):
  6888. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6889. self._serial.open()
  6890. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6891. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6892. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6893. 2020-08-04 12:03:09,520 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6894. 2020-08-04 12:03:10,025 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6895. 2020-08-04 12:03:10,180 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6896. Traceback (most recent call last):
  6897. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6898. self._serial.open()
  6899. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6900. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6901. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6902. 2020-08-04 12:03:10,194 [messaging :206 ][ERROR ][620] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  6903. Traceback (most recent call last):
  6904. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  6905. self._call_hook_for(message, "workflow", message)
  6906. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6907. return True, func(*args, **kwargs)
  6908. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  6909. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6910. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6911. return True, func(*args, **kwargs)
  6912. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6913. return func(*args, **kwargs)
  6914. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  6915. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  6916. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  6917. conn.write_line(cmd)
  6918. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  6919. self.ensure_open()
  6920. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  6921. self.open()
  6922. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  6923. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  6924. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  6925. raise attempt.get()
  6926. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  6927. six.reraise(self.value[0], self.value[1], self.value[2])
  6928. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  6929. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  6930. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6931. self._serial.open()
  6932. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6933. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6934. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6935. 2020-08-04 12:03:10,528 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6936. 2020-08-04 12:03:10,530 [spm_conn :139 ][WARNING ][623] Unable to get status: Expected ack '12' but got '255'
  6937. 2020-08-04 12:03:10,533 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6938. 2020-08-04 12:03:11,036 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6939. 2020-08-04 12:03:11,539 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6940. 2020-08-04 12:03:11,541 [spm_conn :82 ][WARNING ][623] Unable to send noop: Expected ack '12' but got '255'
  6941. 2020-08-04 12:03:11,977 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6942. Traceback (most recent call last):
  6943. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6944. self._serial.open()
  6945. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6946. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6947. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6948. 2020-08-04 12:03:12,045 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6949. 2020-08-04 12:03:12,550 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6950. 2020-08-04 12:03:12,981 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6951. Traceback (most recent call last):
  6952. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6953. self._serial.open()
  6954. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6955. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6956. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6957. 2020-08-04 12:03:13,053 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6958. 2020-08-04 12:03:13,056 [spm_conn :82 ][WARNING ][623] Unable to send noop: Expected ack '12' but got '255'
  6959. 2020-08-04 12:03:13,560 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  6960. 2020-08-04 12:03:13,985 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  6961. Traceback (most recent call last):
  6962. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  6963. self._serial.open()
  6964. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  6965. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  6966. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  6967. 2020-08-04 12:03:13,988 [messaging :742 ][ERROR ][620] Exception while processing event: {'tag': 'ec2x/req/4055ffa2-8a29-4e8d-96b2-79811ba9ac6b', 'data': {'_stamp': '2020-08-04T12:02:50.160890', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/4055ffa2-8a29-4e8d-96b2-79811ba9ac6b', 'kwargs': {'cooldown_delay': None}}}
  6968. Traceback (most recent call last):
  6969. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  6970. res = self.process(message)
  6971. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  6972. result = func(message, **settings)
  6973. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  6974. found, result = self._call_hook_for(message, "workflow", message)
  6975. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6976. return True, func(*args, **kwargs)
  6977. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  6978. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  6979. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  6980. return True, func(*args, **kwargs)
  6981. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  6982. return func(*args, **kwargs)
  6983. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  6984. return _exec(cmd, **kwargs)
  6985. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  6986. conn.write_line(cmd)
  6987. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  6988. self.ensure_open()
  6989. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  6990. self.open()
  6991. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  6992. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  6993. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  6994. raise attempt.get()
  6995. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  6996. six.reraise(self.value[0], self.value[1], self.value[2])
  6997. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  6998. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  6999. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7000. self._serial.open()
  7001. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7002. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7003. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7004. 2020-08-04 12:03:14,069 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  7005. 2020-08-04 12:03:14,572 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  7006. 2020-08-04 12:03:14,575 [spm_conn :82 ][WARNING ][623] Unable to send noop: Expected ack '12' but got '255'
  7007. 2020-08-04 12:03:14,578 [messaging :208 ][ERROR ][623] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  7008. Traceback (most recent call last):
  7009. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  7010. self._call_hook_for(message, "workflow", message)
  7011. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7012. return True, func(*args, **kwargs)
  7013. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  7014. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7015. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7016. return True, func(*args, **kwargs)
  7017. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7018. return func(*args, **kwargs)
  7019. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  7020. conn.heartbeat()
  7021. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  7022. self.noop()
  7023. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  7024. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  7025. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  7026. raise attempt.get()
  7027. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  7028. six.reraise(self.value[0], self.value[1], self.value[2])
  7029. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  7030. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  7031. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  7032. self._begin_message()
  7033. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  7034. self.recv(ack=ACK_MESSAGE_BEGIN)
  7035. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  7036. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  7037. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  7038. raise attempt.get()
  7039. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  7040. six.reraise(self.value[0], self.value[1], self.value[2])
  7041. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  7042. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  7043. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  7044. raise Exception(msg)
  7045. Exception: Expected ack '12' but got '255'
  7046. 2020-08-04 12:03:16,172 [messaging :208 ][ERROR ][621] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  7047. Traceback (most recent call last):
  7048. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  7049. self._call_hook_for(message, "workflow", message)
  7050. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7051. return True, func(*args, **kwargs)
  7052. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  7053. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7054. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7055. return True, func(*args, **kwargs)
  7056. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7057. return func(*args, **kwargs)
  7058. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  7059. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  7060. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  7061. res = query("AT+QGPSLOC={:d}".format(mode))
  7062. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  7063. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  7064. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  7065. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  7066. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  7067. raise salt.exceptions.CommandExecutionError(message["error"])
  7068. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7069. 2020-08-04 12:03:21,253 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  7070. Traceback (most recent call last):
  7071. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7072. self._serial.open()
  7073. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7074. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7075. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7076. 2020-08-04 12:03:22,258 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  7077. Traceback (most recent call last):
  7078. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7079. self._serial.open()
  7080. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7081. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7082. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7083. 2020-08-04 12:03:23,262 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  7084. Traceback (most recent call last):
  7085. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7086. self._serial.open()
  7087. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7088. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7089. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7090. 2020-08-04 12:03:23,264 [messaging :742 ][ERROR ][620] Exception while processing event: {'tag': 'ec2x/req/f7c17647-1a45-49df-a565-55b4f81fe868', 'data': {'_stamp': '2020-08-04T12:03:21.246714', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/f7c17647-1a45-49df-a565-55b4f81fe868', 'kwargs': {'cooldown_delay': None}}}
  7091. Traceback (most recent call last):
  7092. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  7093. res = self.process(message)
  7094. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  7095. result = func(message, **settings)
  7096. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  7097. found, result = self._call_hook_for(message, "workflow", message)
  7098. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7099. return True, func(*args, **kwargs)
  7100. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  7101. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7102. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7103. return True, func(*args, **kwargs)
  7104. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7105. return func(*args, **kwargs)
  7106. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  7107. return _exec(cmd, **kwargs)
  7108. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  7109. conn.write_line(cmd)
  7110. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  7111. self.ensure_open()
  7112. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  7113. self.open()
  7114. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  7115. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  7116. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  7117. raise attempt.get()
  7118. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  7119. six.reraise(self.value[0], self.value[1], self.value[2])
  7120. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  7121. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  7122. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7123. self._serial.open()
  7124. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7125. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7126. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7127. 2020-08-04 12:03:23,282 [messaging :206 ][ERROR ][621] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  7128. Traceback (most recent call last):
  7129. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  7130. self._call_hook_for(message, "workflow", message)
  7131. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7132. return True, func(*args, **kwargs)
  7133. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  7134. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7135. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7136. return True, func(*args, **kwargs)
  7137. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7138. return func(*args, **kwargs)
  7139. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  7140. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  7141. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  7142. res = query("AT+QGPSLOC={:d}".format(mode))
  7143. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  7144. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  7145. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  7146. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  7147. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  7148. raise salt.exceptions.CommandExecutionError(message["error"])
  7149. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7150. 2020-08-04 12:03:26,747 [obd.obd :107 ][ERROR ][710] Failed to use explicit port '/dev/serial0'
  7151. Traceback (most recent call last):
  7152. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  7153. self.interface.open(baudrate, protocol=protocol)
  7154. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  7155. self.set_protocol(prot.pop("id", None), **prot)
  7156. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  7157. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  7158. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  7159. self._protocol = self._auto_protocol(**kwargs)
  7160. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  7161. res_0100 = self._verify_protocol("auto", test=not verify)
  7162. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  7163. for line in self.query("0100", parse=False, read_timeout=10):
  7164. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  7165. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  7166. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  7167. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  7168. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  7169. data = self._port.read(self._port.in_waiting or 1)
  7170. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  7171. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  7172. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  7173. sys.exit(salt.defaults.exitcodes.EX_OK)
  7174. SystemExit: 0
  7175. 2020-08-04 12:03:26,771 [obd.obd :120 ][WARNING ][710] Cannot load commands - no connection to bus
  7176. 2020-08-04 12:03:26,796 [obd.interfaces.elm327:730 ][ERROR ][710] Failed to relay command 'STSLCS' to interface
  7177. Traceback (most recent call last):
  7178. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  7179. lines = self.send(cmd, raw_response=raw_response)
  7180. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  7181. raise ELM327Error(self.ERRORS[line], code=line)
  7182. ELM327Error: Operation interrupted by a received RS232 character
  7183. 2020-08-04 12:03:26,799 [messaging :742 ][ERROR ][710] Exception while processing event: {'tag': 'obd/req/0a87387a-1a0f-4ba4-804a-ed4b13b12f0d', 'data': {'_stamp': '2020-08-04T12:03:21.292693', 'handler': 'execute', '_event_tag': 'obd/req/0a87387a-1a0f-4ba4-804a-ed4b13b12f0d', 'args': ['STSLCS']}}
  7184. Traceback (most recent call last):
  7185. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  7186. res = self.process(message)
  7187. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  7188. result = func(message, **settings)
  7189. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  7190. found, result = self._call_hook_for(message, "workflow", message)
  7191. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7192. return True, func(*args, **kwargs)
  7193. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  7194. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7195. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7196. return True, func(*args, **kwargs)
  7197. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7198. return func(*args, **kwargs)
  7199. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  7200. res = conn.execute(cmd)
  7201. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  7202. return func(self, *args, **kwargs)
  7203. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  7204. return self._obd.execute(cmd, **kwargs)
  7205. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  7206. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  7207. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  7208. lines = self.send(cmd, raw_response=raw_response)
  7209. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  7210. raise ELM327Error(self.ERRORS[line], code=line)
  7211. ELM327Error: Operation interrupted by a received RS232 character
  7212. 2020-08-04 12:03:27,651 [salt.utils.parsers:1050][WARNING ][420] Minion received a SIGTERM. Exiting.
  7213. 2020-08-04 12:03:28,191 [messaging :871 ][WARNING ][820] No reply message with tag 'obd/res/0a87387a-1a0f-4ba4-804a-ed4b13b12f0d' received within timeout of 30 secs
  7214. 2020-08-04 12:03:28,195 [salt.state :292 ][ERROR ][820] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  7215. 2020-08-04 12:03:45,086 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  7216. 2020-08-04 12:03:45,093 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  7217. 2020-08-04 12:03:45,098 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  7218. 2020-08-04 12:03:45,769 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  7219. Traceback (most recent call last):
  7220. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7221. self._serial.open()
  7222. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7223. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7224. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7225. 2020-08-04 12:03:46,783 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  7226. Traceback (most recent call last):
  7227. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7228. self._serial.open()
  7229. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7230. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7231. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7232. 2020-08-04 12:03:47,126 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  7233. 2020-08-04 12:03:47,631 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  7234. 2020-08-04 12:03:47,787 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  7235. Traceback (most recent call last):
  7236. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7237. self._serial.open()
  7238. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7239. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7240. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7241. 2020-08-04 12:03:48,136 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  7242. 2020-08-04 12:03:48,139 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  7243. 2020-08-04 12:03:48,333 [messaging :208 ][ERROR ][616] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  7244. Traceback (most recent call last):
  7245. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  7246. self._call_hook_for(message, "workflow", message)
  7247. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7248. return True, func(*args, **kwargs)
  7249. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  7250. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7251. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7252. return True, func(*args, **kwargs)
  7253. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7254. return func(*args, **kwargs)
  7255. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  7256. res = _exec("AT+CCLK?")
  7257. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  7258. conn.write_line(cmd)
  7259. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  7260. self.ensure_open()
  7261. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  7262. self.open()
  7263. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  7264. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  7265. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  7266. raise attempt.get()
  7267. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  7268. six.reraise(self.value[0], self.value[1], self.value[2])
  7269. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  7270. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  7271. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7272. self._serial.open()
  7273. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7274. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7275. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7276. 2020-08-04 12:03:48,644 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  7277. 2020-08-04 12:03:49,149 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  7278. 2020-08-04 12:03:49,652 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  7279. 2020-08-04 12:03:49,657 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  7280. 2020-08-04 12:03:50,163 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  7281. 2020-08-04 12:03:50,685 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  7282. 2020-08-04 12:03:51,189 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  7283. 2020-08-04 12:03:51,192 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  7284. 2020-08-04 12:03:51,196 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  7285. 2020-08-04 12:03:51,699 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  7286. 2020-08-04 12:03:52,202 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  7287. 2020-08-04 12:03:52,206 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  7288. 2020-08-04 12:03:52,633 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  7289. Traceback (most recent call last):
  7290. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7291. self._serial.open()
  7292. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7293. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7294. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7295. 2020-08-04 12:03:52,710 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  7296. 2020-08-04 12:03:53,214 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  7297. 2020-08-04 12:03:53,638 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  7298. Traceback (most recent call last):
  7299. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7300. self._serial.open()
  7301. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7302. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7303. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7304. 2020-08-04 12:03:53,718 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  7305. 2020-08-04 12:03:53,720 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  7306. 2020-08-04 12:03:54,224 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  7307. 2020-08-04 12:03:54,642 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  7308. Traceback (most recent call last):
  7309. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7310. self._serial.open()
  7311. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7312. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7313. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7314. 2020-08-04 12:03:54,645 [messaging :742 ][ERROR ][616] Exception while processing event: {'tag': 'ec2x/req/1f80cfb7-6051-4742-a87c-4e1a083652b5', 'data': {'_stamp': '2020-08-04T12:03:45.164991', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/1f80cfb7-6051-4742-a87c-4e1a083652b5', 'kwargs': {'cooldown_delay': None}}}
  7315. Traceback (most recent call last):
  7316. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  7317. res = self.process(message)
  7318. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  7319. result = func(message, **settings)
  7320. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  7321. found, result = self._call_hook_for(message, "workflow", message)
  7322. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7323. return True, func(*args, **kwargs)
  7324. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  7325. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7326. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7327. return True, func(*args, **kwargs)
  7328. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7329. return func(*args, **kwargs)
  7330. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  7331. return _exec(cmd, **kwargs)
  7332. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  7333. conn.write_line(cmd)
  7334. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  7335. self.ensure_open()
  7336. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  7337. self.open()
  7338. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  7339. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  7340. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  7341. raise attempt.get()
  7342. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  7343. six.reraise(self.value[0], self.value[1], self.value[2])
  7344. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  7345. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  7346. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7347. self._serial.open()
  7348. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7349. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7350. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7351. 2020-08-04 12:03:54,727 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  7352. 2020-08-04 12:03:55,231 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  7353. 2020-08-04 12:03:55,233 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  7354. 2020-08-04 12:03:55,236 [messaging :208 ][ERROR ][619] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  7355. Traceback (most recent call last):
  7356. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  7357. self._call_hook_for(message, "workflow", message)
  7358. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7359. return True, func(*args, **kwargs)
  7360. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  7361. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7362. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7363. return True, func(*args, **kwargs)
  7364. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7365. return func(*args, **kwargs)
  7366. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  7367. conn.heartbeat()
  7368. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  7369. self.noop()
  7370. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  7371. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  7372. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  7373. raise attempt.get()
  7374. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  7375. six.reraise(self.value[0], self.value[1], self.value[2])
  7376. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  7377. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  7378. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  7379. self._begin_message()
  7380. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  7381. self.recv(ack=ACK_MESSAGE_BEGIN)
  7382. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  7383. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  7384. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  7385. raise attempt.get()
  7386. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  7387. six.reraise(self.value[0], self.value[1], self.value[2])
  7388. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  7389. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  7390. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  7391. raise Exception(msg)
  7392. Exception: Expected ack '12' but got '255'
  7393. 2020-08-04 12:03:55,359 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  7394. Traceback (most recent call last):
  7395. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7396. self._serial.open()
  7397. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7398. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7399. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7400. 2020-08-04 12:03:56,366 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  7401. Traceback (most recent call last):
  7402. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7403. self._serial.open()
  7404. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7405. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7406. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7407. 2020-08-04 12:03:57,293 [messaging :208 ][ERROR ][617] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  7408. Traceback (most recent call last):
  7409. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  7410. self._call_hook_for(message, "workflow", message)
  7411. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7412. return True, func(*args, **kwargs)
  7413. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  7414. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7415. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7416. return True, func(*args, **kwargs)
  7417. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7418. return func(*args, **kwargs)
  7419. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  7420. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  7421. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  7422. res = query("AT+QGPSLOC={:d}".format(mode))
  7423. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  7424. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  7425. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  7426. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  7427. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  7428. raise salt.exceptions.CommandExecutionError(message["error"])
  7429. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7430. 2020-08-04 12:03:57,372 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  7431. Traceback (most recent call last):
  7432. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7433. self._serial.open()
  7434. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7435. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7436. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7437. 2020-08-04 12:03:58,001 [messaging :206 ][ERROR ][616] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  7438. Traceback (most recent call last):
  7439. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  7440. self._call_hook_for(message, "workflow", message)
  7441. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7442. return True, func(*args, **kwargs)
  7443. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  7444. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7445. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7446. return True, func(*args, **kwargs)
  7447. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7448. return func(*args, **kwargs)
  7449. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  7450. res = _exec("AT+CCLK?")
  7451. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  7452. conn.write_line(cmd)
  7453. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  7454. self.ensure_open()
  7455. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  7456. self.open()
  7457. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  7458. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  7459. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  7460. raise attempt.get()
  7461. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  7462. six.reraise(self.value[0], self.value[1], self.value[2])
  7463. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  7464. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  7465. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7466. self._serial.open()
  7467. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7468. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7469. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7470. 2020-08-04 12:04:12,836 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][656] Timeout after 1.28205128205 second(s) waiting for interrupt
  7471. 2020-08-04 12:04:12,900 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  7472. Traceback (most recent call last):
  7473. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7474. self._serial.open()
  7475. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7476. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7477. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7478. 2020-08-04 12:04:13,908 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  7479. Traceback (most recent call last):
  7480. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7481. self._serial.open()
  7482. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7483. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7484. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7485. 2020-08-04 12:04:14,912 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  7486. Traceback (most recent call last):
  7487. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7488. self._serial.open()
  7489. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7490. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7491. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7492. 2020-08-04 12:04:14,915 [messaging :206 ][ERROR ][616] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  7493. Traceback (most recent call last):
  7494. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  7495. self._call_hook_for(message, "workflow", message)
  7496. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7497. return True, func(*args, **kwargs)
  7498. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  7499. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7500. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7501. return True, func(*args, **kwargs)
  7502. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7503. return func(*args, **kwargs)
  7504. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  7505. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  7506. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  7507. conn.write_line(cmd)
  7508. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  7509. self.ensure_open()
  7510. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  7511. self.open()
  7512. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  7513. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  7514. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  7515. raise attempt.get()
  7516. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  7517. six.reraise(self.value[0], self.value[1], self.value[2])
  7518. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  7519. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  7520. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7521. self._serial.open()
  7522. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7523. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7524. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7525. 2020-08-04 12:04:14,916 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  7526. Traceback (most recent call last):
  7527. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7528. self._serial.open()
  7529. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7530. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7531. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7532. 2020-08-04 12:04:15,925 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  7533. Traceback (most recent call last):
  7534. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7535. self._serial.open()
  7536. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7537. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7538. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7539. 2020-08-04 12:04:16,929 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  7540. Traceback (most recent call last):
  7541. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7542. self._serial.open()
  7543. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7544. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7545. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7546. 2020-08-04 12:04:16,932 [messaging :742 ][ERROR ][616] Exception while processing event: {'tag': 'ec2x/req/9a6711c6-82c2-4898-ba61-64856f01afee', 'data': {'_stamp': '2020-08-04T12:04:12.876205', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/9a6711c6-82c2-4898-ba61-64856f01afee', 'kwargs': {'cooldown_delay': None}}}
  7547. Traceback (most recent call last):
  7548. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  7549. res = self.process(message)
  7550. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  7551. result = func(message, **settings)
  7552. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  7553. found, result = self._call_hook_for(message, "workflow", message)
  7554. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7555. return True, func(*args, **kwargs)
  7556. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  7557. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7558. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7559. return True, func(*args, **kwargs)
  7560. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7561. return func(*args, **kwargs)
  7562. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  7563. return _exec(cmd, **kwargs)
  7564. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  7565. conn.write_line(cmd)
  7566. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  7567. self.ensure_open()
  7568. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  7569. self.open()
  7570. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  7571. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  7572. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  7573. raise attempt.get()
  7574. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  7575. six.reraise(self.value[0], self.value[1], self.value[2])
  7576. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  7577. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  7578. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7579. self._serial.open()
  7580. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7581. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7582. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7583. 2020-08-04 12:04:16,964 [messaging :206 ][ERROR ][617] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  7584. Traceback (most recent call last):
  7585. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  7586. self._call_hook_for(message, "workflow", message)
  7587. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7588. return True, func(*args, **kwargs)
  7589. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  7590. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7591. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7592. return True, func(*args, **kwargs)
  7593. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7594. return func(*args, **kwargs)
  7595. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  7596. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  7597. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  7598. res = query("AT+QGPSLOC={:d}".format(mode))
  7599. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  7600. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  7601. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  7602. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  7603. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  7604. raise salt.exceptions.CommandExecutionError(message["error"])
  7605. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7606. 2020-08-04 12:04:22,205 [obd.obd :107 ][ERROR ][655] Failed to use explicit port '/dev/serial0'
  7607. Traceback (most recent call last):
  7608. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  7609. self.interface.open(baudrate, protocol=protocol)
  7610. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  7611. self.set_protocol(prot.pop("id", None), **prot)
  7612. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  7613. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  7614. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  7615. self._protocol = self._auto_protocol(**kwargs)
  7616. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  7617. res_0100 = self._verify_protocol("auto", test=not verify)
  7618. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  7619. for line in self.query("0100", parse=False, read_timeout=10):
  7620. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  7621. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  7622. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  7623. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  7624. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  7625. data = self._port.read(self._port.in_waiting or 1)
  7626. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  7627. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  7628. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  7629. sys.exit(salt.defaults.exitcodes.EX_OK)
  7630. SystemExit: 0
  7631. 2020-08-04 12:04:22,279 [obd.obd :120 ][WARNING ][655] Cannot load commands - no connection to bus
  7632. 2020-08-04 12:04:22,318 [obd.interfaces.elm327:730 ][ERROR ][655] Failed to relay command 'STSLCS' to interface
  7633. Traceback (most recent call last):
  7634. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  7635. lines = self.send(cmd, raw_response=raw_response)
  7636. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  7637. raise ELM327Error(self.ERRORS[line], code=line)
  7638. ELM327Error: Operation interrupted by a received RS232 character
  7639. 2020-08-04 12:04:22,322 [messaging :742 ][ERROR ][655] Exception while processing event: {'tag': 'obd/req/9d38a11b-88c3-46f4-8f00-53c6105aac0b', 'data': {'_stamp': '2020-08-04T12:04:16.715513', 'handler': 'execute', '_event_tag': 'obd/req/9d38a11b-88c3-46f4-8f00-53c6105aac0b', 'args': ['STSLCS']}}
  7640. Traceback (most recent call last):
  7641. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  7642. res = self.process(message)
  7643. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  7644. result = func(message, **settings)
  7645. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  7646. found, result = self._call_hook_for(message, "workflow", message)
  7647. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7648. return True, func(*args, **kwargs)
  7649. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  7650. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7651. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7652. return True, func(*args, **kwargs)
  7653. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7654. return func(*args, **kwargs)
  7655. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  7656. res = conn.execute(cmd)
  7657. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  7658. return func(self, *args, **kwargs)
  7659. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  7660. return self._obd.execute(cmd, **kwargs)
  7661. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  7662. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  7663. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  7664. lines = self.send(cmd, raw_response=raw_response)
  7665. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  7666. raise ELM327Error(self.ERRORS[line], code=line)
  7667. ELM327Error: Operation interrupted by a received RS232 character
  7668. 2020-08-04 12:04:23,019 [salt.utils.parsers:1050][WARNING ][416] Minion received a SIGTERM. Exiting.
  7669. 2020-08-04 12:04:23,556 [messaging :871 ][WARNING ][830] No reply message with tag 'obd/res/9d38a11b-88c3-46f4-8f00-53c6105aac0b' received within timeout of 30 secs
  7670. 2020-08-04 12:04:23,562 [salt.state :292 ][ERROR ][830] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  7671. 2020-08-04 12:04:40,085 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  7672. 2020-08-04 12:04:40,102 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  7673. 2020-08-04 12:04:40,114 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  7674. 2020-08-04 12:04:40,707 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  7675. Traceback (most recent call last):
  7676. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7677. self._serial.open()
  7678. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7679. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7680. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7681. 2020-08-04 12:04:41,718 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  7682. Traceback (most recent call last):
  7683. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7684. self._serial.open()
  7685. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7686. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7687. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7688. 2020-08-04 12:04:42,141 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  7689. 2020-08-04 12:04:42,644 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  7690. 2020-08-04 12:04:42,723 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  7691. Traceback (most recent call last):
  7692. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7693. self._serial.open()
  7694. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7695. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7696. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7697. 2020-08-04 12:04:43,146 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  7698. 2020-08-04 12:04:43,148 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  7699. 2020-08-04 12:04:43,303 [messaging :208 ][ERROR ][618] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  7700. Traceback (most recent call last):
  7701. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  7702. self._call_hook_for(message, "workflow", message)
  7703. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7704. return True, func(*args, **kwargs)
  7705. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  7706. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7707. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7708. return True, func(*args, **kwargs)
  7709. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7710. return func(*args, **kwargs)
  7711. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  7712. res = _exec("AT+CCLK?")
  7713. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  7714. conn.write_line(cmd)
  7715. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  7716. self.ensure_open()
  7717. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  7718. self.open()
  7719. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  7720. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  7721. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  7722. raise attempt.get()
  7723. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  7724. six.reraise(self.value[0], self.value[1], self.value[2])
  7725. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  7726. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  7727. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7728. self._serial.open()
  7729. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7730. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7731. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7732. 2020-08-04 12:04:43,655 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  7733. 2020-08-04 12:04:44,163 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  7734. 2020-08-04 12:04:44,666 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  7735. 2020-08-04 12:04:44,668 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  7736. 2020-08-04 12:04:45,172 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  7737. 2020-08-04 12:04:45,675 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  7738. 2020-08-04 12:04:46,178 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  7739. 2020-08-04 12:04:46,180 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  7740. 2020-08-04 12:04:46,184 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  7741. 2020-08-04 12:04:46,688 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  7742. 2020-08-04 12:04:47,191 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  7743. 2020-08-04 12:04:47,193 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  7744. 2020-08-04 12:04:47,488 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  7745. Traceback (most recent call last):
  7746. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7747. self._serial.open()
  7748. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7749. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7750. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7751. 2020-08-04 12:04:47,697 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  7752. 2020-08-04 12:04:48,200 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  7753. 2020-08-04 12:04:48,493 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  7754. Traceback (most recent call last):
  7755. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7756. self._serial.open()
  7757. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7758. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7759. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7760. 2020-08-04 12:04:48,703 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  7761. 2020-08-04 12:04:48,705 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  7762. 2020-08-04 12:04:49,214 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  7763. 2020-08-04 12:04:49,497 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  7764. Traceback (most recent call last):
  7765. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7766. self._serial.open()
  7767. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7768. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7769. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7770. 2020-08-04 12:04:49,510 [messaging :742 ][ERROR ][618] Exception while processing event: {'tag': 'ec2x/req/6022f12c-db15-40c2-af32-30a14babd76b', 'data': {'_stamp': '2020-08-04T12:04:40.164360', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/6022f12c-db15-40c2-af32-30a14babd76b', 'kwargs': {'cooldown_delay': None}}}
  7771. Traceback (most recent call last):
  7772. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  7773. res = self.process(message)
  7774. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  7775. result = func(message, **settings)
  7776. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  7777. found, result = self._call_hook_for(message, "workflow", message)
  7778. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7779. return True, func(*args, **kwargs)
  7780. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  7781. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7782. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7783. return True, func(*args, **kwargs)
  7784. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7785. return func(*args, **kwargs)
  7786. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  7787. return _exec(cmd, **kwargs)
  7788. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  7789. conn.write_line(cmd)
  7790. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  7791. self.ensure_open()
  7792. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  7793. self.open()
  7794. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  7795. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  7796. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  7797. raise attempt.get()
  7798. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  7799. six.reraise(self.value[0], self.value[1], self.value[2])
  7800. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  7801. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  7802. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7803. self._serial.open()
  7804. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7805. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7806. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7807. 2020-08-04 12:04:49,719 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  7808. 2020-08-04 12:04:50,149 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  7809. Traceback (most recent call last):
  7810. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7811. self._serial.open()
  7812. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7813. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7814. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7815. 2020-08-04 12:04:50,221 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  7816. 2020-08-04 12:04:50,224 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  7817. 2020-08-04 12:04:50,226 [messaging :208 ][ERROR ][621] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  7818. Traceback (most recent call last):
  7819. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  7820. self._call_hook_for(message, "workflow", message)
  7821. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7822. return True, func(*args, **kwargs)
  7823. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  7824. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7825. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7826. return True, func(*args, **kwargs)
  7827. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7828. return func(*args, **kwargs)
  7829. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  7830. conn.heartbeat()
  7831. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  7832. self.noop()
  7833. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  7834. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  7835. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  7836. raise attempt.get()
  7837. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  7838. six.reraise(self.value[0], self.value[1], self.value[2])
  7839. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  7840. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  7841. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  7842. self._begin_message()
  7843. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  7844. self.recv(ack=ACK_MESSAGE_BEGIN)
  7845. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  7846. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  7847. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  7848. raise attempt.get()
  7849. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  7850. six.reraise(self.value[0], self.value[1], self.value[2])
  7851. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  7852. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  7853. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  7854. raise Exception(msg)
  7855. Exception: Expected ack '12' but got '255'
  7856. 2020-08-04 12:04:51,154 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  7857. Traceback (most recent call last):
  7858. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7859. self._serial.open()
  7860. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7861. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7862. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7863. 2020-08-04 12:04:51,792 [messaging :208 ][ERROR ][619] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  7864. Traceback (most recent call last):
  7865. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  7866. self._call_hook_for(message, "workflow", message)
  7867. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7868. return True, func(*args, **kwargs)
  7869. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  7870. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7871. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7872. return True, func(*args, **kwargs)
  7873. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7874. return func(*args, **kwargs)
  7875. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  7876. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  7877. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  7878. res = query("AT+QGPSLOC={:d}".format(mode))
  7879. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  7880. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  7881. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  7882. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  7883. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  7884. raise salt.exceptions.CommandExecutionError(message["error"])
  7885. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7886. 2020-08-04 12:04:52,158 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  7887. Traceback (most recent call last):
  7888. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7889. self._serial.open()
  7890. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7891. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7892. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7893. 2020-08-04 12:04:52,704 [messaging :206 ][ERROR ][618] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  7894. Traceback (most recent call last):
  7895. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  7896. self._call_hook_for(message, "workflow", message)
  7897. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7898. return True, func(*args, **kwargs)
  7899. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  7900. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7901. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7902. return True, func(*args, **kwargs)
  7903. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7904. return func(*args, **kwargs)
  7905. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  7906. res = _exec("AT+CCLK?")
  7907. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  7908. conn.write_line(cmd)
  7909. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  7910. self.ensure_open()
  7911. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  7912. self.open()
  7913. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  7914. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  7915. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  7916. raise attempt.get()
  7917. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  7918. six.reraise(self.value[0], self.value[1], self.value[2])
  7919. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  7920. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  7921. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7922. self._serial.open()
  7923. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7924. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7925. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7926. 2020-08-04 12:04:56,884 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  7927. Traceback (most recent call last):
  7928. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7929. self._serial.open()
  7930. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7931. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7932. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7933. 2020-08-04 12:04:57,888 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  7934. Traceback (most recent call last):
  7935. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7936. self._serial.open()
  7937. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7938. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7939. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7940. 2020-08-04 12:04:58,893 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  7941. Traceback (most recent call last):
  7942. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7943. self._serial.open()
  7944. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7945. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7946. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7947. 2020-08-04 12:04:58,911 [messaging :742 ][ERROR ][618] Exception while processing event: {'tag': 'ec2x/req/b94926f7-f929-4c21-b0c7-e6b0d91dd81f', 'data': {'_stamp': '2020-08-04T12:04:56.872881', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/b94926f7-f929-4c21-b0c7-e6b0d91dd81f', 'kwargs': {'cooldown_delay': None}}}
  7948. Traceback (most recent call last):
  7949. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  7950. res = self.process(message)
  7951. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  7952. result = func(message, **settings)
  7953. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  7954. found, result = self._call_hook_for(message, "workflow", message)
  7955. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7956. return True, func(*args, **kwargs)
  7957. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  7958. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7959. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7960. return True, func(*args, **kwargs)
  7961. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7962. return func(*args, **kwargs)
  7963. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  7964. return _exec(cmd, **kwargs)
  7965. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  7966. conn.write_line(cmd)
  7967. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  7968. self.ensure_open()
  7969. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  7970. self.open()
  7971. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  7972. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  7973. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  7974. raise attempt.get()
  7975. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  7976. six.reraise(self.value[0], self.value[1], self.value[2])
  7977. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  7978. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  7979. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  7980. self._serial.open()
  7981. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  7982. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  7983. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  7984. 2020-08-04 12:04:58,963 [messaging :206 ][ERROR ][619] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  7985. Traceback (most recent call last):
  7986. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  7987. self._call_hook_for(message, "workflow", message)
  7988. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7989. return True, func(*args, **kwargs)
  7990. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  7991. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  7992. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  7993. return True, func(*args, **kwargs)
  7994. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  7995. return func(*args, **kwargs)
  7996. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  7997. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  7998. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  7999. res = query("AT+QGPSLOC={:d}".format(mode))
  8000. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  8001. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  8002. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  8003. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  8004. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  8005. raise salt.exceptions.CommandExecutionError(message["error"])
  8006. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8007. 2020-08-04 12:04:59,509 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  8008. Traceback (most recent call last):
  8009. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8010. self._serial.open()
  8011. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8012. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8013. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8014. 2020-08-04 12:05:00,515 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  8015. Traceback (most recent call last):
  8016. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8017. self._serial.open()
  8018. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8019. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8020. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8021. 2020-08-04 12:05:01,519 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  8022. Traceback (most recent call last):
  8023. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8024. self._serial.open()
  8025. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8026. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8027. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8028. 2020-08-04 12:05:01,577 [salt.loaded.int.module.cmdmod:693 ][ERROR ][618] Command '['timedatectl', 'set-ntp', '1']' failed with return code: 1
  8029. 2020-08-04 12:05:01,580 [salt.loaded.int.module.cmdmod:697 ][ERROR ][618] stderr: Failed to create bus connection: Broken pipe
  8030. 2020-08-04 12:05:01,582 [salt.loaded.int.module.cmdmod:699 ][ERROR ][618] retcode: 1
  8031. 2020-08-04 12:05:01,585 [messaging :208 ][ERROR ][618] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  8032. Traceback (most recent call last):
  8033. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  8034. self._call_hook_for(message, "workflow", message)
  8035. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8036. return True, func(*args, **kwargs)
  8037. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  8038. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8039. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8040. return True, func(*args, **kwargs)
  8041. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8042. return func(*args, **kwargs)
  8043. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 295, in sync_time_handler
  8044. __salt__["clock.ntp"](enable=True)
  8045. File "/var/cache/salt/minion/extmods/modules/clock.py", line 76, in ntp
  8046. raise salt.exceptions.CommandExecutionError(res["stderr"])
  8047. CommandExecutionError: Failed to create bus connection: Broken pipe
  8048. 2020-08-04 12:05:01,915 [obd.obd :107 ][ERROR ][657] Failed to use explicit port '/dev/serial0'
  8049. Traceback (most recent call last):
  8050. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  8051. self.interface.open(baudrate, protocol=protocol)
  8052. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  8053. self.set_protocol(prot.pop("id", None), **prot)
  8054. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  8055. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  8056. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  8057. self._protocol = self._auto_protocol(**kwargs)
  8058. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  8059. res_0100 = self._verify_protocol("auto", test=not verify)
  8060. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  8061. for line in self.query("0100", parse=False, read_timeout=10):
  8062. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  8063. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  8064. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  8065. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  8066. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  8067. data = self._port.read(self._port.in_waiting or 1)
  8068. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  8069. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  8070. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  8071. sys.exit(salt.defaults.exitcodes.EX_OK)
  8072. SystemExit: 0
  8073. 2020-08-04 12:05:01,956 [obd.obd :120 ][WARNING ][657] Cannot load commands - no connection to bus
  8074. 2020-08-04 12:05:01,982 [obd.interfaces.elm327:730 ][ERROR ][657] Failed to relay command 'STSLCS' to interface
  8075. Traceback (most recent call last):
  8076. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  8077. lines = self.send(cmd, raw_response=raw_response)
  8078. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  8079. raise ELM327Error(self.ERRORS[line], code=line)
  8080. ELM327Error: Operation interrupted by a received RS232 character
  8081. 2020-08-04 12:05:01,985 [messaging :742 ][ERROR ][657] Exception while processing event: {'tag': 'obd/req/585f9d5b-7757-48cf-a50e-c0e519a769eb', 'data': {'_stamp': '2020-08-04T12:04:56.719313', 'handler': 'execute', '_event_tag': 'obd/req/585f9d5b-7757-48cf-a50e-c0e519a769eb', 'args': ['STSLCS']}}
  8082. Traceback (most recent call last):
  8083. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  8084. res = self.process(message)
  8085. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  8086. result = func(message, **settings)
  8087. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  8088. found, result = self._call_hook_for(message, "workflow", message)
  8089. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8090. return True, func(*args, **kwargs)
  8091. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  8092. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8093. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8094. return True, func(*args, **kwargs)
  8095. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8096. return func(*args, **kwargs)
  8097. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  8098. res = conn.execute(cmd)
  8099. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  8100. return func(self, *args, **kwargs)
  8101. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  8102. return self._obd.execute(cmd, **kwargs)
  8103. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  8104. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  8105. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  8106. lines = self.send(cmd, raw_response=raw_response)
  8107. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  8108. raise ELM327Error(self.ERRORS[line], code=line)
  8109. ELM327Error: Operation interrupted by a received RS232 character
  8110. 2020-08-04 12:05:02,683 [salt.utils.parsers:1050][WARNING ][418] Minion received a SIGTERM. Exiting.
  8111. 2020-08-04 12:05:03,223 [messaging :871 ][WARNING ][832] No reply message with tag 'obd/res/585f9d5b-7757-48cf-a50e-c0e519a769eb' received within timeout of 30 secs
  8112. 2020-08-04 12:05:03,229 [salt.state :292 ][ERROR ][832] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  8113. 2020-08-04 12:05:19,987 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  8114. 2020-08-04 12:05:20,002 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  8115. 2020-08-04 12:05:20,015 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  8116. 2020-08-04 12:05:20,137 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  8117. Traceback (most recent call last):
  8118. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8119. self._serial.open()
  8120. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8121. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8122. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8123. 2020-08-04 12:05:21,149 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  8124. Traceback (most recent call last):
  8125. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8126. self._serial.open()
  8127. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8128. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8129. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8130. 2020-08-04 12:05:22,044 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  8131. 2020-08-04 12:05:22,153 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  8132. Traceback (most recent call last):
  8133. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8134. self._serial.open()
  8135. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8136. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8137. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8138. 2020-08-04 12:05:22,547 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  8139. 2020-08-04 12:05:22,749 [messaging :208 ][ERROR ][621] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  8140. Traceback (most recent call last):
  8141. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  8142. self._call_hook_for(message, "workflow", message)
  8143. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8144. return True, func(*args, **kwargs)
  8145. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  8146. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8147. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8148. return True, func(*args, **kwargs)
  8149. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8150. return func(*args, **kwargs)
  8151. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  8152. res = _exec("AT+CCLK?")
  8153. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  8154. conn.write_line(cmd)
  8155. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  8156. self.ensure_open()
  8157. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  8158. self.open()
  8159. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  8160. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  8161. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  8162. raise attempt.get()
  8163. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  8164. six.reraise(self.value[0], self.value[1], self.value[2])
  8165. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  8166. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  8167. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8168. self._serial.open()
  8169. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8170. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8171. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8172. 2020-08-04 12:05:23,050 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  8173. 2020-08-04 12:05:23,052 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  8174. 2020-08-04 12:05:23,556 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  8175. 2020-08-04 12:05:24,061 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  8176. 2020-08-04 12:05:24,564 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  8177. 2020-08-04 12:05:24,567 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  8178. 2020-08-04 12:05:25,074 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  8179. 2020-08-04 12:05:25,601 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  8180. 2020-08-04 12:05:26,104 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  8181. 2020-08-04 12:05:26,106 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  8182. 2020-08-04 12:05:26,109 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  8183. 2020-08-04 12:05:26,612 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  8184. 2020-08-04 12:05:27,115 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  8185. 2020-08-04 12:05:27,117 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  8186. 2020-08-04 12:05:27,348 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  8187. Traceback (most recent call last):
  8188. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8189. self._serial.open()
  8190. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8191. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8192. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8193. 2020-08-04 12:05:27,621 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  8194. 2020-08-04 12:05:28,124 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  8195. 2020-08-04 12:05:28,357 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  8196. Traceback (most recent call last):
  8197. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8198. self._serial.open()
  8199. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8200. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8201. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8202. 2020-08-04 12:05:28,627 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  8203. 2020-08-04 12:05:28,630 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  8204. 2020-08-04 12:05:29,133 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  8205. 2020-08-04 12:05:29,361 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  8206. Traceback (most recent call last):
  8207. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8208. self._serial.open()
  8209. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8210. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8211. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8212. 2020-08-04 12:05:29,364 [messaging :742 ][ERROR ][621] Exception while processing event: {'tag': 'ec2x/req/50a0c7c0-1af7-415b-a6d3-95fd48db3b36', 'data': {'_stamp': '2020-08-04T12:05:20.058847', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/50a0c7c0-1af7-415b-a6d3-95fd48db3b36', 'kwargs': {'cooldown_delay': None}}}
  8213. Traceback (most recent call last):
  8214. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  8215. res = self.process(message)
  8216. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  8217. result = func(message, **settings)
  8218. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  8219. found, result = self._call_hook_for(message, "workflow", message)
  8220. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8221. return True, func(*args, **kwargs)
  8222. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  8223. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8224. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8225. return True, func(*args, **kwargs)
  8226. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8227. return func(*args, **kwargs)
  8228. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  8229. return _exec(cmd, **kwargs)
  8230. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  8231. conn.write_line(cmd)
  8232. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  8233. self.ensure_open()
  8234. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  8235. self.open()
  8236. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  8237. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  8238. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  8239. raise attempt.get()
  8240. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  8241. six.reraise(self.value[0], self.value[1], self.value[2])
  8242. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  8243. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  8244. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8245. self._serial.open()
  8246. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8247. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8248. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8249. 2020-08-04 12:05:29,637 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  8250. 2020-08-04 12:05:30,023 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  8251. Traceback (most recent call last):
  8252. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8253. self._serial.open()
  8254. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8255. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8256. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8257. 2020-08-04 12:05:30,140 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  8258. 2020-08-04 12:05:30,143 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  8259. 2020-08-04 12:05:30,145 [messaging :208 ][ERROR ][624] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  8260. Traceback (most recent call last):
  8261. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  8262. self._call_hook_for(message, "workflow", message)
  8263. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8264. return True, func(*args, **kwargs)
  8265. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  8266. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8267. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8268. return True, func(*args, **kwargs)
  8269. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8270. return func(*args, **kwargs)
  8271. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  8272. conn.heartbeat()
  8273. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  8274. self.noop()
  8275. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  8276. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  8277. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  8278. raise attempt.get()
  8279. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  8280. six.reraise(self.value[0], self.value[1], self.value[2])
  8281. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  8282. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  8283. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  8284. self._begin_message()
  8285. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  8286. self.recv(ack=ACK_MESSAGE_BEGIN)
  8287. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  8288. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  8289. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  8290. raise attempt.get()
  8291. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  8292. six.reraise(self.value[0], self.value[1], self.value[2])
  8293. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  8294. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  8295. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  8296. raise Exception(msg)
  8297. Exception: Expected ack '12' but got '255'
  8298. 2020-08-04 12:05:31,028 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  8299. Traceback (most recent call last):
  8300. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8301. self._serial.open()
  8302. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8303. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8304. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8305. 2020-08-04 12:05:31,553 [messaging :208 ][ERROR ][622] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  8306. Traceback (most recent call last):
  8307. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  8308. self._call_hook_for(message, "workflow", message)
  8309. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8310. return True, func(*args, **kwargs)
  8311. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  8312. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8313. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8314. return True, func(*args, **kwargs)
  8315. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8316. return func(*args, **kwargs)
  8317. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  8318. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  8319. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  8320. res = query("AT+QGPSLOC={:d}".format(mode))
  8321. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  8322. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  8323. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  8324. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  8325. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  8326. raise salt.exceptions.CommandExecutionError(message["error"])
  8327. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8328. 2020-08-04 12:05:32,032 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  8329. Traceback (most recent call last):
  8330. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8331. self._serial.open()
  8332. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8333. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8334. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8335. 2020-08-04 12:05:32,562 [messaging :206 ][ERROR ][621] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  8336. Traceback (most recent call last):
  8337. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  8338. self._call_hook_for(message, "workflow", message)
  8339. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8340. return True, func(*args, **kwargs)
  8341. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  8342. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8343. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8344. return True, func(*args, **kwargs)
  8345. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8346. return func(*args, **kwargs)
  8347. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  8348. res = _exec("AT+CCLK?")
  8349. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  8350. conn.write_line(cmd)
  8351. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  8352. self.ensure_open()
  8353. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  8354. self.open()
  8355. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  8356. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  8357. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  8358. raise attempt.get()
  8359. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  8360. six.reraise(self.value[0], self.value[1], self.value[2])
  8361. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  8362. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  8363. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8364. self._serial.open()
  8365. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8366. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8367. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8368. 2020-08-04 12:06:02,343 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][649] Timeout after 1.28205128205 second(s) waiting for interrupt
  8369. 2020-08-04 12:06:02,419 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  8370. Traceback (most recent call last):
  8371. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8372. self._serial.open()
  8373. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8374. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8375. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8376. 2020-08-04 12:06:03,424 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  8377. Traceback (most recent call last):
  8378. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8379. self._serial.open()
  8380. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8381. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8382. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8383. 2020-08-04 12:06:04,428 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  8384. Traceback (most recent call last):
  8385. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8386. self._serial.open()
  8387. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8388. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8389. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8390. 2020-08-04 12:06:04,431 [messaging :206 ][ERROR ][621] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  8391. Traceback (most recent call last):
  8392. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  8393. self._call_hook_for(message, "workflow", message)
  8394. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8395. return True, func(*args, **kwargs)
  8396. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  8397. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8398. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8399. return True, func(*args, **kwargs)
  8400. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8401. return func(*args, **kwargs)
  8402. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  8403. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  8404. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  8405. conn.write_line(cmd)
  8406. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  8407. self.ensure_open()
  8408. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  8409. self.open()
  8410. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  8411. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  8412. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  8413. raise attempt.get()
  8414. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  8415. six.reraise(self.value[0], self.value[1], self.value[2])
  8416. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  8417. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  8418. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8419. self._serial.open()
  8420. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8421. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8422. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8423. 2020-08-04 12:06:04,433 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  8424. Traceback (most recent call last):
  8425. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8426. self._serial.open()
  8427. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8428. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8429. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8430. 2020-08-04 12:06:05,441 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  8431. Traceback (most recent call last):
  8432. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8433. self._serial.open()
  8434. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8435. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8436. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8437. 2020-08-04 12:06:06,445 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  8438. Traceback (most recent call last):
  8439. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8440. self._serial.open()
  8441. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8442. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8443. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8444. 2020-08-04 12:06:06,448 [messaging :742 ][ERROR ][621] Exception while processing event: {'tag': 'ec2x/req/c225541c-11ec-4b3f-a032-dce5db65d033', 'data': {'_stamp': '2020-08-04T12:06:02.369611', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/c225541c-11ec-4b3f-a032-dce5db65d033', 'kwargs': {'cooldown_delay': None}}}
  8445. Traceback (most recent call last):
  8446. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  8447. res = self.process(message)
  8448. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  8449. result = func(message, **settings)
  8450. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  8451. found, result = self._call_hook_for(message, "workflow", message)
  8452. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8453. return True, func(*args, **kwargs)
  8454. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  8455. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8456. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8457. return True, func(*args, **kwargs)
  8458. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8459. return func(*args, **kwargs)
  8460. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  8461. return _exec(cmd, **kwargs)
  8462. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  8463. conn.write_line(cmd)
  8464. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  8465. self.ensure_open()
  8466. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  8467. self.open()
  8468. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  8469. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  8470. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  8471. raise attempt.get()
  8472. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  8473. six.reraise(self.value[0], self.value[1], self.value[2])
  8474. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  8475. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  8476. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8477. self._serial.open()
  8478. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8479. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8480. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8481. 2020-08-04 12:06:06,480 [messaging :206 ][ERROR ][622] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  8482. Traceback (most recent call last):
  8483. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  8484. self._call_hook_for(message, "workflow", message)
  8485. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8486. return True, func(*args, **kwargs)
  8487. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  8488. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8489. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8490. return True, func(*args, **kwargs)
  8491. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8492. return func(*args, **kwargs)
  8493. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  8494. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  8495. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  8496. res = query("AT+QGPSLOC={:d}".format(mode))
  8497. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  8498. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  8499. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  8500. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  8501. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  8502. raise salt.exceptions.CommandExecutionError(message["error"])
  8503. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8504. 2020-08-04 12:06:10,819 [obd.obd :107 ][ERROR ][648] Failed to use explicit port '/dev/serial0'
  8505. Traceback (most recent call last):
  8506. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  8507. self.interface.open(baudrate, protocol=protocol)
  8508. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  8509. self.set_protocol(prot.pop("id", None), **prot)
  8510. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  8511. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  8512. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  8513. self._protocol = self._auto_protocol(**kwargs)
  8514. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  8515. res_0100 = self._verify_protocol("auto", test=not verify)
  8516. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  8517. for line in self.query("0100", parse=False, read_timeout=10):
  8518. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  8519. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  8520. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  8521. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  8522. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  8523. data = self._port.read(self._port.in_waiting or 1)
  8524. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  8525. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  8526. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  8527. sys.exit(salt.defaults.exitcodes.EX_OK)
  8528. SystemExit: 0
  8529. 2020-08-04 12:06:10,846 [obd.obd :120 ][WARNING ][648] Cannot load commands - no connection to bus
  8530. 2020-08-04 12:06:10,876 [obd.interfaces.elm327:730 ][ERROR ][648] Failed to relay command 'STSLCS' to interface
  8531. Traceback (most recent call last):
  8532. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  8533. lines = self.send(cmd, raw_response=raw_response)
  8534. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  8535. raise ELM327Error(self.ERRORS[line], code=line)
  8536. ELM327Error: Operation interrupted by a received RS232 character
  8537. 2020-08-04 12:06:10,879 [messaging :742 ][ERROR ][648] Exception while processing event: {'tag': 'obd/req/77ab5bcd-fd60-41b3-9303-90409a064546', 'data': {'_stamp': '2020-08-04T12:06:05.896562', 'handler': 'execute', '_event_tag': 'obd/req/77ab5bcd-fd60-41b3-9303-90409a064546', 'args': ['STSLCS']}}
  8538. Traceback (most recent call last):
  8539. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  8540. res = self.process(message)
  8541. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  8542. result = func(message, **settings)
  8543. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  8544. found, result = self._call_hook_for(message, "workflow", message)
  8545. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8546. return True, func(*args, **kwargs)
  8547. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  8548. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8549. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8550. return True, func(*args, **kwargs)
  8551. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8552. return func(*args, **kwargs)
  8553. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  8554. res = conn.execute(cmd)
  8555. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  8556. return func(self, *args, **kwargs)
  8557. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  8558. return self._obd.execute(cmd, **kwargs)
  8559. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  8560. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  8561. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  8562. lines = self.send(cmd, raw_response=raw_response)
  8563. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  8564. raise ELM327Error(self.ERRORS[line], code=line)
  8565. ELM327Error: Operation interrupted by a received RS232 character
  8566. 2020-08-04 12:06:11,647 [salt.utils.parsers:1050][WARNING ][420] Minion received a SIGTERM. Exiting.
  8567. 2020-08-04 12:06:12,186 [messaging :871 ][WARNING ][821] No reply message with tag 'obd/res/77ab5bcd-fd60-41b3-9303-90409a064546' received within timeout of 30 secs
  8568. 2020-08-04 12:06:12,190 [salt.state :292 ][ERROR ][821] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  8569. 2020-08-04 12:06:29,164 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  8570. 2020-08-04 12:06:29,177 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  8571. 2020-08-04 12:06:29,182 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  8572. 2020-08-04 12:06:29,856 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  8573. Traceback (most recent call last):
  8574. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8575. self._serial.open()
  8576. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8577. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8578. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8579. 2020-08-04 12:06:30,872 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  8580. Traceback (most recent call last):
  8581. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8582. self._serial.open()
  8583. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8584. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8585. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8586. 2020-08-04 12:06:31,202 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  8587. 2020-08-04 12:06:31,706 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  8588. 2020-08-04 12:06:31,877 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  8589. Traceback (most recent call last):
  8590. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8591. self._serial.open()
  8592. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8593. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8594. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8595. 2020-08-04 12:06:32,208 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  8596. 2020-08-04 12:06:32,211 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  8597. 2020-08-04 12:06:32,491 [messaging :208 ][ERROR ][618] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  8598. Traceback (most recent call last):
  8599. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  8600. self._call_hook_for(message, "workflow", message)
  8601. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8602. return True, func(*args, **kwargs)
  8603. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  8604. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8605. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8606. return True, func(*args, **kwargs)
  8607. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8608. return func(*args, **kwargs)
  8609. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  8610. res = _exec("AT+CCLK?")
  8611. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  8612. conn.write_line(cmd)
  8613. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  8614. self.ensure_open()
  8615. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  8616. self.open()
  8617. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  8618. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  8619. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  8620. raise attempt.get()
  8621. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  8622. six.reraise(self.value[0], self.value[1], self.value[2])
  8623. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  8624. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  8625. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8626. self._serial.open()
  8627. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8628. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8629. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8630. 2020-08-04 12:06:32,714 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  8631. 2020-08-04 12:06:47,321 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][708] Timeout after 1.28205128205 second(s) waiting for interrupt
  8632. 2020-08-04 12:06:47,373 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  8633. Traceback (most recent call last):
  8634. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8635. self._serial.open()
  8636. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8637. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8638. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8639. 2020-08-04 12:06:47,651 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  8640. 2020-08-04 12:06:48,154 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  8641. 2020-08-04 12:06:48,157 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  8642. 2020-08-04 12:06:48,377 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  8643. Traceback (most recent call last):
  8644. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8645. self._serial.open()
  8646. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8647. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8648. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8649. 2020-08-04 12:06:48,662 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  8650. 2020-08-04 12:06:49,166 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  8651. 2020-08-04 12:06:49,382 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  8652. Traceback (most recent call last):
  8653. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8654. self._serial.open()
  8655. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8656. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8657. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8658. 2020-08-04 12:06:49,386 [messaging :206 ][ERROR ][618] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  8659. Traceback (most recent call last):
  8660. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  8661. self._call_hook_for(message, "workflow", message)
  8662. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8663. return True, func(*args, **kwargs)
  8664. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  8665. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8666. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8667. return True, func(*args, **kwargs)
  8668. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8669. return func(*args, **kwargs)
  8670. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  8671. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  8672. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  8673. conn.write_line(cmd)
  8674. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  8675. self.ensure_open()
  8676. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  8677. self.open()
  8678. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  8679. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  8680. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  8681. raise attempt.get()
  8682. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  8683. six.reraise(self.value[0], self.value[1], self.value[2])
  8684. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  8685. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  8686. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8687. self._serial.open()
  8688. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8689. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8690. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8691. 2020-08-04 12:06:49,669 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  8692. 2020-08-04 12:06:49,672 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  8693. 2020-08-04 12:06:49,676 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  8694. 2020-08-04 12:06:50,179 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  8695. 2020-08-04 12:06:50,683 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  8696. 2020-08-04 12:06:50,685 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  8697. 2020-08-04 12:06:51,189 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  8698. 2020-08-04 12:06:51,419 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  8699. Traceback (most recent call last):
  8700. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8701. self._serial.open()
  8702. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8703. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8704. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8705. 2020-08-04 12:06:51,693 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  8706. 2020-08-04 12:06:52,198 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  8707. 2020-08-04 12:06:52,203 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  8708. 2020-08-04 12:06:52,435 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  8709. Traceback (most recent call last):
  8710. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8711. self._serial.open()
  8712. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8713. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8714. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8715. 2020-08-04 12:06:52,708 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  8716. 2020-08-04 12:06:53,212 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  8717. 2020-08-04 12:06:53,443 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  8718. Traceback (most recent call last):
  8719. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8720. self._serial.open()
  8721. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8722. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8723. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8724. 2020-08-04 12:06:53,455 [messaging :742 ][ERROR ][618] Exception while processing event: {'tag': 'ec2x/req/0ad4afce-31ea-47be-8c81-d9dafbc2d54d', 'data': {'_stamp': '2020-08-04T12:06:29.229890', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/0ad4afce-31ea-47be-8c81-d9dafbc2d54d', 'kwargs': {'cooldown_delay': None}}}
  8725. Traceback (most recent call last):
  8726. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  8727. res = self.process(message)
  8728. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  8729. result = func(message, **settings)
  8730. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  8731. found, result = self._call_hook_for(message, "workflow", message)
  8732. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8733. return True, func(*args, **kwargs)
  8734. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  8735. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8736. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8737. return True, func(*args, **kwargs)
  8738. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8739. return func(*args, **kwargs)
  8740. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  8741. return _exec(cmd, **kwargs)
  8742. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  8743. conn.write_line(cmd)
  8744. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  8745. self.ensure_open()
  8746. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  8747. self.open()
  8748. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  8749. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  8750. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  8751. raise attempt.get()
  8752. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  8753. six.reraise(self.value[0], self.value[1], self.value[2])
  8754. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  8755. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  8756. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8757. self._serial.open()
  8758. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8759. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8760. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8761. 2020-08-04 12:06:53,716 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  8762. 2020-08-04 12:06:53,719 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  8763. 2020-08-04 12:06:53,726 [messaging :208 ][ERROR ][621] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  8764. Traceback (most recent call last):
  8765. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  8766. self._call_hook_for(message, "workflow", message)
  8767. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8768. return True, func(*args, **kwargs)
  8769. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  8770. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8771. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8772. return True, func(*args, **kwargs)
  8773. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8774. return func(*args, **kwargs)
  8775. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  8776. conn.heartbeat()
  8777. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  8778. self.noop()
  8779. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  8780. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  8781. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  8782. raise attempt.get()
  8783. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  8784. six.reraise(self.value[0], self.value[1], self.value[2])
  8785. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  8786. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  8787. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  8788. self._begin_message()
  8789. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  8790. self.recv(ack=ACK_MESSAGE_BEGIN)
  8791. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  8792. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  8793. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  8794. raise attempt.get()
  8795. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  8796. six.reraise(self.value[0], self.value[1], self.value[2])
  8797. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  8798. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  8799. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  8800. raise Exception(msg)
  8801. Exception: Expected ack '12' but got '255'
  8802. 2020-08-04 12:06:56,325 [messaging :208 ][ERROR ][619] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  8803. Traceback (most recent call last):
  8804. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  8805. self._call_hook_for(message, "workflow", message)
  8806. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8807. return True, func(*args, **kwargs)
  8808. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  8809. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8810. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8811. return True, func(*args, **kwargs)
  8812. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8813. return func(*args, **kwargs)
  8814. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  8815. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  8816. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  8817. res = query("AT+QGPSLOC={:d}".format(mode))
  8818. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  8819. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  8820. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  8821. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  8822. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  8823. raise salt.exceptions.CommandExecutionError(message["error"])
  8824. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8825. 2020-08-04 12:07:01,374 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  8826. Traceback (most recent call last):
  8827. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8828. self._serial.open()
  8829. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8830. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8831. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8832. 2020-08-04 12:07:02,394 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  8833. Traceback (most recent call last):
  8834. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8835. self._serial.open()
  8836. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8837. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8838. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8839. 2020-08-04 12:07:03,397 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  8840. Traceback (most recent call last):
  8841. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8842. self._serial.open()
  8843. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8844. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8845. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8846. 2020-08-04 12:07:03,400 [messaging :742 ][ERROR ][618] Exception while processing event: {'tag': 'ec2x/req/08e5ef58-d311-4c36-8a8b-9c0b247ff87b', 'data': {'_stamp': '2020-08-04T12:07:01.362726', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/08e5ef58-d311-4c36-8a8b-9c0b247ff87b', 'kwargs': {'cooldown_delay': None}}}
  8847. Traceback (most recent call last):
  8848. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  8849. res = self.process(message)
  8850. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  8851. result = func(message, **settings)
  8852. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  8853. found, result = self._call_hook_for(message, "workflow", message)
  8854. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8855. return True, func(*args, **kwargs)
  8856. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  8857. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8858. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8859. return True, func(*args, **kwargs)
  8860. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8861. return func(*args, **kwargs)
  8862. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  8863. return _exec(cmd, **kwargs)
  8864. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  8865. conn.write_line(cmd)
  8866. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  8867. self.ensure_open()
  8868. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  8869. self.open()
  8870. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  8871. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  8872. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  8873. raise attempt.get()
  8874. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  8875. six.reraise(self.value[0], self.value[1], self.value[2])
  8876. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  8877. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  8878. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8879. self._serial.open()
  8880. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8881. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8882. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8883. 2020-08-04 12:07:03,441 [messaging :206 ][ERROR ][619] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  8884. Traceback (most recent call last):
  8885. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  8886. self._call_hook_for(message, "workflow", message)
  8887. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8888. return True, func(*args, **kwargs)
  8889. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  8890. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8891. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8892. return True, func(*args, **kwargs)
  8893. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8894. return func(*args, **kwargs)
  8895. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  8896. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  8897. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  8898. res = query("AT+QGPSLOC={:d}".format(mode))
  8899. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  8900. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  8901. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  8902. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  8903. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  8904. raise salt.exceptions.CommandExecutionError(message["error"])
  8905. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8906. 2020-08-04 12:07:06,762 [obd.obd :107 ][ERROR ][707] Failed to use explicit port '/dev/serial0'
  8907. Traceback (most recent call last):
  8908. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  8909. self.interface.open(baudrate, protocol=protocol)
  8910. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  8911. self.set_protocol(prot.pop("id", None), **prot)
  8912. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  8913. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  8914. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  8915. self._protocol = self._auto_protocol(**kwargs)
  8916. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  8917. res_0100 = self._verify_protocol("auto", test=not verify)
  8918. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  8919. for line in self.query("0100", parse=False, read_timeout=10):
  8920. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  8921. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  8922. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  8923. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  8924. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  8925. data = self._port.read(self._port.in_waiting or 1)
  8926. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  8927. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  8928. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  8929. sys.exit(salt.defaults.exitcodes.EX_OK)
  8930. SystemExit: 0
  8931. 2020-08-04 12:07:06,786 [obd.obd :120 ][WARNING ][707] Cannot load commands - no connection to bus
  8932. 2020-08-04 12:07:06,810 [obd.interfaces.elm327:730 ][ERROR ][707] Failed to relay command 'STSLCS' to interface
  8933. Traceback (most recent call last):
  8934. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  8935. lines = self.send(cmd, raw_response=raw_response)
  8936. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  8937. raise ELM327Error(self.ERRORS[line], code=line)
  8938. ELM327Error: Operation interrupted by a received RS232 character
  8939. 2020-08-04 12:07:06,813 [messaging :742 ][ERROR ][707] Exception while processing event: {'tag': 'obd/req/c057e859-df30-41d4-884c-6efdcca8b787', 'data': {'_stamp': '2020-08-04T12:07:01.254907', 'handler': 'execute', '_event_tag': 'obd/req/c057e859-df30-41d4-884c-6efdcca8b787', 'args': ['STSLCS']}}
  8940. Traceback (most recent call last):
  8941. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  8942. res = self.process(message)
  8943. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  8944. result = func(message, **settings)
  8945. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  8946. found, result = self._call_hook_for(message, "workflow", message)
  8947. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8948. return True, func(*args, **kwargs)
  8949. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  8950. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  8951. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  8952. return True, func(*args, **kwargs)
  8953. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  8954. return func(*args, **kwargs)
  8955. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  8956. res = conn.execute(cmd)
  8957. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  8958. return func(self, *args, **kwargs)
  8959. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  8960. return self._obd.execute(cmd, **kwargs)
  8961. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  8962. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  8963. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  8964. lines = self.send(cmd, raw_response=raw_response)
  8965. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  8966. raise ELM327Error(self.ERRORS[line], code=line)
  8967. ELM327Error: Operation interrupted by a received RS232 character
  8968. 2020-08-04 12:07:07,601 [salt.utils.parsers:1050][WARNING ][418] Minion received a SIGTERM. Exiting.
  8969. 2020-08-04 12:07:08,141 [messaging :871 ][WARNING ][834] No reply message with tag 'obd/res/c057e859-df30-41d4-884c-6efdcca8b787' received within timeout of 30 secs
  8970. 2020-08-04 12:07:08,147 [salt.state :292 ][ERROR ][834] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  8971. 2020-08-04 12:07:25,089 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  8972. 2020-08-04 12:07:25,098 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  8973. 2020-08-04 12:07:25,104 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  8974. 2020-08-04 12:07:25,797 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  8975. Traceback (most recent call last):
  8976. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8977. self._serial.open()
  8978. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8979. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8980. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8981. 2020-08-04 12:07:26,813 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  8982. Traceback (most recent call last):
  8983. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8984. self._serial.open()
  8985. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8986. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8987. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8988. 2020-08-04 12:07:27,132 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  8989. 2020-08-04 12:07:27,635 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  8990. 2020-08-04 12:07:27,817 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  8991. Traceback (most recent call last):
  8992. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  8993. self._serial.open()
  8994. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  8995. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  8996. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  8997. 2020-08-04 12:07:28,138 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  8998. 2020-08-04 12:07:28,140 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  8999. 2020-08-04 12:07:28,417 [messaging :208 ][ERROR ][616] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  9000. Traceback (most recent call last):
  9001. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  9002. self._call_hook_for(message, "workflow", message)
  9003. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9004. return True, func(*args, **kwargs)
  9005. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  9006. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9007. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9008. return True, func(*args, **kwargs)
  9009. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9010. return func(*args, **kwargs)
  9011. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  9012. res = _exec("AT+CCLK?")
  9013. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  9014. conn.write_line(cmd)
  9015. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  9016. self.ensure_open()
  9017. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  9018. self.open()
  9019. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  9020. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  9021. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  9022. raise attempt.get()
  9023. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  9024. six.reraise(self.value[0], self.value[1], self.value[2])
  9025. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  9026. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  9027. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9028. self._serial.open()
  9029. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9030. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9031. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9032. 2020-08-04 12:07:28,644 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  9033. 2020-08-04 12:07:43,331 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][675] Timeout after 1.28205128205 second(s) waiting for interrupt
  9034. 2020-08-04 12:07:43,375 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  9035. Traceback (most recent call last):
  9036. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9037. self._serial.open()
  9038. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9039. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9040. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9041. 2020-08-04 12:07:43,555 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  9042. 2020-08-04 12:07:44,057 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  9043. 2020-08-04 12:07:44,060 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  9044. 2020-08-04 12:07:44,380 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  9045. Traceback (most recent call last):
  9046. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9047. self._serial.open()
  9048. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9049. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9050. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9051. 2020-08-04 12:07:44,563 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  9052. 2020-08-04 12:07:45,067 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  9053. 2020-08-04 12:07:45,384 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  9054. Traceback (most recent call last):
  9055. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9056. self._serial.open()
  9057. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9058. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9059. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9060. 2020-08-04 12:07:45,388 [messaging :206 ][ERROR ][616] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  9061. Traceback (most recent call last):
  9062. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  9063. self._call_hook_for(message, "workflow", message)
  9064. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9065. return True, func(*args, **kwargs)
  9066. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  9067. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9068. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9069. return True, func(*args, **kwargs)
  9070. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9071. return func(*args, **kwargs)
  9072. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  9073. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  9074. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  9075. conn.write_line(cmd)
  9076. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  9077. self.ensure_open()
  9078. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  9079. self.open()
  9080. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  9081. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  9082. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  9083. raise attempt.get()
  9084. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  9085. six.reraise(self.value[0], self.value[1], self.value[2])
  9086. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  9087. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  9088. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9089. self._serial.open()
  9090. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9091. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9092. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9093. 2020-08-04 12:07:45,570 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  9094. 2020-08-04 12:07:45,573 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  9095. 2020-08-04 12:07:45,577 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  9096. 2020-08-04 12:07:46,083 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  9097. 2020-08-04 12:07:46,587 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  9098. 2020-08-04 12:07:46,592 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  9099. 2020-08-04 12:07:47,097 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  9100. 2020-08-04 12:07:47,141 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  9101. Traceback (most recent call last):
  9102. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9103. self._serial.open()
  9104. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9105. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9106. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9107. 2020-08-04 12:07:47,601 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  9108. 2020-08-04 12:07:48,104 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  9109. 2020-08-04 12:07:48,107 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  9110. 2020-08-04 12:07:48,156 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  9111. Traceback (most recent call last):
  9112. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9113. self._serial.open()
  9114. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9115. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9116. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9117. 2020-08-04 12:07:48,612 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  9118. 2020-08-04 12:07:49,115 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  9119. 2020-08-04 12:07:49,169 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  9120. Traceback (most recent call last):
  9121. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9122. self._serial.open()
  9123. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9124. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9125. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9126. 2020-08-04 12:07:49,182 [messaging :742 ][ERROR ][616] Exception while processing event: {'tag': 'ec2x/req/7cc23860-c18d-455d-a792-435cf44fcf42', 'data': {'_stamp': '2020-08-04T12:07:25.185281', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/7cc23860-c18d-455d-a792-435cf44fcf42', 'kwargs': {'cooldown_delay': None}}}
  9127. Traceback (most recent call last):
  9128. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  9129. res = self.process(message)
  9130. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  9131. result = func(message, **settings)
  9132. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  9133. found, result = self._call_hook_for(message, "workflow", message)
  9134. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9135. return True, func(*args, **kwargs)
  9136. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  9137. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9138. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9139. return True, func(*args, **kwargs)
  9140. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9141. return func(*args, **kwargs)
  9142. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  9143. return _exec(cmd, **kwargs)
  9144. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  9145. conn.write_line(cmd)
  9146. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  9147. self.ensure_open()
  9148. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  9149. self.open()
  9150. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  9151. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  9152. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  9153. raise attempt.get()
  9154. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  9155. six.reraise(self.value[0], self.value[1], self.value[2])
  9156. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  9157. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  9158. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9159. self._serial.open()
  9160. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9161. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9162. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9163. 2020-08-04 12:07:49,625 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  9164. 2020-08-04 12:07:49,628 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  9165. 2020-08-04 12:07:49,631 [messaging :208 ][ERROR ][619] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  9166. Traceback (most recent call last):
  9167. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  9168. self._call_hook_for(message, "workflow", message)
  9169. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9170. return True, func(*args, **kwargs)
  9171. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  9172. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9173. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9174. return True, func(*args, **kwargs)
  9175. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9176. return func(*args, **kwargs)
  9177. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  9178. conn.heartbeat()
  9179. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  9180. self.noop()
  9181. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  9182. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  9183. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  9184. raise attempt.get()
  9185. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  9186. six.reraise(self.value[0], self.value[1], self.value[2])
  9187. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  9188. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  9189. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  9190. self._begin_message()
  9191. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  9192. self.recv(ack=ACK_MESSAGE_BEGIN)
  9193. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  9194. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  9195. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  9196. raise attempt.get()
  9197. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  9198. six.reraise(self.value[0], self.value[1], self.value[2])
  9199. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  9200. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  9201. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  9202. raise Exception(msg)
  9203. Exception: Expected ack '12' but got '255'
  9204. 2020-08-04 12:07:51,266 [messaging :208 ][ERROR ][617] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  9205. Traceback (most recent call last):
  9206. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  9207. self._call_hook_for(message, "workflow", message)
  9208. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9209. return True, func(*args, **kwargs)
  9210. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  9211. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9212. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9213. return True, func(*args, **kwargs)
  9214. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9215. return func(*args, **kwargs)
  9216. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  9217. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  9218. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  9219. res = query("AT+QGPSLOC={:d}".format(mode))
  9220. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  9221. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  9222. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  9223. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  9224. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  9225. raise salt.exceptions.CommandExecutionError(message["error"])
  9226. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9227. 2020-08-04 12:07:56,360 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  9228. Traceback (most recent call last):
  9229. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9230. self._serial.open()
  9231. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9232. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9233. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9234. 2020-08-04 12:07:57,364 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  9235. Traceback (most recent call last):
  9236. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9237. self._serial.open()
  9238. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9239. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9240. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9241. 2020-08-04 12:07:58,368 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  9242. Traceback (most recent call last):
  9243. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9244. self._serial.open()
  9245. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9246. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9247. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9248. 2020-08-04 12:07:58,371 [messaging :742 ][ERROR ][616] Exception while processing event: {'tag': 'ec2x/req/50afaffd-b644-4759-a01c-2f194e4ca8da', 'data': {'_stamp': '2020-08-04T12:07:56.344093', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/50afaffd-b644-4759-a01c-2f194e4ca8da', 'kwargs': {'cooldown_delay': None}}}
  9249. Traceback (most recent call last):
  9250. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  9251. res = self.process(message)
  9252. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  9253. result = func(message, **settings)
  9254. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  9255. found, result = self._call_hook_for(message, "workflow", message)
  9256. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9257. return True, func(*args, **kwargs)
  9258. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  9259. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9260. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9261. return True, func(*args, **kwargs)
  9262. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9263. return func(*args, **kwargs)
  9264. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  9265. return _exec(cmd, **kwargs)
  9266. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  9267. conn.write_line(cmd)
  9268. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  9269. self.ensure_open()
  9270. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  9271. self.open()
  9272. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  9273. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  9274. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  9275. raise attempt.get()
  9276. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  9277. six.reraise(self.value[0], self.value[1], self.value[2])
  9278. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  9279. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  9280. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9281. self._serial.open()
  9282. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9283. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9284. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9285. 2020-08-04 12:07:58,397 [messaging :206 ][ERROR ][617] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  9286. Traceback (most recent call last):
  9287. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  9288. self._call_hook_for(message, "workflow", message)
  9289. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9290. return True, func(*args, **kwargs)
  9291. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  9292. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9293. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9294. return True, func(*args, **kwargs)
  9295. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9296. return func(*args, **kwargs)
  9297. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  9298. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  9299. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  9300. res = query("AT+QGPSLOC={:d}".format(mode))
  9301. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  9302. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  9303. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  9304. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  9305. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  9306. raise salt.exceptions.CommandExecutionError(message["error"])
  9307. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9308. 2020-08-04 12:08:02,171 [obd.obd :107 ][ERROR ][658] Failed to use explicit port '/dev/serial0'
  9309. Traceback (most recent call last):
  9310. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  9311. self.interface.open(baudrate, protocol=protocol)
  9312. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  9313. self.set_protocol(prot.pop("id", None), **prot)
  9314. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  9315. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  9316. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  9317. self._protocol = self._auto_protocol(**kwargs)
  9318. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  9319. res_0100 = self._verify_protocol("auto", test=not verify)
  9320. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  9321. for line in self.query("0100", parse=False, read_timeout=10):
  9322. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  9323. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  9324. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  9325. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  9326. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  9327. data = self._port.read(self._port.in_waiting or 1)
  9328. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  9329. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  9330. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  9331. sys.exit(salt.defaults.exitcodes.EX_OK)
  9332. SystemExit: 0
  9333. 2020-08-04 12:08:02,203 [obd.obd :120 ][WARNING ][658] Cannot load commands - no connection to bus
  9334. 2020-08-04 12:08:02,229 [obd.interfaces.elm327:730 ][ERROR ][658] Failed to relay command 'STSLCS' to interface
  9335. Traceback (most recent call last):
  9336. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  9337. lines = self.send(cmd, raw_response=raw_response)
  9338. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  9339. raise ELM327Error(self.ERRORS[line], code=line)
  9340. ELM327Error: Operation interrupted by a received RS232 character
  9341. 2020-08-04 12:08:02,232 [messaging :742 ][ERROR ][658] Exception while processing event: {'tag': 'obd/req/3e6c2636-5889-424a-b066-3f74d9b5e9d2', 'data': {'_stamp': '2020-08-04T12:07:56.642547', 'handler': 'execute', '_event_tag': 'obd/req/3e6c2636-5889-424a-b066-3f74d9b5e9d2', 'args': ['STSLCS']}}
  9342. Traceback (most recent call last):
  9343. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  9344. res = self.process(message)
  9345. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  9346. result = func(message, **settings)
  9347. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  9348. found, result = self._call_hook_for(message, "workflow", message)
  9349. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9350. return True, func(*args, **kwargs)
  9351. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  9352. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9353. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9354. return True, func(*args, **kwargs)
  9355. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9356. return func(*args, **kwargs)
  9357. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  9358. res = conn.execute(cmd)
  9359. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  9360. return func(self, *args, **kwargs)
  9361. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  9362. return self._obd.execute(cmd, **kwargs)
  9363. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  9364. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  9365. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  9366. lines = self.send(cmd, raw_response=raw_response)
  9367. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  9368. raise ELM327Error(self.ERRORS[line], code=line)
  9369. ELM327Error: Operation interrupted by a received RS232 character
  9370. 2020-08-04 12:08:02,961 [salt.utils.parsers:1050][WARNING ][416] Minion received a SIGTERM. Exiting.
  9371. 2020-08-04 12:08:03,501 [messaging :871 ][WARNING ][816] No reply message with tag 'obd/res/3e6c2636-5889-424a-b066-3f74d9b5e9d2' received within timeout of 30 secs
  9372. 2020-08-04 12:08:03,505 [salt.state :292 ][ERROR ][816] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  9373. 2020-08-04 12:08:20,228 [gpio_spi_conn :42 ][WARNING ][615] Unable to clear buffer - got unexpected value: 255
  9374. 2020-08-04 12:08:20,243 [gpio_spi_conn :42 ][WARNING ][615] Unable to clear buffer - got unexpected value: 255
  9375. 2020-08-04 12:08:20,260 [gpio_spi_conn :42 ][WARNING ][615] Unable to clear buffer - got unexpected value: 255
  9376. 2020-08-04 12:08:20,902 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  9377. Traceback (most recent call last):
  9378. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9379. self._serial.open()
  9380. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9381. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9382. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9383. 2020-08-04 12:08:21,917 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  9384. Traceback (most recent call last):
  9385. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9386. self._serial.open()
  9387. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9388. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9389. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9390. 2020-08-04 12:08:22,289 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  9391. 2020-08-04 12:08:22,792 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  9392. 2020-08-04 12:08:22,921 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  9393. Traceback (most recent call last):
  9394. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9395. self._serial.open()
  9396. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9397. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9398. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9399. 2020-08-04 12:08:23,295 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  9400. 2020-08-04 12:08:23,297 [spm_conn :139 ][WARNING ][615] Unable to get status: Expected ack '12' but got '255'
  9401. 2020-08-04 12:08:23,570 [messaging :208 ][ERROR ][612] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  9402. Traceback (most recent call last):
  9403. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  9404. self._call_hook_for(message, "workflow", message)
  9405. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9406. return True, func(*args, **kwargs)
  9407. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  9408. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9409. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9410. return True, func(*args, **kwargs)
  9411. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9412. return func(*args, **kwargs)
  9413. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  9414. res = _exec("AT+CCLK?")
  9415. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  9416. conn.write_line(cmd)
  9417. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  9418. self.ensure_open()
  9419. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  9420. self.open()
  9421. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  9422. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  9423. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  9424. raise attempt.get()
  9425. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  9426. six.reraise(self.value[0], self.value[1], self.value[2])
  9427. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  9428. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  9429. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9430. self._serial.open()
  9431. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9432. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9433. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9434. 2020-08-04 12:08:23,801 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  9435. 2020-08-04 12:08:38,832 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][652] Timeout after 1.28205128205 second(s) waiting for interrupt
  9436. 2020-08-04 12:08:38,920 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  9437. Traceback (most recent call last):
  9438. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9439. self._serial.open()
  9440. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9441. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9442. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9443. 2020-08-04 12:08:39,129 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  9444. 2020-08-04 12:08:39,632 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  9445. 2020-08-04 12:08:39,635 [spm_conn :139 ][WARNING ][615] Unable to get status: Expected ack '12' but got '255'
  9446. 2020-08-04 12:08:39,925 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  9447. Traceback (most recent call last):
  9448. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9449. self._serial.open()
  9450. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9451. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9452. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9453. 2020-08-04 12:08:40,139 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  9454. 2020-08-04 12:08:40,642 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  9455. 2020-08-04 12:08:40,928 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  9456. Traceback (most recent call last):
  9457. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9458. self._serial.open()
  9459. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9460. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9461. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9462. 2020-08-04 12:08:40,932 [messaging :206 ][ERROR ][612] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  9463. Traceback (most recent call last):
  9464. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  9465. self._call_hook_for(message, "workflow", message)
  9466. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9467. return True, func(*args, **kwargs)
  9468. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  9469. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9470. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9471. return True, func(*args, **kwargs)
  9472. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9473. return func(*args, **kwargs)
  9474. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  9475. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  9476. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  9477. conn.write_line(cmd)
  9478. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  9479. self.ensure_open()
  9480. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  9481. self.open()
  9482. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  9483. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  9484. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  9485. raise attempt.get()
  9486. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  9487. six.reraise(self.value[0], self.value[1], self.value[2])
  9488. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  9489. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  9490. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9491. self._serial.open()
  9492. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9493. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9494. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9495. 2020-08-04 12:08:41,145 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  9496. 2020-08-04 12:08:41,148 [spm_conn :139 ][WARNING ][615] Unable to get status: Expected ack '12' but got '255'
  9497. 2020-08-04 12:08:41,151 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  9498. 2020-08-04 12:08:41,655 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  9499. 2020-08-04 12:08:42,158 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  9500. 2020-08-04 12:08:42,160 [spm_conn :82 ][WARNING ][615] Unable to send noop: Expected ack '12' but got '255'
  9501. 2020-08-04 12:08:42,598 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  9502. Traceback (most recent call last):
  9503. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9504. self._serial.open()
  9505. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9506. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9507. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9508. 2020-08-04 12:08:42,665 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  9509. 2020-08-04 12:08:43,170 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  9510. 2020-08-04 12:08:43,625 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  9511. Traceback (most recent call last):
  9512. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9513. self._serial.open()
  9514. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9515. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9516. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9517. 2020-08-04 12:08:43,674 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  9518. 2020-08-04 12:08:43,676 [spm_conn :82 ][WARNING ][615] Unable to send noop: Expected ack '12' but got '255'
  9519. 2020-08-04 12:08:44,179 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  9520. 2020-08-04 12:08:44,629 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  9521. Traceback (most recent call last):
  9522. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9523. self._serial.open()
  9524. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9525. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9526. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9527. 2020-08-04 12:08:44,632 [messaging :742 ][ERROR ][612] Exception while processing event: {'tag': 'ec2x/req/35cdeb83-1d46-4378-8c7a-96a71ea2f24b', 'data': {'_stamp': '2020-08-04T12:08:20.322176', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/35cdeb83-1d46-4378-8c7a-96a71ea2f24b', 'kwargs': {'cooldown_delay': None}}}
  9528. Traceback (most recent call last):
  9529. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  9530. res = self.process(message)
  9531. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  9532. result = func(message, **settings)
  9533. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  9534. found, result = self._call_hook_for(message, "workflow", message)
  9535. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9536. return True, func(*args, **kwargs)
  9537. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  9538. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9539. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9540. return True, func(*args, **kwargs)
  9541. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9542. return func(*args, **kwargs)
  9543. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  9544. return _exec(cmd, **kwargs)
  9545. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  9546. conn.write_line(cmd)
  9547. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  9548. self.ensure_open()
  9549. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  9550. self.open()
  9551. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  9552. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  9553. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  9554. raise attempt.get()
  9555. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  9556. six.reraise(self.value[0], self.value[1], self.value[2])
  9557. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  9558. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  9559. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9560. self._serial.open()
  9561. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9562. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9563. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9564. 2020-08-04 12:08:44,682 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  9565. 2020-08-04 12:08:45,185 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  9566. 2020-08-04 12:08:45,187 [spm_conn :82 ][WARNING ][615] Unable to send noop: Expected ack '12' but got '255'
  9567. 2020-08-04 12:08:45,190 [messaging :208 ][ERROR ][615] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  9568. Traceback (most recent call last):
  9569. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  9570. self._call_hook_for(message, "workflow", message)
  9571. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9572. return True, func(*args, **kwargs)
  9573. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  9574. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9575. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9576. return True, func(*args, **kwargs)
  9577. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9578. return func(*args, **kwargs)
  9579. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  9580. conn.heartbeat()
  9581. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  9582. self.noop()
  9583. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  9584. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  9585. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  9586. raise attempt.get()
  9587. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  9588. six.reraise(self.value[0], self.value[1], self.value[2])
  9589. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  9590. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  9591. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  9592. self._begin_message()
  9593. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  9594. self.recv(ack=ACK_MESSAGE_BEGIN)
  9595. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  9596. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  9597. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  9598. raise attempt.get()
  9599. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  9600. six.reraise(self.value[0], self.value[1], self.value[2])
  9601. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  9602. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  9603. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  9604. raise Exception(msg)
  9605. Exception: Expected ack '12' but got '255'
  9606. 2020-08-04 12:08:46,789 [messaging :208 ][ERROR ][613] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  9607. Traceback (most recent call last):
  9608. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  9609. self._call_hook_for(message, "workflow", message)
  9610. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9611. return True, func(*args, **kwargs)
  9612. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  9613. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9614. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9615. return True, func(*args, **kwargs)
  9616. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9617. return func(*args, **kwargs)
  9618. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  9619. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  9620. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  9621. res = query("AT+QGPSLOC={:d}".format(mode))
  9622. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  9623. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  9624. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  9625. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  9626. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  9627. raise salt.exceptions.CommandExecutionError(message["error"])
  9628. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9629. 2020-08-04 12:08:51,852 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  9630. Traceback (most recent call last):
  9631. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9632. self._serial.open()
  9633. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9634. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9635. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9636. 2020-08-04 12:08:52,870 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  9637. Traceback (most recent call last):
  9638. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9639. self._serial.open()
  9640. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9641. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9642. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9643. 2020-08-04 12:08:53,880 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  9644. Traceback (most recent call last):
  9645. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9646. self._serial.open()
  9647. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9648. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9649. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9650. 2020-08-04 12:08:53,883 [messaging :742 ][ERROR ][612] Exception while processing event: {'tag': 'ec2x/req/75769c1c-4d36-4cec-8481-6d0c0c99e0ed', 'data': {'_stamp': '2020-08-04T12:08:51.842975', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/75769c1c-4d36-4cec-8481-6d0c0c99e0ed', 'kwargs': {'cooldown_delay': None}}}
  9651. Traceback (most recent call last):
  9652. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  9653. res = self.process(message)
  9654. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  9655. result = func(message, **settings)
  9656. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  9657. found, result = self._call_hook_for(message, "workflow", message)
  9658. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9659. return True, func(*args, **kwargs)
  9660. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  9661. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9662. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9663. return True, func(*args, **kwargs)
  9664. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9665. return func(*args, **kwargs)
  9666. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  9667. return _exec(cmd, **kwargs)
  9668. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  9669. conn.write_line(cmd)
  9670. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  9671. self.ensure_open()
  9672. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  9673. self.open()
  9674. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  9675. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  9676. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  9677. raise attempt.get()
  9678. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  9679. six.reraise(self.value[0], self.value[1], self.value[2])
  9680. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  9681. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  9682. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9683. self._serial.open()
  9684. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9685. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9686. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9687. 2020-08-04 12:08:53,906 [messaging :206 ][ERROR ][613] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  9688. Traceback (most recent call last):
  9689. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  9690. self._call_hook_for(message, "workflow", message)
  9691. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9692. return True, func(*args, **kwargs)
  9693. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  9694. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9695. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9696. return True, func(*args, **kwargs)
  9697. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9698. return func(*args, **kwargs)
  9699. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  9700. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  9701. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  9702. res = query("AT+QGPSLOC={:d}".format(mode))
  9703. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  9704. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  9705. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  9706. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  9707. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  9708. raise salt.exceptions.CommandExecutionError(message["error"])
  9709. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9710. 2020-08-04 12:08:57,337 [obd.obd :107 ][ERROR ][651] Failed to use explicit port '/dev/serial0'
  9711. Traceback (most recent call last):
  9712. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  9713. self.interface.open(baudrate, protocol=protocol)
  9714. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  9715. self.set_protocol(prot.pop("id", None), **prot)
  9716. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  9717. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  9718. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  9719. self._protocol = self._auto_protocol(**kwargs)
  9720. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  9721. res_0100 = self._verify_protocol("auto", test=not verify)
  9722. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  9723. for line in self.query("0100", parse=False, read_timeout=10):
  9724. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  9725. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  9726. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  9727. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  9728. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  9729. data = self._port.read(self._port.in_waiting or 1)
  9730. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  9731. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  9732. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  9733. sys.exit(salt.defaults.exitcodes.EX_OK)
  9734. SystemExit: 0
  9735. 2020-08-04 12:08:57,370 [obd.obd :120 ][WARNING ][651] Cannot load commands - no connection to bus
  9736. 2020-08-04 12:08:57,399 [obd.interfaces.elm327:730 ][ERROR ][651] Failed to relay command 'STSLCS' to interface
  9737. Traceback (most recent call last):
  9738. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  9739. lines = self.send(cmd, raw_response=raw_response)
  9740. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  9741. raise ELM327Error(self.ERRORS[line], code=line)
  9742. ELM327Error: Operation interrupted by a received RS232 character
  9743. 2020-08-04 12:08:57,403 [messaging :742 ][ERROR ][651] Exception while processing event: {'tag': 'obd/req/11b5f946-4b9c-4047-affc-e72db03d2c09', 'data': {'_stamp': '2020-08-04T12:08:51.850202', 'handler': 'execute', '_event_tag': 'obd/req/11b5f946-4b9c-4047-affc-e72db03d2c09', 'args': ['STSLCS']}}
  9744. Traceback (most recent call last):
  9745. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  9746. res = self.process(message)
  9747. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  9748. result = func(message, **settings)
  9749. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  9750. found, result = self._call_hook_for(message, "workflow", message)
  9751. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9752. return True, func(*args, **kwargs)
  9753. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  9754. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9755. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9756. return True, func(*args, **kwargs)
  9757. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9758. return func(*args, **kwargs)
  9759. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  9760. res = conn.execute(cmd)
  9761. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  9762. return func(self, *args, **kwargs)
  9763. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  9764. return self._obd.execute(cmd, **kwargs)
  9765. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  9766. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  9767. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  9768. lines = self.send(cmd, raw_response=raw_response)
  9769. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  9770. raise ELM327Error(self.ERRORS[line], code=line)
  9771. ELM327Error: Operation interrupted by a received RS232 character
  9772. 2020-08-04 12:08:58,196 [salt.utils.parsers:1050][WARNING ][412] Minion received a SIGTERM. Exiting.
  9773. 2020-08-04 12:08:58,732 [messaging :871 ][WARNING ][812] No reply message with tag 'obd/res/11b5f946-4b9c-4047-affc-e72db03d2c09' received within timeout of 30 secs
  9774. 2020-08-04 12:08:58,736 [salt.state :292 ][ERROR ][812] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  9775. 2020-08-04 12:09:15,180 [gpio_spi_conn :42 ][WARNING ][612] Unable to clear buffer - got unexpected value: 255
  9776. 2020-08-04 12:09:15,213 [gpio_spi_conn :42 ][WARNING ][612] Unable to clear buffer - got unexpected value: 255
  9777. 2020-08-04 12:09:15,216 [gpio_spi_conn :42 ][WARNING ][612] Unable to clear buffer - got unexpected value: 255
  9778. 2020-08-04 12:09:15,848 [serial_conn :79 ][ERROR ][609] Failed to open serial connection
  9779. Traceback (most recent call last):
  9780. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9781. self._serial.open()
  9782. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9783. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9784. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9785. 2020-08-04 12:09:16,860 [serial_conn :79 ][ERROR ][609] Failed to open serial connection
  9786. Traceback (most recent call last):
  9787. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9788. self._serial.open()
  9789. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9790. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9791. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9792. 2020-08-04 12:09:17,246 [gpio_spi_conn :109 ][WARNING ][612] Expected ack '12' but got '255'
  9793. 2020-08-04 12:09:17,749 [gpio_spi_conn :109 ][WARNING ][612] Expected ack '12' but got '255'
  9794. 2020-08-04 12:09:17,863 [serial_conn :79 ][ERROR ][609] Failed to open serial connection
  9795. Traceback (most recent call last):
  9796. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9797. self._serial.open()
  9798. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9799. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9800. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9801. 2020-08-04 12:09:18,251 [gpio_spi_conn :109 ][WARNING ][612] Expected ack '12' but got '255'
  9802. 2020-08-04 12:09:18,253 [spm_conn :139 ][WARNING ][612] Unable to get status: Expected ack '12' but got '255'
  9803. 2020-08-04 12:09:18,480 [messaging :208 ][ERROR ][609] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  9804. Traceback (most recent call last):
  9805. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  9806. self._call_hook_for(message, "workflow", message)
  9807. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9808. return True, func(*args, **kwargs)
  9809. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  9810. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9811. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9812. return True, func(*args, **kwargs)
  9813. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9814. return func(*args, **kwargs)
  9815. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  9816. res = _exec("AT+CCLK?")
  9817. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  9818. conn.write_line(cmd)
  9819. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  9820. self.ensure_open()
  9821. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  9822. self.open()
  9823. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  9824. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  9825. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  9826. raise attempt.get()
  9827. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  9828. six.reraise(self.value[0], self.value[1], self.value[2])
  9829. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  9830. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  9831. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9832. self._serial.open()
  9833. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9834. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9835. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9836. 2020-08-04 12:09:18,757 [gpio_spi_conn :109 ][WARNING ][612] Expected ack '12' but got '255'
  9837. 2020-08-04 12:09:34,033 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][699] Timeout after 1.28205128205 second(s) waiting for interrupt
  9838. 2020-08-04 12:09:34,324 [gpio_spi_conn :109 ][WARNING ][612] Expected ack '12' but got '255'
  9839. 2020-08-04 12:09:34,687 [serial_conn :79 ][ERROR ][609] Failed to open serial connection
  9840. Traceback (most recent call last):
  9841. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9842. self._serial.open()
  9843. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9844. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9845. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9846. 2020-08-04 12:09:34,828 [gpio_spi_conn :109 ][WARNING ][612] Expected ack '12' but got '255'
  9847. 2020-08-04 12:09:34,830 [spm_conn :139 ][WARNING ][612] Unable to get status: Expected ack '12' but got '255'
  9848. 2020-08-04 12:09:35,334 [gpio_spi_conn :109 ][WARNING ][612] Expected ack '12' but got '255'
  9849. 2020-08-04 12:09:35,692 [serial_conn :79 ][ERROR ][609] Failed to open serial connection
  9850. Traceback (most recent call last):
  9851. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9852. self._serial.open()
  9853. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9854. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9855. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9856. 2020-08-04 12:09:35,839 [gpio_spi_conn :109 ][WARNING ][612] Expected ack '12' but got '255'
  9857. 2020-08-04 12:09:36,343 [gpio_spi_conn :109 ][WARNING ][612] Expected ack '12' but got '255'
  9858. 2020-08-04 12:09:36,345 [spm_conn :139 ][WARNING ][612] Unable to get status: Expected ack '12' but got '255'
  9859. 2020-08-04 12:09:36,351 [gpio_spi_conn :109 ][WARNING ][612] Expected ack '12' but got '255'
  9860. 2020-08-04 12:09:36,697 [serial_conn :79 ][ERROR ][609] Failed to open serial connection
  9861. Traceback (most recent call last):
  9862. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9863. self._serial.open()
  9864. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9865. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9866. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9867. 2020-08-04 12:09:36,854 [gpio_spi_conn :109 ][WARNING ][612] Expected ack '12' but got '255'
  9868. 2020-08-04 12:09:37,264 [messaging :206 ][ERROR ][609] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  9869. Traceback (most recent call last):
  9870. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  9871. self._call_hook_for(message, "workflow", message)
  9872. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9873. return True, func(*args, **kwargs)
  9874. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  9875. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9876. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9877. return True, func(*args, **kwargs)
  9878. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9879. return func(*args, **kwargs)
  9880. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  9881. res = _exec("AT+CCLK?")
  9882. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  9883. conn.write_line(cmd)
  9884. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  9885. self.ensure_open()
  9886. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  9887. self.open()
  9888. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  9889. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  9890. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  9891. raise attempt.get()
  9892. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  9893. six.reraise(self.value[0], self.value[1], self.value[2])
  9894. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  9895. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  9896. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9897. self._serial.open()
  9898. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9899. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9900. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9901. 2020-08-04 12:09:37,357 [gpio_spi_conn :109 ][WARNING ][612] Expected ack '12' but got '255'
  9902. 2020-08-04 12:09:37,359 [spm_conn :82 ][WARNING ][612] Unable to send noop: Expected ack '12' but got '255'
  9903. 2020-08-04 12:09:37,863 [gpio_spi_conn :109 ][WARNING ][612] Expected ack '12' but got '255'
  9904. 2020-08-04 12:09:37,936 [serial_conn :79 ][ERROR ][609] Failed to open serial connection
  9905. Traceback (most recent call last):
  9906. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9907. self._serial.open()
  9908. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9909. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9910. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9911. 2020-08-04 12:09:38,366 [gpio_spi_conn :109 ][WARNING ][612] Expected ack '12' but got '255'
  9912. 2020-08-04 12:09:38,869 [gpio_spi_conn :109 ][WARNING ][612] Expected ack '12' but got '255'
  9913. 2020-08-04 12:09:38,871 [spm_conn :82 ][WARNING ][612] Unable to send noop: Expected ack '12' but got '255'
  9914. 2020-08-04 12:09:38,941 [serial_conn :79 ][ERROR ][609] Failed to open serial connection
  9915. Traceback (most recent call last):
  9916. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9917. self._serial.open()
  9918. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9919. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9920. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9921. 2020-08-04 12:09:39,375 [gpio_spi_conn :109 ][WARNING ][612] Expected ack '12' but got '255'
  9922. 2020-08-04 12:09:39,877 [gpio_spi_conn :109 ][WARNING ][612] Expected ack '12' but got '255'
  9923. 2020-08-04 12:09:39,945 [serial_conn :79 ][ERROR ][609] Failed to open serial connection
  9924. Traceback (most recent call last):
  9925. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9926. self._serial.open()
  9927. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9928. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9929. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9930. 2020-08-04 12:09:39,948 [messaging :742 ][ERROR ][609] Exception while processing event: {'tag': 'ec2x/req/39588f82-bfe6-4474-81ad-e2c666991dbc', 'data': {'_stamp': '2020-08-04T12:09:15.268551', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/39588f82-bfe6-4474-81ad-e2c666991dbc', 'kwargs': {'cooldown_delay': None}}}
  9931. Traceback (most recent call last):
  9932. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  9933. res = self.process(message)
  9934. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  9935. result = func(message, **settings)
  9936. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  9937. found, result = self._call_hook_for(message, "workflow", message)
  9938. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9939. return True, func(*args, **kwargs)
  9940. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  9941. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9942. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9943. return True, func(*args, **kwargs)
  9944. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9945. return func(*args, **kwargs)
  9946. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  9947. return _exec(cmd, **kwargs)
  9948. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  9949. conn.write_line(cmd)
  9950. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  9951. self.ensure_open()
  9952. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  9953. self.open()
  9954. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  9955. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  9956. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  9957. raise attempt.get()
  9958. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  9959. six.reraise(self.value[0], self.value[1], self.value[2])
  9960. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  9961. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  9962. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  9963. self._serial.open()
  9964. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  9965. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  9966. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  9967. 2020-08-04 12:09:40,380 [gpio_spi_conn :109 ][WARNING ][612] Expected ack '12' but got '255'
  9968. 2020-08-04 12:09:40,382 [spm_conn :82 ][WARNING ][612] Unable to send noop: Expected ack '12' but got '255'
  9969. 2020-08-04 12:09:40,385 [messaging :208 ][ERROR ][612] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  9970. Traceback (most recent call last):
  9971. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  9972. self._call_hook_for(message, "workflow", message)
  9973. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9974. return True, func(*args, **kwargs)
  9975. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  9976. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  9977. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  9978. return True, func(*args, **kwargs)
  9979. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  9980. return func(*args, **kwargs)
  9981. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  9982. conn.heartbeat()
  9983. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  9984. self.noop()
  9985. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  9986. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  9987. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  9988. raise attempt.get()
  9989. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  9990. six.reraise(self.value[0], self.value[1], self.value[2])
  9991. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  9992. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  9993. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  9994. self._begin_message()
  9995. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  9996. self.recv(ack=ACK_MESSAGE_BEGIN)
  9997. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  9998. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  9999. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  10000. raise attempt.get()
  10001. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  10002. six.reraise(self.value[0], self.value[1], self.value[2])
  10003. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  10004. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  10005. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  10006. raise Exception(msg)
  10007. Exception: Expected ack '12' but got '255'
  10008. 2020-08-04 12:09:42,099 [messaging :208 ][ERROR ][610] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  10009. Traceback (most recent call last):
  10010. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  10011. self._call_hook_for(message, "workflow", message)
  10012. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10013. return True, func(*args, **kwargs)
  10014. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  10015. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10016. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10017. return True, func(*args, **kwargs)
  10018. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10019. return func(*args, **kwargs)
  10020. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  10021. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  10022. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  10023. res = query("AT+QGPSLOC={:d}".format(mode))
  10024. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  10025. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  10026. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  10027. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  10028. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  10029. raise salt.exceptions.CommandExecutionError(message["error"])
  10030. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10031. 2020-08-04 12:09:42,330 [serial_conn :79 ][ERROR ][609] Failed to open serial connection
  10032. Traceback (most recent call last):
  10033. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10034. self._serial.open()
  10035. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10036. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10037. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10038. 2020-08-04 12:09:43,357 [serial_conn :79 ][ERROR ][609] Failed to open serial connection
  10039. Traceback (most recent call last):
  10040. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10041. self._serial.open()
  10042. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10043. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10044. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10045. 2020-08-04 12:09:44,362 [serial_conn :79 ][ERROR ][609] Failed to open serial connection
  10046. Traceback (most recent call last):
  10047. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10048. self._serial.open()
  10049. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10050. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10051. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10052. 2020-08-04 12:09:44,365 [messaging :206 ][ERROR ][609] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  10053. Traceback (most recent call last):
  10054. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  10055. self._call_hook_for(message, "workflow", message)
  10056. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10057. return True, func(*args, **kwargs)
  10058. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  10059. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10060. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10061. return True, func(*args, **kwargs)
  10062. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10063. return func(*args, **kwargs)
  10064. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  10065. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  10066. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  10067. conn.write_line(cmd)
  10068. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  10069. self.ensure_open()
  10070. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  10071. self.open()
  10072. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  10073. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  10074. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  10075. raise attempt.get()
  10076. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  10077. six.reraise(self.value[0], self.value[1], self.value[2])
  10078. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  10079. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  10080. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10081. self._serial.open()
  10082. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10083. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10084. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10085. 2020-08-04 12:09:47,180 [serial_conn :79 ][ERROR ][609] Failed to open serial connection
  10086. Traceback (most recent call last):
  10087. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10088. self._serial.open()
  10089. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10090. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10091. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10092. 2020-08-04 12:09:48,188 [serial_conn :79 ][ERROR ][609] Failed to open serial connection
  10093. Traceback (most recent call last):
  10094. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10095. self._serial.open()
  10096. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10097. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10098. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10099. 2020-08-04 12:09:49,192 [serial_conn :79 ][ERROR ][609] Failed to open serial connection
  10100. Traceback (most recent call last):
  10101. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10102. self._serial.open()
  10103. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10104. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10105. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10106. 2020-08-04 12:09:49,195 [messaging :742 ][ERROR ][609] Exception while processing event: {'tag': 'ec2x/req/e751aae0-a125-4f5c-b779-541bd97990c9', 'data': {'_stamp': '2020-08-04T12:09:47.162166', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/e751aae0-a125-4f5c-b779-541bd97990c9', 'kwargs': {'cooldown_delay': None}}}
  10107. Traceback (most recent call last):
  10108. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  10109. res = self.process(message)
  10110. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  10111. result = func(message, **settings)
  10112. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  10113. found, result = self._call_hook_for(message, "workflow", message)
  10114. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10115. return True, func(*args, **kwargs)
  10116. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  10117. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10118. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10119. return True, func(*args, **kwargs)
  10120. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10121. return func(*args, **kwargs)
  10122. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  10123. return _exec(cmd, **kwargs)
  10124. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  10125. conn.write_line(cmd)
  10126. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  10127. self.ensure_open()
  10128. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  10129. self.open()
  10130. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  10131. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  10132. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  10133. raise attempt.get()
  10134. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  10135. six.reraise(self.value[0], self.value[1], self.value[2])
  10136. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  10137. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  10138. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10139. self._serial.open()
  10140. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10141. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10142. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10143. 2020-08-04 12:09:49,226 [messaging :206 ][ERROR ][610] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  10144. Traceback (most recent call last):
  10145. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  10146. self._call_hook_for(message, "workflow", message)
  10147. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10148. return True, func(*args, **kwargs)
  10149. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  10150. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10151. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10152. return True, func(*args, **kwargs)
  10153. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10154. return func(*args, **kwargs)
  10155. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  10156. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  10157. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  10158. res = query("AT+QGPSLOC={:d}".format(mode))
  10159. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  10160. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  10161. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  10162. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  10163. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  10164. raise salt.exceptions.CommandExecutionError(message["error"])
  10165. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10166. 2020-08-04 12:09:52,644 [obd.obd :107 ][ERROR ][698] Failed to use explicit port '/dev/serial0'
  10167. Traceback (most recent call last):
  10168. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  10169. self.interface.open(baudrate, protocol=protocol)
  10170. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  10171. self.set_protocol(prot.pop("id", None), **prot)
  10172. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  10173. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  10174. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  10175. self._protocol = self._auto_protocol(**kwargs)
  10176. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  10177. res_0100 = self._verify_protocol("auto", test=not verify)
  10178. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  10179. for line in self.query("0100", parse=False, read_timeout=10):
  10180. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  10181. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  10182. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  10183. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  10184. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  10185. data = self._port.read(self._port.in_waiting or 1)
  10186. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  10187. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  10188. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  10189. sys.exit(salt.defaults.exitcodes.EX_OK)
  10190. SystemExit: 0
  10191. 2020-08-04 12:09:52,669 [obd.obd :120 ][WARNING ][698] Cannot load commands - no connection to bus
  10192. 2020-08-04 12:09:52,701 [obd.interfaces.elm327:730 ][ERROR ][698] Failed to relay command 'STSLCS' to interface
  10193. Traceback (most recent call last):
  10194. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  10195. lines = self.send(cmd, raw_response=raw_response)
  10196. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  10197. raise ELM327Error(self.ERRORS[line], code=line)
  10198. ELM327Error: Operation interrupted by a received RS232 character
  10199. 2020-08-04 12:09:52,704 [messaging :742 ][ERROR ][698] Exception while processing event: {'tag': 'obd/req/688ae745-bbdb-43aa-a3e4-639a1cf10b1d', 'data': {'_stamp': '2020-08-04T12:09:47.127990', 'handler': 'execute', '_event_tag': 'obd/req/688ae745-bbdb-43aa-a3e4-639a1cf10b1d', 'args': ['STSLCS']}}
  10200. Traceback (most recent call last):
  10201. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  10202. res = self.process(message)
  10203. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  10204. result = func(message, **settings)
  10205. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  10206. found, result = self._call_hook_for(message, "workflow", message)
  10207. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10208. return True, func(*args, **kwargs)
  10209. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  10210. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10211. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10212. return True, func(*args, **kwargs)
  10213. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10214. return func(*args, **kwargs)
  10215. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  10216. res = conn.execute(cmd)
  10217. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  10218. return func(self, *args, **kwargs)
  10219. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  10220. return self._obd.execute(cmd, **kwargs)
  10221. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  10222. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  10223. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  10224. lines = self.send(cmd, raw_response=raw_response)
  10225. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  10226. raise ELM327Error(self.ERRORS[line], code=line)
  10227. ELM327Error: Operation interrupted by a received RS232 character
  10228. 2020-08-04 12:09:53,491 [salt.utils.parsers:1050][WARNING ][409] Minion received a SIGTERM. Exiting.
  10229. 2020-08-04 12:09:54,031 [messaging :871 ][WARNING ][836] No reply message with tag 'obd/res/688ae745-bbdb-43aa-a3e4-639a1cf10b1d' received within timeout of 30 secs
  10230. 2020-08-04 12:09:54,035 [salt.state :292 ][ERROR ][836] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  10231. 2020-08-04 12:10:10,893 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  10232. 2020-08-04 12:10:10,905 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  10233. 2020-08-04 12:10:10,917 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  10234. 2020-08-04 12:10:11,578 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  10235. Traceback (most recent call last):
  10236. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10237. self._serial.open()
  10238. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10239. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10240. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10241. 2020-08-04 12:10:12,589 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  10242. Traceback (most recent call last):
  10243. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10244. self._serial.open()
  10245. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10246. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10247. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10248. 2020-08-04 12:10:12,948 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  10249. 2020-08-04 12:10:13,451 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  10250. 2020-08-04 12:10:13,593 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  10251. Traceback (most recent call last):
  10252. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10253. self._serial.open()
  10254. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10255. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10256. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10257. 2020-08-04 12:10:13,954 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  10258. 2020-08-04 12:10:13,957 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  10259. 2020-08-04 12:10:14,180 [messaging :208 ][ERROR ][618] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  10260. Traceback (most recent call last):
  10261. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  10262. self._call_hook_for(message, "workflow", message)
  10263. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10264. return True, func(*args, **kwargs)
  10265. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  10266. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10267. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10268. return True, func(*args, **kwargs)
  10269. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10270. return func(*args, **kwargs)
  10271. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  10272. res = _exec("AT+CCLK?")
  10273. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  10274. conn.write_line(cmd)
  10275. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  10276. self.ensure_open()
  10277. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  10278. self.open()
  10279. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  10280. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  10281. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  10282. raise attempt.get()
  10283. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  10284. six.reraise(self.value[0], self.value[1], self.value[2])
  10285. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  10286. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  10287. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10288. self._serial.open()
  10289. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10290. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10291. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10292. 2020-08-04 12:10:14,460 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  10293. 2020-08-04 12:10:29,039 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][708] Timeout after 1.28205128205 second(s) waiting for interrupt
  10294. 2020-08-04 12:10:29,117 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  10295. Traceback (most recent call last):
  10296. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10297. self._serial.open()
  10298. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10299. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10300. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10301. 2020-08-04 12:10:29,398 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  10302. 2020-08-04 12:10:29,901 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  10303. 2020-08-04 12:10:29,904 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  10304. 2020-08-04 12:10:30,121 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  10305. Traceback (most recent call last):
  10306. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10307. self._serial.open()
  10308. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10309. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10310. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10311. 2020-08-04 12:10:30,408 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  10312. 2020-08-04 12:10:30,912 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  10313. 2020-08-04 12:10:31,125 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  10314. Traceback (most recent call last):
  10315. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10316. self._serial.open()
  10317. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10318. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10319. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10320. 2020-08-04 12:10:31,129 [messaging :206 ][ERROR ][618] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  10321. Traceback (most recent call last):
  10322. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  10323. self._call_hook_for(message, "workflow", message)
  10324. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10325. return True, func(*args, **kwargs)
  10326. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  10327. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10328. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10329. return True, func(*args, **kwargs)
  10330. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10331. return func(*args, **kwargs)
  10332. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  10333. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  10334. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  10335. conn.write_line(cmd)
  10336. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  10337. self.ensure_open()
  10338. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  10339. self.open()
  10340. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  10341. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  10342. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  10343. raise attempt.get()
  10344. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  10345. six.reraise(self.value[0], self.value[1], self.value[2])
  10346. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  10347. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  10348. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10349. self._serial.open()
  10350. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10351. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10352. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10353. 2020-08-04 12:10:31,418 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  10354. 2020-08-04 12:10:31,420 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  10355. 2020-08-04 12:10:31,425 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  10356. 2020-08-04 12:10:31,928 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  10357. 2020-08-04 12:10:32,430 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  10358. 2020-08-04 12:10:32,432 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  10359. 2020-08-04 12:10:32,882 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  10360. Traceback (most recent call last):
  10361. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10362. self._serial.open()
  10363. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10364. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10365. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10366. 2020-08-04 12:10:32,938 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  10367. 2020-08-04 12:10:33,444 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  10368. 2020-08-04 12:10:33,887 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  10369. Traceback (most recent call last):
  10370. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10371. self._serial.open()
  10372. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10373. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10374. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10375. 2020-08-04 12:10:33,950 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  10376. 2020-08-04 12:10:33,952 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  10377. 2020-08-04 12:10:34,455 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  10378. 2020-08-04 12:10:34,891 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  10379. Traceback (most recent call last):
  10380. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10381. self._serial.open()
  10382. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10383. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10384. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10385. 2020-08-04 12:10:34,895 [messaging :742 ][ERROR ][618] Exception while processing event: {'tag': 'ec2x/req/afc87988-3530-4fcd-b585-f1f642b82e72', 'data': {'_stamp': '2020-08-04T12:10:10.969240', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/afc87988-3530-4fcd-b585-f1f642b82e72', 'kwargs': {'cooldown_delay': None}}}
  10386. Traceback (most recent call last):
  10387. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  10388. res = self.process(message)
  10389. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  10390. result = func(message, **settings)
  10391. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  10392. found, result = self._call_hook_for(message, "workflow", message)
  10393. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10394. return True, func(*args, **kwargs)
  10395. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  10396. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10397. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10398. return True, func(*args, **kwargs)
  10399. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10400. return func(*args, **kwargs)
  10401. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  10402. return _exec(cmd, **kwargs)
  10403. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  10404. conn.write_line(cmd)
  10405. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  10406. self.ensure_open()
  10407. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  10408. self.open()
  10409. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  10410. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  10411. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  10412. raise attempt.get()
  10413. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  10414. six.reraise(self.value[0], self.value[1], self.value[2])
  10415. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  10416. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  10417. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10418. self._serial.open()
  10419. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10420. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10421. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10422. 2020-08-04 12:10:34,960 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  10423. 2020-08-04 12:10:35,463 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  10424. 2020-08-04 12:10:35,466 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  10425. 2020-08-04 12:10:35,468 [messaging :208 ][ERROR ][621] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  10426. Traceback (most recent call last):
  10427. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  10428. self._call_hook_for(message, "workflow", message)
  10429. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10430. return True, func(*args, **kwargs)
  10431. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  10432. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10433. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10434. return True, func(*args, **kwargs)
  10435. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10436. return func(*args, **kwargs)
  10437. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  10438. conn.heartbeat()
  10439. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  10440. self.noop()
  10441. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  10442. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  10443. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  10444. raise attempt.get()
  10445. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  10446. six.reraise(self.value[0], self.value[1], self.value[2])
  10447. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  10448. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  10449. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  10450. self._begin_message()
  10451. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  10452. self.recv(ack=ACK_MESSAGE_BEGIN)
  10453. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  10454. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  10455. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  10456. raise attempt.get()
  10457. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  10458. six.reraise(self.value[0], self.value[1], self.value[2])
  10459. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  10460. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  10461. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  10462. raise Exception(msg)
  10463. Exception: Expected ack '12' but got '255'
  10464. 2020-08-04 12:10:37,049 [messaging :208 ][ERROR ][619] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  10465. Traceback (most recent call last):
  10466. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  10467. self._call_hook_for(message, "workflow", message)
  10468. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10469. return True, func(*args, **kwargs)
  10470. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  10471. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10472. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10473. return True, func(*args, **kwargs)
  10474. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10475. return func(*args, **kwargs)
  10476. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  10477. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  10478. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  10479. res = query("AT+QGPSLOC={:d}".format(mode))
  10480. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  10481. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  10482. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  10483. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  10484. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  10485. raise salt.exceptions.CommandExecutionError(message["error"])
  10486. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10487. 2020-08-04 12:10:42,093 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  10488. Traceback (most recent call last):
  10489. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10490. self._serial.open()
  10491. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10492. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10493. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10494. 2020-08-04 12:10:43,097 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  10495. Traceback (most recent call last):
  10496. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10497. self._serial.open()
  10498. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10499. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10500. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10501. 2020-08-04 12:10:44,101 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  10502. Traceback (most recent call last):
  10503. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10504. self._serial.open()
  10505. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10506. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10507. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10508. 2020-08-04 12:10:44,104 [messaging :742 ][ERROR ][618] Exception while processing event: {'tag': 'ec2x/req/f4c1bdb9-6d93-4bcb-8bbb-b25c09c75972', 'data': {'_stamp': '2020-08-04T12:10:42.086318', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/f4c1bdb9-6d93-4bcb-8bbb-b25c09c75972', 'kwargs': {'cooldown_delay': None}}}
  10509. Traceback (most recent call last):
  10510. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  10511. res = self.process(message)
  10512. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  10513. result = func(message, **settings)
  10514. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  10515. found, result = self._call_hook_for(message, "workflow", message)
  10516. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10517. return True, func(*args, **kwargs)
  10518. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  10519. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10520. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10521. return True, func(*args, **kwargs)
  10522. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10523. return func(*args, **kwargs)
  10524. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  10525. return _exec(cmd, **kwargs)
  10526. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  10527. conn.write_line(cmd)
  10528. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  10529. self.ensure_open()
  10530. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  10531. self.open()
  10532. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  10533. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  10534. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  10535. raise attempt.get()
  10536. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  10537. six.reraise(self.value[0], self.value[1], self.value[2])
  10538. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  10539. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  10540. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10541. self._serial.open()
  10542. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10543. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10544. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10545. 2020-08-04 12:10:44,140 [messaging :206 ][ERROR ][619] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  10546. Traceback (most recent call last):
  10547. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  10548. self._call_hook_for(message, "workflow", message)
  10549. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10550. return True, func(*args, **kwargs)
  10551. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  10552. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10553. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10554. return True, func(*args, **kwargs)
  10555. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10556. return func(*args, **kwargs)
  10557. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  10558. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  10559. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  10560. res = query("AT+QGPSLOC={:d}".format(mode))
  10561. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  10562. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  10563. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  10564. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  10565. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  10566. raise salt.exceptions.CommandExecutionError(message["error"])
  10567. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10568. 2020-08-04 12:10:47,416 [obd.obd :107 ][ERROR ][705] Failed to use explicit port '/dev/serial0'
  10569. Traceback (most recent call last):
  10570. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  10571. self.interface.open(baudrate, protocol=protocol)
  10572. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  10573. self.set_protocol(prot.pop("id", None), **prot)
  10574. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  10575. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  10576. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  10577. self._protocol = self._auto_protocol(**kwargs)
  10578. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  10579. res_0100 = self._verify_protocol("auto", test=not verify)
  10580. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  10581. for line in self.query("0100", parse=False, read_timeout=10):
  10582. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  10583. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  10584. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  10585. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  10586. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  10587. data = self._port.read(self._port.in_waiting or 1)
  10588. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  10589. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  10590. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  10591. sys.exit(salt.defaults.exitcodes.EX_OK)
  10592. SystemExit: 0
  10593. 2020-08-04 12:10:47,460 [obd.obd :120 ][WARNING ][705] Cannot load commands - no connection to bus
  10594. 2020-08-04 12:10:47,490 [obd.interfaces.elm327:730 ][ERROR ][705] Failed to relay command 'STSLCS' to interface
  10595. Traceback (most recent call last):
  10596. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  10597. lines = self.send(cmd, raw_response=raw_response)
  10598. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  10599. raise ELM327Error(self.ERRORS[line], code=line)
  10600. ELM327Error: Operation interrupted by a received RS232 character
  10601. 2020-08-04 12:10:47,493 [messaging :742 ][ERROR ][705] Exception while processing event: {'tag': 'obd/req/508b8125-1884-4b61-80e0-e3635682f878', 'data': {'_stamp': '2020-08-04T12:10:41.922663', 'handler': 'execute', '_event_tag': 'obd/req/508b8125-1884-4b61-80e0-e3635682f878', 'args': ['STSLCS']}}
  10602. Traceback (most recent call last):
  10603. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  10604. res = self.process(message)
  10605. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  10606. result = func(message, **settings)
  10607. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  10608. found, result = self._call_hook_for(message, "workflow", message)
  10609. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10610. return True, func(*args, **kwargs)
  10611. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  10612. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10613. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10614. return True, func(*args, **kwargs)
  10615. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10616. return func(*args, **kwargs)
  10617. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  10618. res = conn.execute(cmd)
  10619. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  10620. return func(self, *args, **kwargs)
  10621. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  10622. return self._obd.execute(cmd, **kwargs)
  10623. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  10624. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  10625. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  10626. lines = self.send(cmd, raw_response=raw_response)
  10627. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  10628. raise ELM327Error(self.ERRORS[line], code=line)
  10629. ELM327Error: Operation interrupted by a received RS232 character
  10630. 2020-08-04 12:10:48,339 [salt.utils.parsers:1050][WARNING ][417] Minion received a SIGTERM. Exiting.
  10631. 2020-08-04 12:10:48,879 [messaging :871 ][WARNING ][818] No reply message with tag 'obd/res/508b8125-1884-4b61-80e0-e3635682f878' received within timeout of 30 secs
  10632. 2020-08-04 12:10:48,883 [salt.state :292 ][ERROR ][818] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  10633. 2020-08-04 12:11:06,042 [gpio_spi_conn :42 ][WARNING ][632] Unable to clear buffer - got unexpected value: 255
  10634. 2020-08-04 12:11:06,061 [gpio_spi_conn :42 ][WARNING ][632] Unable to clear buffer - got unexpected value: 255
  10635. 2020-08-04 12:11:06,069 [gpio_spi_conn :42 ][WARNING ][632] Unable to clear buffer - got unexpected value: 255
  10636. 2020-08-04 12:11:06,730 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  10637. Traceback (most recent call last):
  10638. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10639. self._serial.open()
  10640. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10641. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10642. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10643. 2020-08-04 12:11:07,744 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  10644. Traceback (most recent call last):
  10645. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10646. self._serial.open()
  10647. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10648. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10649. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10650. 2020-08-04 12:11:08,107 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  10651. 2020-08-04 12:11:08,610 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  10652. 2020-08-04 12:11:08,748 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  10653. Traceback (most recent call last):
  10654. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10655. self._serial.open()
  10656. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10657. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10658. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10659. 2020-08-04 12:11:09,113 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  10660. 2020-08-04 12:11:09,115 [spm_conn :139 ][WARNING ][632] Unable to get status: Expected ack '12' but got '255'
  10661. 2020-08-04 12:11:09,340 [messaging :208 ][ERROR ][629] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  10662. Traceback (most recent call last):
  10663. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  10664. self._call_hook_for(message, "workflow", message)
  10665. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10666. return True, func(*args, **kwargs)
  10667. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  10668. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10669. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10670. return True, func(*args, **kwargs)
  10671. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10672. return func(*args, **kwargs)
  10673. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  10674. res = _exec("AT+CCLK?")
  10675. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  10676. conn.write_line(cmd)
  10677. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  10678. self.ensure_open()
  10679. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  10680. self.open()
  10681. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  10682. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  10683. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  10684. raise attempt.get()
  10685. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  10686. six.reraise(self.value[0], self.value[1], self.value[2])
  10687. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  10688. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  10689. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10690. self._serial.open()
  10691. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10692. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10693. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10694. 2020-08-04 12:11:09,619 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  10695. 2020-08-04 12:11:10,122 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  10696. 2020-08-04 12:11:10,626 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  10697. 2020-08-04 12:11:10,630 [spm_conn :139 ][WARNING ][632] Unable to get status: Expected ack '12' but got '255'
  10698. 2020-08-04 12:11:11,135 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  10699. 2020-08-04 12:11:11,648 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  10700. 2020-08-04 12:11:12,152 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  10701. 2020-08-04 12:11:12,155 [spm_conn :139 ][WARNING ][632] Unable to get status: Expected ack '12' but got '255'
  10702. 2020-08-04 12:11:12,158 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  10703. 2020-08-04 12:11:12,662 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  10704. 2020-08-04 12:11:13,165 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  10705. 2020-08-04 12:11:13,168 [spm_conn :82 ][WARNING ][632] Unable to send noop: Expected ack '12' but got '255'
  10706. 2020-08-04 12:11:13,571 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  10707. Traceback (most recent call last):
  10708. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10709. self._serial.open()
  10710. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10711. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10712. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10713. 2020-08-04 12:11:13,675 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  10714. 2020-08-04 12:11:14,178 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  10715. 2020-08-04 12:11:14,576 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  10716. Traceback (most recent call last):
  10717. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10718. self._serial.open()
  10719. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10720. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10721. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10722. 2020-08-04 12:11:14,681 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  10723. 2020-08-04 12:11:14,683 [spm_conn :82 ][WARNING ][632] Unable to send noop: Expected ack '12' but got '255'
  10724. 2020-08-04 12:11:15,187 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  10725. 2020-08-04 12:11:15,580 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  10726. Traceback (most recent call last):
  10727. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10728. self._serial.open()
  10729. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10730. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10731. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10732. 2020-08-04 12:11:15,583 [messaging :742 ][ERROR ][629] Exception while processing event: {'tag': 'ec2x/req/78ac7405-012a-4822-946c-dbb5ea3f3940', 'data': {'_stamp': '2020-08-04T12:11:06.130394', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/78ac7405-012a-4822-946c-dbb5ea3f3940', 'kwargs': {'cooldown_delay': None}}}
  10733. Traceback (most recent call last):
  10734. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  10735. res = self.process(message)
  10736. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  10737. result = func(message, **settings)
  10738. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  10739. found, result = self._call_hook_for(message, "workflow", message)
  10740. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10741. return True, func(*args, **kwargs)
  10742. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  10743. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10744. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10745. return True, func(*args, **kwargs)
  10746. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10747. return func(*args, **kwargs)
  10748. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  10749. return _exec(cmd, **kwargs)
  10750. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  10751. conn.write_line(cmd)
  10752. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  10753. self.ensure_open()
  10754. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  10755. self.open()
  10756. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  10757. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  10758. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  10759. raise attempt.get()
  10760. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  10761. six.reraise(self.value[0], self.value[1], self.value[2])
  10762. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  10763. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  10764. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10765. self._serial.open()
  10766. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10767. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10768. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10769. 2020-08-04 12:11:15,689 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  10770. 2020-08-04 12:11:16,193 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  10771. 2020-08-04 12:11:16,195 [spm_conn :82 ][WARNING ][632] Unable to send noop: Expected ack '12' but got '255'
  10772. 2020-08-04 12:11:16,198 [messaging :208 ][ERROR ][632] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  10773. Traceback (most recent call last):
  10774. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  10775. self._call_hook_for(message, "workflow", message)
  10776. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10777. return True, func(*args, **kwargs)
  10778. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  10779. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10780. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10781. return True, func(*args, **kwargs)
  10782. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10783. return func(*args, **kwargs)
  10784. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  10785. conn.heartbeat()
  10786. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  10787. self.noop()
  10788. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  10789. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  10790. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  10791. raise attempt.get()
  10792. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  10793. six.reraise(self.value[0], self.value[1], self.value[2])
  10794. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  10795. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  10796. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  10797. self._begin_message()
  10798. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  10799. self.recv(ack=ACK_MESSAGE_BEGIN)
  10800. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  10801. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  10802. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  10803. raise attempt.get()
  10804. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  10805. six.reraise(self.value[0], self.value[1], self.value[2])
  10806. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  10807. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  10808. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  10809. raise Exception(msg)
  10810. Exception: Expected ack '12' but got '255'
  10811. 2020-08-04 12:11:16,229 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  10812. Traceback (most recent call last):
  10813. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10814. self._serial.open()
  10815. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10816. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10817. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10818. 2020-08-04 12:11:17,234 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  10819. Traceback (most recent call last):
  10820. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10821. self._serial.open()
  10822. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10823. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10824. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10825. 2020-08-04 12:11:17,902 [messaging :208 ][ERROR ][630] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  10826. Traceback (most recent call last):
  10827. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  10828. self._call_hook_for(message, "workflow", message)
  10829. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10830. return True, func(*args, **kwargs)
  10831. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  10832. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10833. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10834. return True, func(*args, **kwargs)
  10835. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10836. return func(*args, **kwargs)
  10837. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  10838. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  10839. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  10840. res = query("AT+QGPSLOC={:d}".format(mode))
  10841. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  10842. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  10843. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  10844. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  10845. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  10846. raise salt.exceptions.CommandExecutionError(message["error"])
  10847. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10848. 2020-08-04 12:11:18,238 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  10849. Traceback (most recent call last):
  10850. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10851. self._serial.open()
  10852. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10853. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10854. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10855. 2020-08-04 12:11:18,738 [messaging :206 ][ERROR ][629] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  10856. Traceback (most recent call last):
  10857. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  10858. self._call_hook_for(message, "workflow", message)
  10859. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10860. return True, func(*args, **kwargs)
  10861. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  10862. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10863. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10864. return True, func(*args, **kwargs)
  10865. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10866. return func(*args, **kwargs)
  10867. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  10868. res = _exec("AT+CCLK?")
  10869. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  10870. conn.write_line(cmd)
  10871. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  10872. self.ensure_open()
  10873. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  10874. self.open()
  10875. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  10876. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  10877. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  10878. raise attempt.get()
  10879. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  10880. six.reraise(self.value[0], self.value[1], self.value[2])
  10881. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  10882. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  10883. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10884. self._serial.open()
  10885. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10886. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10887. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10888. 2020-08-04 12:11:33,358 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][669] Timeout after 1.28205128205 second(s) waiting for interrupt
  10889. 2020-08-04 12:11:33,403 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  10890. Traceback (most recent call last):
  10891. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10892. self._serial.open()
  10893. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10894. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10895. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10896. 2020-08-04 12:11:34,408 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  10897. Traceback (most recent call last):
  10898. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10899. self._serial.open()
  10900. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10901. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10902. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10903. 2020-08-04 12:11:35,412 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  10904. Traceback (most recent call last):
  10905. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10906. self._serial.open()
  10907. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10908. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10909. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10910. 2020-08-04 12:11:35,415 [messaging :206 ][ERROR ][629] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  10911. Traceback (most recent call last):
  10912. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  10913. self._call_hook_for(message, "workflow", message)
  10914. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10915. return True, func(*args, **kwargs)
  10916. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  10917. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10918. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10919. return True, func(*args, **kwargs)
  10920. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10921. return func(*args, **kwargs)
  10922. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  10923. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  10924. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  10925. conn.write_line(cmd)
  10926. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  10927. self.ensure_open()
  10928. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  10929. self.open()
  10930. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  10931. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  10932. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  10933. raise attempt.get()
  10934. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  10935. six.reraise(self.value[0], self.value[1], self.value[2])
  10936. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  10937. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  10938. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10939. self._serial.open()
  10940. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10941. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10942. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10943. 2020-08-04 12:11:35,428 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  10944. Traceback (most recent call last):
  10945. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10946. self._serial.open()
  10947. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10948. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10949. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10950. 2020-08-04 12:11:36,433 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  10951. Traceback (most recent call last):
  10952. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10953. self._serial.open()
  10954. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10955. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10956. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10957. 2020-08-04 12:11:37,438 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  10958. Traceback (most recent call last):
  10959. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10960. self._serial.open()
  10961. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10962. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  10963. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  10964. 2020-08-04 12:11:37,442 [messaging :742 ][ERROR ][629] Exception while processing event: {'tag': 'ec2x/req/10a5aee4-6279-4ab9-892d-74176fbadcb9', 'data': {'_stamp': '2020-08-04T12:11:33.365144', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/10a5aee4-6279-4ab9-892d-74176fbadcb9', 'kwargs': {'cooldown_delay': None}}}
  10965. Traceback (most recent call last):
  10966. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  10967. res = self.process(message)
  10968. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  10969. result = func(message, **settings)
  10970. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  10971. found, result = self._call_hook_for(message, "workflow", message)
  10972. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10973. return True, func(*args, **kwargs)
  10974. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  10975. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  10976. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  10977. return True, func(*args, **kwargs)
  10978. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  10979. return func(*args, **kwargs)
  10980. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  10981. return _exec(cmd, **kwargs)
  10982. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  10983. conn.write_line(cmd)
  10984. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  10985. self.ensure_open()
  10986. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  10987. self.open()
  10988. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  10989. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  10990. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  10991. raise attempt.get()
  10992. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  10993. six.reraise(self.value[0], self.value[1], self.value[2])
  10994. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  10995. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  10996. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  10997. self._serial.open()
  10998. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  10999. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11000. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11001. 2020-08-04 12:11:37,463 [messaging :206 ][ERROR ][630] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  11002. Traceback (most recent call last):
  11003. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  11004. self._call_hook_for(message, "workflow", message)
  11005. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11006. return True, func(*args, **kwargs)
  11007. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  11008. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11009. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11010. return True, func(*args, **kwargs)
  11011. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11012. return func(*args, **kwargs)
  11013. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  11014. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  11015. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  11016. res = query("AT+QGPSLOC={:d}".format(mode))
  11017. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  11018. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  11019. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  11020. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  11021. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  11022. raise salt.exceptions.CommandExecutionError(message["error"])
  11023. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11024. 2020-08-04 12:11:42,673 [obd.obd :107 ][ERROR ][668] Failed to use explicit port '/dev/serial0'
  11025. Traceback (most recent call last):
  11026. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  11027. self.interface.open(baudrate, protocol=protocol)
  11028. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  11029. self.set_protocol(prot.pop("id", None), **prot)
  11030. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  11031. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  11032. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  11033. self._protocol = self._auto_protocol(**kwargs)
  11034. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  11035. res_0100 = self._verify_protocol("auto", test=not verify)
  11036. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  11037. for line in self.query("0100", parse=False, read_timeout=10):
  11038. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  11039. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  11040. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  11041. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  11042. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  11043. data = self._port.read(self._port.in_waiting or 1)
  11044. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  11045. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  11046. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  11047. sys.exit(salt.defaults.exitcodes.EX_OK)
  11048. SystemExit: 0
  11049. 2020-08-04 12:11:42,698 [obd.obd :120 ][WARNING ][668] Cannot load commands - no connection to bus
  11050. 2020-08-04 12:11:42,729 [obd.interfaces.elm327:730 ][ERROR ][668] Failed to relay command 'STSLCS' to interface
  11051. Traceback (most recent call last):
  11052. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  11053. lines = self.send(cmd, raw_response=raw_response)
  11054. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  11055. raise ELM327Error(self.ERRORS[line], code=line)
  11056. ELM327Error: Operation interrupted by a received RS232 character
  11057. 2020-08-04 12:11:42,733 [messaging :742 ][ERROR ][668] Exception while processing event: {'tag': 'obd/req/87a35b8a-8df5-42c3-baa6-09f7ca542f9c', 'data': {'_stamp': '2020-08-04T12:11:37.195874', 'handler': 'execute', '_event_tag': 'obd/req/87a35b8a-8df5-42c3-baa6-09f7ca542f9c', 'args': ['STSLCS']}}
  11058. Traceback (most recent call last):
  11059. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  11060. res = self.process(message)
  11061. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  11062. result = func(message, **settings)
  11063. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  11064. found, result = self._call_hook_for(message, "workflow", message)
  11065. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11066. return True, func(*args, **kwargs)
  11067. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  11068. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11069. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11070. return True, func(*args, **kwargs)
  11071. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11072. return func(*args, **kwargs)
  11073. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  11074. res = conn.execute(cmd)
  11075. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  11076. return func(self, *args, **kwargs)
  11077. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  11078. return self._obd.execute(cmd, **kwargs)
  11079. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  11080. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  11081. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  11082. lines = self.send(cmd, raw_response=raw_response)
  11083. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  11084. raise ELM327Error(self.ERRORS[line], code=line)
  11085. ELM327Error: Operation interrupted by a received RS232 character
  11086. 2020-08-04 12:11:43,514 [salt.utils.parsers:1050][WARNING ][429] Minion received a SIGTERM. Exiting.
  11087. 2020-08-04 12:11:44,051 [messaging :871 ][WARNING ][843] No reply message with tag 'obd/res/87a35b8a-8df5-42c3-baa6-09f7ca542f9c' received within timeout of 30 secs
  11088. 2020-08-04 12:11:44,055 [salt.state :292 ][ERROR ][843] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  11089. 2020-08-04 12:12:01,020 [gpio_spi_conn :42 ][WARNING ][625] Unable to clear buffer - got unexpected value: 255
  11090. 2020-08-04 12:12:01,033 [gpio_spi_conn :42 ][WARNING ][625] Unable to clear buffer - got unexpected value: 255
  11091. 2020-08-04 12:12:01,048 [gpio_spi_conn :42 ][WARNING ][625] Unable to clear buffer - got unexpected value: 255
  11092. 2020-08-04 12:12:01,706 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  11093. Traceback (most recent call last):
  11094. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11095. self._serial.open()
  11096. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11097. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11098. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11099. 2020-08-04 12:12:02,720 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  11100. Traceback (most recent call last):
  11101. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11102. self._serial.open()
  11103. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11104. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11105. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11106. 2020-08-04 12:12:03,094 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  11107. 2020-08-04 12:12:03,597 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  11108. 2020-08-04 12:12:03,724 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  11109. Traceback (most recent call last):
  11110. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11111. self._serial.open()
  11112. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11113. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11114. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11115. 2020-08-04 12:12:04,100 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  11116. 2020-08-04 12:12:04,102 [spm_conn :139 ][WARNING ][625] Unable to get status: Expected ack '12' but got '255'
  11117. 2020-08-04 12:12:04,307 [messaging :208 ][ERROR ][622] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  11118. Traceback (most recent call last):
  11119. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  11120. self._call_hook_for(message, "workflow", message)
  11121. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11122. return True, func(*args, **kwargs)
  11123. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  11124. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11125. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11126. return True, func(*args, **kwargs)
  11127. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11128. return func(*args, **kwargs)
  11129. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  11130. res = _exec("AT+CCLK?")
  11131. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  11132. conn.write_line(cmd)
  11133. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  11134. self.ensure_open()
  11135. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  11136. self.open()
  11137. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  11138. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  11139. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  11140. raise attempt.get()
  11141. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  11142. six.reraise(self.value[0], self.value[1], self.value[2])
  11143. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  11144. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  11145. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11146. self._serial.open()
  11147. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11148. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11149. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11150. 2020-08-04 12:12:04,606 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  11151. 2020-08-04 12:12:19,040 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][713] Timeout after 1.28205128205 second(s) waiting for interrupt
  11152. 2020-08-04 12:12:19,136 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  11153. Traceback (most recent call last):
  11154. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11155. self._serial.open()
  11156. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11157. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11158. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11159. 2020-08-04 12:12:19,445 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  11160. 2020-08-04 12:12:19,948 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  11161. 2020-08-04 12:12:19,951 [spm_conn :139 ][WARNING ][625] Unable to get status: Expected ack '12' but got '255'
  11162. 2020-08-04 12:12:20,140 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  11163. Traceback (most recent call last):
  11164. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11165. self._serial.open()
  11166. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11167. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11168. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11169. 2020-08-04 12:12:20,455 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  11170. 2020-08-04 12:12:20,958 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  11171. 2020-08-04 12:12:21,145 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  11172. Traceback (most recent call last):
  11173. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11174. self._serial.open()
  11175. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11176. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11177. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11178. 2020-08-04 12:12:21,155 [messaging :206 ][ERROR ][622] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  11179. Traceback (most recent call last):
  11180. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  11181. self._call_hook_for(message, "workflow", message)
  11182. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11183. return True, func(*args, **kwargs)
  11184. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  11185. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11186. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11187. return True, func(*args, **kwargs)
  11188. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11189. return func(*args, **kwargs)
  11190. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  11191. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  11192. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  11193. conn.write_line(cmd)
  11194. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  11195. self.ensure_open()
  11196. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  11197. self.open()
  11198. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  11199. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  11200. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  11201. raise attempt.get()
  11202. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  11203. six.reraise(self.value[0], self.value[1], self.value[2])
  11204. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  11205. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  11206. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11207. self._serial.open()
  11208. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11209. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11210. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11211. 2020-08-04 12:12:21,462 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  11212. 2020-08-04 12:12:21,464 [spm_conn :139 ][WARNING ][625] Unable to get status: Expected ack '12' but got '255'
  11213. 2020-08-04 12:12:21,468 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  11214. 2020-08-04 12:12:21,971 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  11215. 2020-08-04 12:12:22,474 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  11216. 2020-08-04 12:12:22,476 [spm_conn :82 ][WARNING ][625] Unable to send noop: Expected ack '12' but got '255'
  11217. 2020-08-04 12:12:22,942 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  11218. Traceback (most recent call last):
  11219. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11220. self._serial.open()
  11221. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11222. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11223. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11224. 2020-08-04 12:12:22,981 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  11225. 2020-08-04 12:12:23,485 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  11226. 2020-08-04 12:12:23,977 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  11227. Traceback (most recent call last):
  11228. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11229. self._serial.open()
  11230. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11231. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11232. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11233. 2020-08-04 12:12:23,992 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  11234. 2020-08-04 12:12:23,994 [spm_conn :82 ][WARNING ][625] Unable to send noop: Expected ack '12' but got '255'
  11235. 2020-08-04 12:12:24,498 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  11236. 2020-08-04 12:12:24,981 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  11237. Traceback (most recent call last):
  11238. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11239. self._serial.open()
  11240. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11241. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11242. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11243. 2020-08-04 12:12:24,985 [messaging :742 ][ERROR ][622] Exception while processing event: {'tag': 'ec2x/req/45638432-bf6e-4f36-9f52-f9d970e2a160', 'data': {'_stamp': '2020-08-04T12:12:01.103784', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/45638432-bf6e-4f36-9f52-f9d970e2a160', 'kwargs': {'cooldown_delay': None}}}
  11244. Traceback (most recent call last):
  11245. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  11246. res = self.process(message)
  11247. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  11248. result = func(message, **settings)
  11249. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  11250. found, result = self._call_hook_for(message, "workflow", message)
  11251. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11252. return True, func(*args, **kwargs)
  11253. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  11254. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11255. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11256. return True, func(*args, **kwargs)
  11257. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11258. return func(*args, **kwargs)
  11259. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  11260. return _exec(cmd, **kwargs)
  11261. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  11262. conn.write_line(cmd)
  11263. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  11264. self.ensure_open()
  11265. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  11266. self.open()
  11267. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  11268. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  11269. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  11270. raise attempt.get()
  11271. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  11272. six.reraise(self.value[0], self.value[1], self.value[2])
  11273. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  11274. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  11275. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11276. self._serial.open()
  11277. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11278. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11279. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11280. 2020-08-04 12:12:25,001 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  11281. 2020-08-04 12:12:25,504 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  11282. 2020-08-04 12:12:25,506 [spm_conn :82 ][WARNING ][625] Unable to send noop: Expected ack '12' but got '255'
  11283. 2020-08-04 12:12:25,509 [messaging :208 ][ERROR ][625] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  11284. Traceback (most recent call last):
  11285. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  11286. self._call_hook_for(message, "workflow", message)
  11287. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11288. return True, func(*args, **kwargs)
  11289. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  11290. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11291. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11292. return True, func(*args, **kwargs)
  11293. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11294. return func(*args, **kwargs)
  11295. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  11296. conn.heartbeat()
  11297. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  11298. self.noop()
  11299. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  11300. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  11301. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  11302. raise attempt.get()
  11303. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  11304. six.reraise(self.value[0], self.value[1], self.value[2])
  11305. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  11306. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  11307. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  11308. self._begin_message()
  11309. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  11310. self.recv(ack=ACK_MESSAGE_BEGIN)
  11311. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  11312. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  11313. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  11314. raise attempt.get()
  11315. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  11316. six.reraise(self.value[0], self.value[1], self.value[2])
  11317. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  11318. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  11319. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  11320. raise Exception(msg)
  11321. Exception: Expected ack '12' but got '255'
  11322. 2020-08-04 12:12:27,060 [messaging :208 ][ERROR ][623] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  11323. Traceback (most recent call last):
  11324. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  11325. self._call_hook_for(message, "workflow", message)
  11326. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11327. return True, func(*args, **kwargs)
  11328. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  11329. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11330. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11331. return True, func(*args, **kwargs)
  11332. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11333. return func(*args, **kwargs)
  11334. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  11335. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  11336. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  11337. res = query("AT+QGPSLOC={:d}".format(mode))
  11338. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  11339. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  11340. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  11341. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  11342. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  11343. raise salt.exceptions.CommandExecutionError(message["error"])
  11344. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11345. 2020-08-04 12:12:32,130 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  11346. Traceback (most recent call last):
  11347. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11348. self._serial.open()
  11349. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11350. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11351. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11352. 2020-08-04 12:12:33,135 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  11353. Traceback (most recent call last):
  11354. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11355. self._serial.open()
  11356. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11357. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11358. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11359. 2020-08-04 12:12:34,140 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  11360. Traceback (most recent call last):
  11361. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11362. self._serial.open()
  11363. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11364. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11365. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11366. 2020-08-04 12:12:34,143 [messaging :742 ][ERROR ][622] Exception while processing event: {'tag': 'ec2x/req/d62ef1e6-b825-43e2-ac62-26c4da20792a', 'data': {'_stamp': '2020-08-04T12:12:32.123825', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/d62ef1e6-b825-43e2-ac62-26c4da20792a', 'kwargs': {'cooldown_delay': None}}}
  11367. Traceback (most recent call last):
  11368. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  11369. res = self.process(message)
  11370. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  11371. result = func(message, **settings)
  11372. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  11373. found, result = self._call_hook_for(message, "workflow", message)
  11374. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11375. return True, func(*args, **kwargs)
  11376. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  11377. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11378. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11379. return True, func(*args, **kwargs)
  11380. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11381. return func(*args, **kwargs)
  11382. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  11383. return _exec(cmd, **kwargs)
  11384. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  11385. conn.write_line(cmd)
  11386. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  11387. self.ensure_open()
  11388. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  11389. self.open()
  11390. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  11391. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  11392. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  11393. raise attempt.get()
  11394. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  11395. six.reraise(self.value[0], self.value[1], self.value[2])
  11396. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  11397. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  11398. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11399. self._serial.open()
  11400. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11401. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11402. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11403. 2020-08-04 12:12:34,163 [messaging :206 ][ERROR ][623] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  11404. Traceback (most recent call last):
  11405. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  11406. self._call_hook_for(message, "workflow", message)
  11407. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11408. return True, func(*args, **kwargs)
  11409. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  11410. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11411. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11412. return True, func(*args, **kwargs)
  11413. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11414. return func(*args, **kwargs)
  11415. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  11416. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  11417. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  11418. res = query("AT+QGPSLOC={:d}".format(mode))
  11419. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  11420. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  11421. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  11422. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  11423. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  11424. raise salt.exceptions.CommandExecutionError(message["error"])
  11425. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11426. 2020-08-04 12:12:37,586 [obd.obd :107 ][ERROR ][711] Failed to use explicit port '/dev/serial0'
  11427. Traceback (most recent call last):
  11428. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  11429. self.interface.open(baudrate, protocol=protocol)
  11430. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  11431. self.set_protocol(prot.pop("id", None), **prot)
  11432. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  11433. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  11434. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  11435. self._protocol = self._auto_protocol(**kwargs)
  11436. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  11437. res_0100 = self._verify_protocol("auto", test=not verify)
  11438. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  11439. for line in self.query("0100", parse=False, read_timeout=10):
  11440. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  11441. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  11442. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  11443. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  11444. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  11445. data = self._port.read(self._port.in_waiting or 1)
  11446. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  11447. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  11448. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  11449. sys.exit(salt.defaults.exitcodes.EX_OK)
  11450. SystemExit: 0
  11451. 2020-08-04 12:12:37,625 [obd.obd :120 ][WARNING ][711] Cannot load commands - no connection to bus
  11452. 2020-08-04 12:12:37,652 [obd.interfaces.elm327:730 ][ERROR ][711] Failed to relay command 'STSLCS' to interface
  11453. Traceback (most recent call last):
  11454. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  11455. lines = self.send(cmd, raw_response=raw_response)
  11456. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  11457. raise ELM327Error(self.ERRORS[line], code=line)
  11458. ELM327Error: Operation interrupted by a received RS232 character
  11459. 2020-08-04 12:12:37,656 [messaging :742 ][ERROR ][711] Exception while processing event: {'tag': 'obd/req/febc422c-3355-49cd-ad12-6bec6aec3b50', 'data': {'_stamp': '2020-08-04T12:12:32.039093', 'handler': 'execute', '_event_tag': 'obd/req/febc422c-3355-49cd-ad12-6bec6aec3b50', 'args': ['STSLCS']}}
  11460. Traceback (most recent call last):
  11461. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  11462. res = self.process(message)
  11463. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  11464. result = func(message, **settings)
  11465. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  11466. found, result = self._call_hook_for(message, "workflow", message)
  11467. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11468. return True, func(*args, **kwargs)
  11469. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  11470. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11471. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11472. return True, func(*args, **kwargs)
  11473. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11474. return func(*args, **kwargs)
  11475. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  11476. res = conn.execute(cmd)
  11477. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  11478. return func(self, *args, **kwargs)
  11479. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  11480. return self._obd.execute(cmd, **kwargs)
  11481. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  11482. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  11483. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  11484. lines = self.send(cmd, raw_response=raw_response)
  11485. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  11486. raise ELM327Error(self.ERRORS[line], code=line)
  11487. ELM327Error: Operation interrupted by a received RS232 character
  11488. 2020-08-04 12:12:38,336 [salt.utils.parsers:1050][WARNING ][422] Minion received a SIGTERM. Exiting.
  11489. 2020-08-04 12:12:38,876 [messaging :871 ][WARNING ][822] No reply message with tag 'obd/res/febc422c-3355-49cd-ad12-6bec6aec3b50' received within timeout of 30 secs
  11490. 2020-08-04 12:12:38,880 [salt.state :292 ][ERROR ][822] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  11491. 2020-08-04 12:12:56,162 [gpio_spi_conn :42 ][WARNING ][618] Unable to clear buffer - got unexpected value: 255
  11492. 2020-08-04 12:12:56,169 [gpio_spi_conn :42 ][WARNING ][618] Unable to clear buffer - got unexpected value: 255
  11493. 2020-08-04 12:12:56,178 [gpio_spi_conn :42 ][WARNING ][618] Unable to clear buffer - got unexpected value: 255
  11494. 2020-08-04 12:12:56,892 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  11495. Traceback (most recent call last):
  11496. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11497. self._serial.open()
  11498. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11499. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11500. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11501. 2020-08-04 12:12:57,904 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  11502. Traceback (most recent call last):
  11503. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11504. self._serial.open()
  11505. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11506. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11507. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11508. 2020-08-04 12:12:58,204 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  11509. 2020-08-04 12:12:58,707 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  11510. 2020-08-04 12:12:58,908 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  11511. Traceback (most recent call last):
  11512. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11513. self._serial.open()
  11514. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11515. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11516. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11517. 2020-08-04 12:12:59,210 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  11518. 2020-08-04 12:12:59,212 [spm_conn :139 ][WARNING ][618] Unable to get status: Expected ack '12' but got '255'
  11519. 2020-08-04 12:12:59,493 [messaging :208 ][ERROR ][615] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  11520. Traceback (most recent call last):
  11521. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  11522. self._call_hook_for(message, "workflow", message)
  11523. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11524. return True, func(*args, **kwargs)
  11525. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  11526. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11527. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11528. return True, func(*args, **kwargs)
  11529. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11530. return func(*args, **kwargs)
  11531. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  11532. res = _exec("AT+CCLK?")
  11533. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  11534. conn.write_line(cmd)
  11535. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  11536. self.ensure_open()
  11537. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  11538. self.open()
  11539. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  11540. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  11541. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  11542. raise attempt.get()
  11543. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  11544. six.reraise(self.value[0], self.value[1], self.value[2])
  11545. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  11546. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  11547. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11548. self._serial.open()
  11549. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11550. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11551. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11552. 2020-08-04 12:12:59,716 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  11553. 2020-08-04 12:13:14,085 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][705] Timeout after 1.28205128205 second(s) waiting for interrupt
  11554. 2020-08-04 12:13:14,173 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  11555. Traceback (most recent call last):
  11556. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11557. self._serial.open()
  11558. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11559. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11560. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11561. 2020-08-04 12:13:14,391 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  11562. 2020-08-04 12:13:14,894 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  11563. 2020-08-04 12:13:14,897 [spm_conn :139 ][WARNING ][618] Unable to get status: Expected ack '12' but got '255'
  11564. 2020-08-04 12:13:15,178 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  11565. Traceback (most recent call last):
  11566. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11567. self._serial.open()
  11568. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11569. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11570. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11571. 2020-08-04 12:13:15,401 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  11572. 2020-08-04 12:13:15,904 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  11573. 2020-08-04 12:13:16,183 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  11574. Traceback (most recent call last):
  11575. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11576. self._serial.open()
  11577. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11578. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11579. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11580. 2020-08-04 12:13:16,186 [messaging :206 ][ERROR ][615] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  11581. Traceback (most recent call last):
  11582. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  11583. self._call_hook_for(message, "workflow", message)
  11584. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11585. return True, func(*args, **kwargs)
  11586. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  11587. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11588. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11589. return True, func(*args, **kwargs)
  11590. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11591. return func(*args, **kwargs)
  11592. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  11593. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  11594. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  11595. conn.write_line(cmd)
  11596. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  11597. self.ensure_open()
  11598. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  11599. self.open()
  11600. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  11601. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  11602. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  11603. raise attempt.get()
  11604. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  11605. six.reraise(self.value[0], self.value[1], self.value[2])
  11606. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  11607. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  11608. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11609. self._serial.open()
  11610. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11611. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11612. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11613. 2020-08-04 12:13:16,407 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  11614. 2020-08-04 12:13:16,410 [spm_conn :139 ][WARNING ][618] Unable to get status: Expected ack '12' but got '255'
  11615. 2020-08-04 12:13:16,413 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  11616. 2020-08-04 12:13:16,916 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  11617. 2020-08-04 12:13:17,419 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  11618. 2020-08-04 12:13:17,421 [spm_conn :82 ][WARNING ][618] Unable to send noop: Expected ack '12' but got '255'
  11619. 2020-08-04 12:13:17,850 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  11620. Traceback (most recent call last):
  11621. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11622. self._serial.open()
  11623. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11624. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11625. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11626. 2020-08-04 12:13:17,927 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  11627. 2020-08-04 12:13:18,434 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  11628. 2020-08-04 12:13:18,856 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  11629. Traceback (most recent call last):
  11630. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11631. self._serial.open()
  11632. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11633. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11634. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11635. 2020-08-04 12:13:18,938 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  11636. 2020-08-04 12:13:18,940 [spm_conn :82 ][WARNING ][618] Unable to send noop: Expected ack '12' but got '255'
  11637. 2020-08-04 12:13:19,444 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  11638. 2020-08-04 12:13:19,860 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  11639. Traceback (most recent call last):
  11640. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11641. self._serial.open()
  11642. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11643. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11644. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11645. 2020-08-04 12:13:19,871 [messaging :742 ][ERROR ][615] Exception while processing event: {'tag': 'ec2x/req/d385e3f7-d8af-4c01-9d1d-36338377bc68', 'data': {'_stamp': '2020-08-04T12:12:56.230457', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/d385e3f7-d8af-4c01-9d1d-36338377bc68', 'kwargs': {'cooldown_delay': None}}}
  11646. Traceback (most recent call last):
  11647. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  11648. res = self.process(message)
  11649. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  11650. result = func(message, **settings)
  11651. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  11652. found, result = self._call_hook_for(message, "workflow", message)
  11653. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11654. return True, func(*args, **kwargs)
  11655. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  11656. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11657. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11658. return True, func(*args, **kwargs)
  11659. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11660. return func(*args, **kwargs)
  11661. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  11662. return _exec(cmd, **kwargs)
  11663. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  11664. conn.write_line(cmd)
  11665. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  11666. self.ensure_open()
  11667. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  11668. self.open()
  11669. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  11670. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  11671. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  11672. raise attempt.get()
  11673. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  11674. six.reraise(self.value[0], self.value[1], self.value[2])
  11675. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  11676. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  11677. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11678. self._serial.open()
  11679. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11680. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11681. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11682. 2020-08-04 12:13:19,947 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  11683. 2020-08-04 12:13:20,450 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  11684. 2020-08-04 12:13:20,453 [spm_conn :82 ][WARNING ][618] Unable to send noop: Expected ack '12' but got '255'
  11685. 2020-08-04 12:13:20,455 [messaging :208 ][ERROR ][618] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  11686. Traceback (most recent call last):
  11687. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  11688. self._call_hook_for(message, "workflow", message)
  11689. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11690. return True, func(*args, **kwargs)
  11691. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  11692. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11693. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11694. return True, func(*args, **kwargs)
  11695. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11696. return func(*args, **kwargs)
  11697. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  11698. conn.heartbeat()
  11699. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  11700. self.noop()
  11701. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  11702. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  11703. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  11704. raise attempt.get()
  11705. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  11706. six.reraise(self.value[0], self.value[1], self.value[2])
  11707. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  11708. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  11709. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  11710. self._begin_message()
  11711. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  11712. self.recv(ack=ACK_MESSAGE_BEGIN)
  11713. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  11714. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  11715. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  11716. raise attempt.get()
  11717. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  11718. six.reraise(self.value[0], self.value[1], self.value[2])
  11719. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  11720. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  11721. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  11722. raise Exception(msg)
  11723. Exception: Expected ack '12' but got '255'
  11724. 2020-08-04 12:13:22,073 [messaging :208 ][ERROR ][616] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  11725. Traceback (most recent call last):
  11726. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  11727. self._call_hook_for(message, "workflow", message)
  11728. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11729. return True, func(*args, **kwargs)
  11730. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  11731. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11732. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11733. return True, func(*args, **kwargs)
  11734. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11735. return func(*args, **kwargs)
  11736. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  11737. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  11738. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  11739. res = query("AT+QGPSLOC={:d}".format(mode))
  11740. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  11741. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  11742. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  11743. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  11744. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  11745. raise salt.exceptions.CommandExecutionError(message["error"])
  11746. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11747. 2020-08-04 12:13:27,128 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  11748. Traceback (most recent call last):
  11749. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11750. self._serial.open()
  11751. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11752. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11753. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11754. 2020-08-04 12:13:28,141 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  11755. Traceback (most recent call last):
  11756. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11757. self._serial.open()
  11758. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11759. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11760. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11761. 2020-08-04 12:13:29,145 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  11762. Traceback (most recent call last):
  11763. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11764. self._serial.open()
  11765. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11766. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11767. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11768. 2020-08-04 12:13:29,148 [messaging :742 ][ERROR ][615] Exception while processing event: {'tag': 'ec2x/req/c2a28384-b5f6-4e33-a613-094ac86494a0', 'data': {'_stamp': '2020-08-04T12:13:27.121155', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/c2a28384-b5f6-4e33-a613-094ac86494a0', 'kwargs': {'cooldown_delay': None}}}
  11769. Traceback (most recent call last):
  11770. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  11771. res = self.process(message)
  11772. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  11773. result = func(message, **settings)
  11774. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  11775. found, result = self._call_hook_for(message, "workflow", message)
  11776. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11777. return True, func(*args, **kwargs)
  11778. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  11779. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11780. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11781. return True, func(*args, **kwargs)
  11782. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11783. return func(*args, **kwargs)
  11784. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  11785. return _exec(cmd, **kwargs)
  11786. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  11787. conn.write_line(cmd)
  11788. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  11789. self.ensure_open()
  11790. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  11791. self.open()
  11792. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  11793. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  11794. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  11795. raise attempt.get()
  11796. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  11797. six.reraise(self.value[0], self.value[1], self.value[2])
  11798. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  11799. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  11800. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11801. self._serial.open()
  11802. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11803. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11804. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11805. 2020-08-04 12:13:29,185 [messaging :206 ][ERROR ][616] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  11806. Traceback (most recent call last):
  11807. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  11808. self._call_hook_for(message, "workflow", message)
  11809. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11810. return True, func(*args, **kwargs)
  11811. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  11812. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11813. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11814. return True, func(*args, **kwargs)
  11815. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11816. return func(*args, **kwargs)
  11817. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  11818. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  11819. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  11820. res = query("AT+QGPSLOC={:d}".format(mode))
  11821. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  11822. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  11823. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  11824. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  11825. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  11826. raise salt.exceptions.CommandExecutionError(message["error"])
  11827. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11828. 2020-08-04 12:13:32,556 [obd.obd :107 ][ERROR ][704] Failed to use explicit port '/dev/serial0'
  11829. Traceback (most recent call last):
  11830. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  11831. self.interface.open(baudrate, protocol=protocol)
  11832. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  11833. self.set_protocol(prot.pop("id", None), **prot)
  11834. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  11835. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  11836. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  11837. self._protocol = self._auto_protocol(**kwargs)
  11838. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  11839. res_0100 = self._verify_protocol("auto", test=not verify)
  11840. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  11841. for line in self.query("0100", parse=False, read_timeout=10):
  11842. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  11843. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  11844. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  11845. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  11846. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  11847. data = self._port.read(self._port.in_waiting or 1)
  11848. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  11849. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  11850. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  11851. sys.exit(salt.defaults.exitcodes.EX_OK)
  11852. SystemExit: 0
  11853. 2020-08-04 12:13:32,581 [obd.obd :120 ][WARNING ][704] Cannot load commands - no connection to bus
  11854. 2020-08-04 12:13:32,614 [obd.interfaces.elm327:730 ][ERROR ][704] Failed to relay command 'STSLCS' to interface
  11855. Traceback (most recent call last):
  11856. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  11857. lines = self.send(cmd, raw_response=raw_response)
  11858. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  11859. raise ELM327Error(self.ERRORS[line], code=line)
  11860. ELM327Error: Operation interrupted by a received RS232 character
  11861. 2020-08-04 12:13:32,617 [messaging :742 ][ERROR ][704] Exception while processing event: {'tag': 'obd/req/2d555eb7-4506-4510-be50-11a2b6e6b52e', 'data': {'_stamp': '2020-08-04T12:13:27.079342', 'handler': 'execute', '_event_tag': 'obd/req/2d555eb7-4506-4510-be50-11a2b6e6b52e', 'args': ['STSLCS']}}
  11862. Traceback (most recent call last):
  11863. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  11864. res = self.process(message)
  11865. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  11866. result = func(message, **settings)
  11867. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  11868. found, result = self._call_hook_for(message, "workflow", message)
  11869. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11870. return True, func(*args, **kwargs)
  11871. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  11872. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11873. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11874. return True, func(*args, **kwargs)
  11875. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11876. return func(*args, **kwargs)
  11877. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  11878. res = conn.execute(cmd)
  11879. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  11880. return func(self, *args, **kwargs)
  11881. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  11882. return self._obd.execute(cmd, **kwargs)
  11883. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  11884. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  11885. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  11886. lines = self.send(cmd, raw_response=raw_response)
  11887. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  11888. raise ELM327Error(self.ERRORS[line], code=line)
  11889. ELM327Error: Operation interrupted by a received RS232 character
  11890. 2020-08-04 12:13:33,434 [salt.utils.parsers:1050][WARNING ][415] Minion received a SIGTERM. Exiting.
  11891. 2020-08-04 12:13:33,973 [messaging :871 ][WARNING ][815] No reply message with tag 'obd/res/2d555eb7-4506-4510-be50-11a2b6e6b52e' received within timeout of 30 secs
  11892. 2020-08-04 12:13:33,979 [salt.state :292 ][ERROR ][815] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  11893. 2020-08-04 12:13:51,110 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  11894. 2020-08-04 12:13:51,122 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  11895. 2020-08-04 12:13:51,134 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  11896. 2020-08-04 12:13:51,801 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  11897. Traceback (most recent call last):
  11898. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11899. self._serial.open()
  11900. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11901. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11902. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11903. 2020-08-04 12:13:52,816 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  11904. Traceback (most recent call last):
  11905. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11906. self._serial.open()
  11907. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11908. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11909. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11910. 2020-08-04 12:13:53,168 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  11911. 2020-08-04 12:13:53,671 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  11912. 2020-08-04 12:13:53,820 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  11913. Traceback (most recent call last):
  11914. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11915. self._serial.open()
  11916. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11917. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11918. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11919. 2020-08-04 12:13:54,176 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  11920. 2020-08-04 12:13:54,178 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  11921. 2020-08-04 12:13:54,447 [messaging :208 ][ERROR ][616] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  11922. Traceback (most recent call last):
  11923. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  11924. self._call_hook_for(message, "workflow", message)
  11925. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11926. return True, func(*args, **kwargs)
  11927. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  11928. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  11929. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  11930. return True, func(*args, **kwargs)
  11931. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  11932. return func(*args, **kwargs)
  11933. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  11934. res = _exec("AT+CCLK?")
  11935. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  11936. conn.write_line(cmd)
  11937. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  11938. self.ensure_open()
  11939. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  11940. self.open()
  11941. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  11942. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  11943. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  11944. raise attempt.get()
  11945. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  11946. six.reraise(self.value[0], self.value[1], self.value[2])
  11947. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  11948. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  11949. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11950. self._serial.open()
  11951. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11952. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11953. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11954. 2020-08-04 12:13:54,682 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  11955. 2020-08-04 12:13:55,187 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  11956. 2020-08-04 12:13:55,690 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  11957. 2020-08-04 12:13:55,692 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  11958. 2020-08-04 12:13:56,195 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  11959. 2020-08-04 12:13:56,709 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  11960. 2020-08-04 12:13:57,212 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  11961. 2020-08-04 12:13:57,214 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  11962. 2020-08-04 12:13:57,218 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  11963. 2020-08-04 12:13:57,721 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  11964. 2020-08-04 12:13:58,224 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  11965. 2020-08-04 12:13:58,226 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  11966. 2020-08-04 12:13:58,555 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  11967. Traceback (most recent call last):
  11968. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11969. self._serial.open()
  11970. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11971. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11972. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11973. 2020-08-04 12:13:58,730 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  11974. 2020-08-04 12:13:59,232 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  11975. 2020-08-04 12:13:59,559 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  11976. Traceback (most recent call last):
  11977. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11978. self._serial.open()
  11979. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11980. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11981. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11982. 2020-08-04 12:13:59,735 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  11983. 2020-08-04 12:13:59,737 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  11984. 2020-08-04 12:14:00,241 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  11985. 2020-08-04 12:14:00,563 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  11986. Traceback (most recent call last):
  11987. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  11988. self._serial.open()
  11989. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  11990. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  11991. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  11992. 2020-08-04 12:14:00,567 [messaging :742 ][ERROR ][616] Exception while processing event: {'tag': 'ec2x/req/88a7ccfc-7103-4ec1-ae71-ce4a0c7f15ee', 'data': {'_stamp': '2020-08-04T12:13:51.202054', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/88a7ccfc-7103-4ec1-ae71-ce4a0c7f15ee', 'kwargs': {'cooldown_delay': None}}}
  11993. Traceback (most recent call last):
  11994. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  11995. res = self.process(message)
  11996. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  11997. result = func(message, **settings)
  11998. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  11999. found, result = self._call_hook_for(message, "workflow", message)
  12000. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12001. return True, func(*args, **kwargs)
  12002. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  12003. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12004. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12005. return True, func(*args, **kwargs)
  12006. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12007. return func(*args, **kwargs)
  12008. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  12009. return _exec(cmd, **kwargs)
  12010. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  12011. conn.write_line(cmd)
  12012. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  12013. self.ensure_open()
  12014. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  12015. self.open()
  12016. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  12017. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  12018. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  12019. raise attempt.get()
  12020. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  12021. six.reraise(self.value[0], self.value[1], self.value[2])
  12022. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  12023. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  12024. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12025. self._serial.open()
  12026. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12027. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12028. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12029. 2020-08-04 12:14:00,744 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  12030. 2020-08-04 12:14:01,247 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  12031. 2020-08-04 12:14:01,250 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  12032. 2020-08-04 12:14:01,253 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  12033. Traceback (most recent call last):
  12034. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12035. self._serial.open()
  12036. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12037. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12038. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12039. 2020-08-04 12:14:01,252 [messaging :208 ][ERROR ][619] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  12040. Traceback (most recent call last):
  12041. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  12042. self._call_hook_for(message, "workflow", message)
  12043. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12044. return True, func(*args, **kwargs)
  12045. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  12046. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12047. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12048. return True, func(*args, **kwargs)
  12049. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12050. return func(*args, **kwargs)
  12051. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  12052. conn.heartbeat()
  12053. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  12054. self.noop()
  12055. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  12056. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  12057. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  12058. raise attempt.get()
  12059. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  12060. six.reraise(self.value[0], self.value[1], self.value[2])
  12061. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  12062. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  12063. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  12064. self._begin_message()
  12065. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  12066. self.recv(ack=ACK_MESSAGE_BEGIN)
  12067. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  12068. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  12069. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  12070. raise attempt.get()
  12071. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  12072. six.reraise(self.value[0], self.value[1], self.value[2])
  12073. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  12074. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  12075. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  12076. raise Exception(msg)
  12077. Exception: Expected ack '12' but got '255'
  12078. 2020-08-04 12:14:02,258 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  12079. Traceback (most recent call last):
  12080. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12081. self._serial.open()
  12082. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12083. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12084. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12085. 2020-08-04 12:14:02,986 [messaging :208 ][ERROR ][617] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  12086. Traceback (most recent call last):
  12087. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  12088. self._call_hook_for(message, "workflow", message)
  12089. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12090. return True, func(*args, **kwargs)
  12091. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  12092. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12093. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12094. return True, func(*args, **kwargs)
  12095. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12096. return func(*args, **kwargs)
  12097. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  12098. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  12099. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  12100. res = query("AT+QGPSLOC={:d}".format(mode))
  12101. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  12102. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  12103. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  12104. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  12105. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  12106. raise salt.exceptions.CommandExecutionError(message["error"])
  12107. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12108. 2020-08-04 12:14:03,262 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  12109. Traceback (most recent call last):
  12110. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12111. self._serial.open()
  12112. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12113. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12114. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12115. 2020-08-04 12:14:03,785 [messaging :206 ][ERROR ][616] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  12116. Traceback (most recent call last):
  12117. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  12118. self._call_hook_for(message, "workflow", message)
  12119. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12120. return True, func(*args, **kwargs)
  12121. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  12122. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12123. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12124. return True, func(*args, **kwargs)
  12125. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12126. return func(*args, **kwargs)
  12127. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  12128. res = _exec("AT+CCLK?")
  12129. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  12130. conn.write_line(cmd)
  12131. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  12132. self.ensure_open()
  12133. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  12134. self.open()
  12135. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  12136. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  12137. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  12138. raise attempt.get()
  12139. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  12140. six.reraise(self.value[0], self.value[1], self.value[2])
  12141. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  12142. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  12143. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12144. self._serial.open()
  12145. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12146. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12147. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12148. 2020-08-04 12:14:18,342 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  12149. Traceback (most recent call last):
  12150. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12151. self._serial.open()
  12152. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12153. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12154. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12155. 2020-08-04 12:14:18,356 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][654] Timeout after 1.28205128205 second(s) waiting for interrupt
  12156. 2020-08-04 12:14:19,347 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  12157. Traceback (most recent call last):
  12158. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12159. self._serial.open()
  12160. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12161. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12162. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12163. 2020-08-04 12:14:20,351 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  12164. Traceback (most recent call last):
  12165. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12166. self._serial.open()
  12167. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12168. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12169. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12170. 2020-08-04 12:14:20,354 [messaging :742 ][ERROR ][616] Exception while processing event: {'tag': 'ec2x/req/85a8fff7-3933-4d66-8d1e-db7c06aadd01', 'data': {'_stamp': '2020-08-04T12:14:18.334302', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/85a8fff7-3933-4d66-8d1e-db7c06aadd01', 'kwargs': {'cooldown_delay': None}}}
  12171. Traceback (most recent call last):
  12172. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  12173. res = self.process(message)
  12174. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  12175. result = func(message, **settings)
  12176. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  12177. found, result = self._call_hook_for(message, "workflow", message)
  12178. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12179. return True, func(*args, **kwargs)
  12180. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  12181. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12182. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12183. return True, func(*args, **kwargs)
  12184. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12185. return func(*args, **kwargs)
  12186. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  12187. return _exec(cmd, **kwargs)
  12188. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  12189. conn.write_line(cmd)
  12190. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  12191. self.ensure_open()
  12192. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  12193. self.open()
  12194. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  12195. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  12196. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  12197. raise attempt.get()
  12198. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  12199. six.reraise(self.value[0], self.value[1], self.value[2])
  12200. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  12201. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  12202. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12203. self._serial.open()
  12204. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12205. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12206. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12207. 2020-08-04 12:14:20,420 [messaging :206 ][ERROR ][617] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  12208. Traceback (most recent call last):
  12209. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  12210. self._call_hook_for(message, "workflow", message)
  12211. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12212. return True, func(*args, **kwargs)
  12213. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  12214. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12215. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12216. return True, func(*args, **kwargs)
  12217. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12218. return func(*args, **kwargs)
  12219. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  12220. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  12221. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  12222. res = query("AT+QGPSLOC={:d}".format(mode))
  12223. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  12224. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  12225. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  12226. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  12227. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  12228. raise salt.exceptions.CommandExecutionError(message["error"])
  12229. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12230. 2020-08-04 12:14:20,995 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  12231. Traceback (most recent call last):
  12232. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12233. self._serial.open()
  12234. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12235. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12236. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12237. 2020-08-04 12:14:22,002 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  12238. Traceback (most recent call last):
  12239. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12240. self._serial.open()
  12241. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12242. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12243. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12244. 2020-08-04 12:14:23,005 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  12245. Traceback (most recent call last):
  12246. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12247. self._serial.open()
  12248. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12249. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12250. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12251. 2020-08-04 12:14:23,535 [messaging :206 ][ERROR ][616] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  12252. Traceback (most recent call last):
  12253. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  12254. self._call_hook_for(message, "workflow", message)
  12255. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12256. return True, func(*args, **kwargs)
  12257. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  12258. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12259. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12260. return True, func(*args, **kwargs)
  12261. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12262. return func(*args, **kwargs)
  12263. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  12264. res = _exec("AT+CCLK?")
  12265. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  12266. conn.write_line(cmd)
  12267. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  12268. self.ensure_open()
  12269. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  12270. self.open()
  12271. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  12272. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  12273. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  12274. raise attempt.get()
  12275. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  12276. six.reraise(self.value[0], self.value[1], self.value[2])
  12277. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  12278. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  12279. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12280. self._serial.open()
  12281. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12282. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12283. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12284. 2020-08-04 12:14:25,440 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  12285. Traceback (most recent call last):
  12286. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12287. self._serial.open()
  12288. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12289. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12290. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12291. 2020-08-04 12:14:26,445 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  12292. Traceback (most recent call last):
  12293. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12294. self._serial.open()
  12295. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12296. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12297. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12298. 2020-08-04 12:14:27,449 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  12299. Traceback (most recent call last):
  12300. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12301. self._serial.open()
  12302. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12303. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12304. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12305. 2020-08-04 12:14:27,453 [messaging :742 ][ERROR ][616] Exception while processing event: {'tag': 'ec2x/req/748547ed-fb54-416f-b51d-650a4127b0d2', 'data': {'_stamp': '2020-08-04T12:14:25.433380', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/748547ed-fb54-416f-b51d-650a4127b0d2', 'kwargs': {'cooldown_delay': None}}}
  12306. Traceback (most recent call last):
  12307. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  12308. res = self.process(message)
  12309. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  12310. result = func(message, **settings)
  12311. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  12312. found, result = self._call_hook_for(message, "workflow", message)
  12313. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12314. return True, func(*args, **kwargs)
  12315. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  12316. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12317. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12318. return True, func(*args, **kwargs)
  12319. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12320. return func(*args, **kwargs)
  12321. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  12322. return _exec(cmd, **kwargs)
  12323. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  12324. conn.write_line(cmd)
  12325. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  12326. self.ensure_open()
  12327. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  12328. self.open()
  12329. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  12330. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  12331. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  12332. raise attempt.get()
  12333. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  12334. six.reraise(self.value[0], self.value[1], self.value[2])
  12335. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  12336. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  12337. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12338. self._serial.open()
  12339. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12340. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12341. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12342. 2020-08-04 12:14:27,484 [messaging :206 ][ERROR ][617] Recurring exception (3 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  12343. Traceback (most recent call last):
  12344. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  12345. self._call_hook_for(message, "workflow", message)
  12346. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12347. return True, func(*args, **kwargs)
  12348. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  12349. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12350. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12351. return True, func(*args, **kwargs)
  12352. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12353. return func(*args, **kwargs)
  12354. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  12355. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  12356. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  12357. res = query("AT+QGPSLOC={:d}".format(mode))
  12358. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  12359. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  12360. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  12361. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  12362. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  12363. raise salt.exceptions.CommandExecutionError(message["error"])
  12364. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12365. 2020-08-04 12:14:27,783 [obd.obd :107 ][ERROR ][653] Failed to use explicit port '/dev/serial0'
  12366. Traceback (most recent call last):
  12367. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  12368. self.interface.open(baudrate, protocol=protocol)
  12369. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  12370. self.set_protocol(prot.pop("id", None), **prot)
  12371. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  12372. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  12373. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  12374. self._protocol = self._auto_protocol(**kwargs)
  12375. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  12376. res_0100 = self._verify_protocol("auto", test=not verify)
  12377. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  12378. for line in self.query("0100", parse=False, read_timeout=10):
  12379. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  12380. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  12381. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  12382. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  12383. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  12384. data = self._port.read(self._port.in_waiting or 1)
  12385. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  12386. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  12387. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  12388. sys.exit(salt.defaults.exitcodes.EX_OK)
  12389. SystemExit: 0
  12390. 2020-08-04 12:14:27,807 [obd.obd :120 ][WARNING ][653] Cannot load commands - no connection to bus
  12391. 2020-08-04 12:14:27,837 [obd.interfaces.elm327:730 ][ERROR ][653] Failed to relay command 'STSLCS' to interface
  12392. Traceback (most recent call last):
  12393. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  12394. lines = self.send(cmd, raw_response=raw_response)
  12395. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  12396. raise ELM327Error(self.ERRORS[line], code=line)
  12397. ELM327Error: Operation interrupted by a received RS232 character
  12398. 2020-08-04 12:14:27,840 [messaging :742 ][ERROR ][653] Exception while processing event: {'tag': 'obd/req/d1b55067-8abe-4c14-bac2-67a9969da58b', 'data': {'_stamp': '2020-08-04T12:14:22.229903', 'handler': 'execute', '_event_tag': 'obd/req/d1b55067-8abe-4c14-bac2-67a9969da58b', 'args': ['STSLCS']}}
  12399. Traceback (most recent call last):
  12400. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  12401. res = self.process(message)
  12402. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  12403. result = func(message, **settings)
  12404. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  12405. found, result = self._call_hook_for(message, "workflow", message)
  12406. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12407. return True, func(*args, **kwargs)
  12408. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  12409. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12410. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12411. return True, func(*args, **kwargs)
  12412. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12413. return func(*args, **kwargs)
  12414. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  12415. res = conn.execute(cmd)
  12416. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  12417. return func(self, *args, **kwargs)
  12418. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  12419. return self._obd.execute(cmd, **kwargs)
  12420. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  12421. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  12422. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  12423. lines = self.send(cmd, raw_response=raw_response)
  12424. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  12425. raise ELM327Error(self.ERRORS[line], code=line)
  12426. ELM327Error: Operation interrupted by a received RS232 character
  12427. 2020-08-04 12:14:28,658 [salt.utils.parsers:1050][WARNING ][416] Minion received a SIGTERM. Exiting.
  12428. 2020-08-04 12:14:29,198 [messaging :871 ][WARNING ][830] No reply message with tag 'obd/res/d1b55067-8abe-4c14-bac2-67a9969da58b' received within timeout of 30 secs
  12429. 2020-08-04 12:14:29,202 [salt.state :292 ][ERROR ][830] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  12430. 2020-08-04 12:14:46,023 [gpio_spi_conn :42 ][WARNING ][626] Unable to clear buffer - got unexpected value: 255
  12431. 2020-08-04 12:14:46,039 [gpio_spi_conn :42 ][WARNING ][626] Unable to clear buffer - got unexpected value: 255
  12432. 2020-08-04 12:14:46,044 [gpio_spi_conn :42 ][WARNING ][626] Unable to clear buffer - got unexpected value: 255
  12433. 2020-08-04 12:14:46,628 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  12434. Traceback (most recent call last):
  12435. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12436. self._serial.open()
  12437. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12438. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12439. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12440. 2020-08-04 12:14:47,640 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  12441. Traceback (most recent call last):
  12442. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12443. self._serial.open()
  12444. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12445. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12446. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12447. 2020-08-04 12:14:48,071 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  12448. 2020-08-04 12:14:48,574 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  12449. 2020-08-04 12:14:48,645 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  12450. Traceback (most recent call last):
  12451. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12452. self._serial.open()
  12453. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12454. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12455. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12456. 2020-08-04 12:14:49,078 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  12457. 2020-08-04 12:14:49,080 [spm_conn :139 ][WARNING ][626] Unable to get status: Expected ack '12' but got '255'
  12458. 2020-08-04 12:14:49,232 [messaging :208 ][ERROR ][623] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  12459. Traceback (most recent call last):
  12460. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  12461. self._call_hook_for(message, "workflow", message)
  12462. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12463. return True, func(*args, **kwargs)
  12464. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  12465. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12466. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12467. return True, func(*args, **kwargs)
  12468. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12469. return func(*args, **kwargs)
  12470. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  12471. res = _exec("AT+CCLK?")
  12472. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  12473. conn.write_line(cmd)
  12474. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  12475. self.ensure_open()
  12476. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  12477. self.open()
  12478. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  12479. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  12480. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  12481. raise attempt.get()
  12482. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  12483. six.reraise(self.value[0], self.value[1], self.value[2])
  12484. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  12485. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  12486. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12487. self._serial.open()
  12488. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12489. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12490. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12491. 2020-08-04 12:14:49,585 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  12492. 2020-08-04 12:14:50,089 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  12493. 2020-08-04 12:14:50,592 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  12494. 2020-08-04 12:14:50,594 [spm_conn :139 ][WARNING ][626] Unable to get status: Expected ack '12' but got '255'
  12495. 2020-08-04 12:14:51,098 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  12496. 2020-08-04 12:14:51,612 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  12497. 2020-08-04 12:14:52,115 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  12498. 2020-08-04 12:14:52,118 [spm_conn :139 ][WARNING ][626] Unable to get status: Expected ack '12' but got '255'
  12499. 2020-08-04 12:14:52,121 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  12500. 2020-08-04 12:14:52,625 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  12501. 2020-08-04 12:14:53,128 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  12502. 2020-08-04 12:14:53,130 [spm_conn :82 ][WARNING ][626] Unable to send noop: Expected ack '12' but got '255'
  12503. 2020-08-04 12:14:53,438 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  12504. Traceback (most recent call last):
  12505. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12506. self._serial.open()
  12507. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12508. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12509. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12510. 2020-08-04 12:14:53,634 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  12511. 2020-08-04 12:14:54,137 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  12512. 2020-08-04 12:14:54,452 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  12513. Traceback (most recent call last):
  12514. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12515. self._serial.open()
  12516. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12517. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12518. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12519. 2020-08-04 12:14:54,641 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  12520. 2020-08-04 12:14:54,643 [spm_conn :82 ][WARNING ][626] Unable to send noop: Expected ack '12' but got '255'
  12521. 2020-08-04 12:14:55,148 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  12522. 2020-08-04 12:14:55,456 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  12523. Traceback (most recent call last):
  12524. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12525. self._serial.open()
  12526. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12527. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12528. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12529. 2020-08-04 12:14:55,459 [messaging :742 ][ERROR ][623] Exception while processing event: {'tag': 'ec2x/req/9724b1de-0293-4dd7-a0a4-f093251ebf0f', 'data': {'_stamp': '2020-08-04T12:14:46.076562', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/9724b1de-0293-4dd7-a0a4-f093251ebf0f', 'kwargs': {'cooldown_delay': None}}}
  12530. Traceback (most recent call last):
  12531. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  12532. res = self.process(message)
  12533. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  12534. result = func(message, **settings)
  12535. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  12536. found, result = self._call_hook_for(message, "workflow", message)
  12537. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12538. return True, func(*args, **kwargs)
  12539. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  12540. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12541. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12542. return True, func(*args, **kwargs)
  12543. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12544. return func(*args, **kwargs)
  12545. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  12546. return _exec(cmd, **kwargs)
  12547. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  12548. conn.write_line(cmd)
  12549. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  12550. self.ensure_open()
  12551. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  12552. self.open()
  12553. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  12554. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  12555. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  12556. raise attempt.get()
  12557. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  12558. six.reraise(self.value[0], self.value[1], self.value[2])
  12559. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  12560. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  12561. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12562. self._serial.open()
  12563. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12564. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12565. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12566. 2020-08-04 12:14:55,652 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  12567. 2020-08-04 12:14:56,120 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  12568. Traceback (most recent call last):
  12569. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12570. self._serial.open()
  12571. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12572. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12573. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12574. 2020-08-04 12:14:56,157 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  12575. 2020-08-04 12:14:56,159 [spm_conn :82 ][WARNING ][626] Unable to send noop: Expected ack '12' but got '255'
  12576. 2020-08-04 12:14:56,163 [messaging :208 ][ERROR ][626] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  12577. Traceback (most recent call last):
  12578. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  12579. self._call_hook_for(message, "workflow", message)
  12580. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12581. return True, func(*args, **kwargs)
  12582. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  12583. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12584. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12585. return True, func(*args, **kwargs)
  12586. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12587. return func(*args, **kwargs)
  12588. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  12589. conn.heartbeat()
  12590. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  12591. self.noop()
  12592. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  12593. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  12594. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  12595. raise attempt.get()
  12596. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  12597. six.reraise(self.value[0], self.value[1], self.value[2])
  12598. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  12599. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  12600. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  12601. self._begin_message()
  12602. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  12603. self.recv(ack=ACK_MESSAGE_BEGIN)
  12604. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  12605. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  12606. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  12607. raise attempt.get()
  12608. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  12609. six.reraise(self.value[0], self.value[1], self.value[2])
  12610. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  12611. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  12612. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  12613. raise Exception(msg)
  12614. Exception: Expected ack '12' but got '255'
  12615. 2020-08-04 12:14:57,125 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  12616. Traceback (most recent call last):
  12617. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12618. self._serial.open()
  12619. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12620. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12621. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12622. 2020-08-04 12:14:57,726 [messaging :208 ][ERROR ][624] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  12623. Traceback (most recent call last):
  12624. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  12625. self._call_hook_for(message, "workflow", message)
  12626. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12627. return True, func(*args, **kwargs)
  12628. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  12629. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12630. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12631. return True, func(*args, **kwargs)
  12632. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12633. return func(*args, **kwargs)
  12634. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  12635. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  12636. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  12637. res = query("AT+QGPSLOC={:d}".format(mode))
  12638. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  12639. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  12640. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  12641. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  12642. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  12643. raise salt.exceptions.CommandExecutionError(message["error"])
  12644. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12645. 2020-08-04 12:14:58,130 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  12646. Traceback (most recent call last):
  12647. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12648. self._serial.open()
  12649. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12650. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12651. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12652. 2020-08-04 12:14:58,645 [messaging :206 ][ERROR ][623] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  12653. Traceback (most recent call last):
  12654. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  12655. self._call_hook_for(message, "workflow", message)
  12656. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12657. return True, func(*args, **kwargs)
  12658. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  12659. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12660. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12661. return True, func(*args, **kwargs)
  12662. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12663. return func(*args, **kwargs)
  12664. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  12665. res = _exec("AT+CCLK?")
  12666. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  12667. conn.write_line(cmd)
  12668. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  12669. self.ensure_open()
  12670. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  12671. self.open()
  12672. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  12673. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  12674. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  12675. raise attempt.get()
  12676. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  12677. six.reraise(self.value[0], self.value[1], self.value[2])
  12678. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  12679. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  12680. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12681. self._serial.open()
  12682. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12683. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12684. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12685. 2020-08-04 12:15:13,520 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][663] Timeout after 1.28205128205 second(s) waiting for interrupt
  12686. 2020-08-04 12:15:13,582 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  12687. Traceback (most recent call last):
  12688. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12689. self._serial.open()
  12690. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12691. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12692. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12693. 2020-08-04 12:15:14,586 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  12694. Traceback (most recent call last):
  12695. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12696. self._serial.open()
  12697. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12698. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12699. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12700. 2020-08-04 12:15:15,590 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  12701. Traceback (most recent call last):
  12702. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12703. self._serial.open()
  12704. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12705. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12706. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12707. 2020-08-04 12:15:15,595 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  12708. Traceback (most recent call last):
  12709. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12710. self._serial.open()
  12711. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12712. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12713. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12714. 2020-08-04 12:15:15,600 [messaging :206 ][ERROR ][623] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  12715. Traceback (most recent call last):
  12716. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  12717. self._call_hook_for(message, "workflow", message)
  12718. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12719. return True, func(*args, **kwargs)
  12720. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  12721. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12722. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12723. return True, func(*args, **kwargs)
  12724. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12725. return func(*args, **kwargs)
  12726. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  12727. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  12728. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  12729. conn.write_line(cmd)
  12730. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  12731. self.ensure_open()
  12732. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  12733. self.open()
  12734. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  12735. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  12736. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  12737. raise attempt.get()
  12738. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  12739. six.reraise(self.value[0], self.value[1], self.value[2])
  12740. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  12741. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  12742. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12743. self._serial.open()
  12744. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12745. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12746. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12747. 2020-08-04 12:15:16,601 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  12748. Traceback (most recent call last):
  12749. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12750. self._serial.open()
  12751. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12752. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12753. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12754. 2020-08-04 12:15:17,605 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  12755. Traceback (most recent call last):
  12756. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12757. self._serial.open()
  12758. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12759. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12760. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12761. 2020-08-04 12:15:17,609 [messaging :742 ][ERROR ][623] Exception while processing event: {'tag': 'ec2x/req/9a4abcf3-399e-4e0c-97d8-4ed1d146e1bb', 'data': {'_stamp': '2020-08-04T12:15:13.513389', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/9a4abcf3-399e-4e0c-97d8-4ed1d146e1bb', 'kwargs': {'cooldown_delay': None}}}
  12762. Traceback (most recent call last):
  12763. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  12764. res = self.process(message)
  12765. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  12766. result = func(message, **settings)
  12767. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  12768. found, result = self._call_hook_for(message, "workflow", message)
  12769. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12770. return True, func(*args, **kwargs)
  12771. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  12772. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12773. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12774. return True, func(*args, **kwargs)
  12775. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12776. return func(*args, **kwargs)
  12777. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  12778. return _exec(cmd, **kwargs)
  12779. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  12780. conn.write_line(cmd)
  12781. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  12782. self.ensure_open()
  12783. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  12784. self.open()
  12785. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  12786. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  12787. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  12788. raise attempt.get()
  12789. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  12790. six.reraise(self.value[0], self.value[1], self.value[2])
  12791. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  12792. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  12793. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12794. self._serial.open()
  12795. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12796. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12797. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12798. 2020-08-04 12:15:17,632 [messaging :206 ][ERROR ][624] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  12799. Traceback (most recent call last):
  12800. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  12801. self._call_hook_for(message, "workflow", message)
  12802. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12803. return True, func(*args, **kwargs)
  12804. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  12805. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12806. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12807. return True, func(*args, **kwargs)
  12808. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12809. return func(*args, **kwargs)
  12810. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  12811. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  12812. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  12813. res = query("AT+QGPSLOC={:d}".format(mode))
  12814. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  12815. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  12816. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  12817. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  12818. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  12819. raise salt.exceptions.CommandExecutionError(message["error"])
  12820. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12821. 2020-08-04 12:15:22,683 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  12822. Traceback (most recent call last):
  12823. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12824. self._serial.open()
  12825. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12826. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12827. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12828. 2020-08-04 12:15:22,943 [obd.obd :107 ][ERROR ][660] Failed to use explicit port '/dev/serial0'
  12829. Traceback (most recent call last):
  12830. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  12831. self.interface.open(baudrate, protocol=protocol)
  12832. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  12833. self.set_protocol(prot.pop("id", None), **prot)
  12834. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  12835. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  12836. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  12837. self._protocol = self._auto_protocol(**kwargs)
  12838. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  12839. res_0100 = self._verify_protocol("auto", test=not verify)
  12840. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  12841. for line in self.query("0100", parse=False, read_timeout=10):
  12842. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  12843. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  12844. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  12845. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  12846. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  12847. data = self._port.read(self._port.in_waiting or 1)
  12848. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  12849. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  12850. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  12851. sys.exit(salt.defaults.exitcodes.EX_OK)
  12852. SystemExit: 0
  12853. 2020-08-04 12:15:23,029 [obd.obd :120 ][WARNING ][660] Cannot load commands - no connection to bus
  12854. 2020-08-04 12:15:23,058 [obd.interfaces.elm327:730 ][ERROR ][660] Failed to relay command 'STSLCS' to interface
  12855. Traceback (most recent call last):
  12856. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  12857. lines = self.send(cmd, raw_response=raw_response)
  12858. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  12859. raise ELM327Error(self.ERRORS[line], code=line)
  12860. ELM327Error: Operation interrupted by a received RS232 character
  12861. 2020-08-04 12:15:23,072 [messaging :753 ][WARNING ][623] No reply to send back for event: {'tag': 'ec2x/req/69f6273d-d2d9-4c59-bda8-4c40d961b525', 'data': {'_stamp': '2020-08-04T12:15:22.665988', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/69f6273d-d2d9-4c59-bda8-4c40d961b525', 'kwargs': {'cooldown_delay': None}}}
  12862. 2020-08-04 12:15:23,074 [messaging :742 ][ERROR ][660] Exception while processing event: {'tag': 'obd/req/672df8c1-8302-4d34-822d-27314b606012', 'data': {'_stamp': '2020-08-04T12:15:17.380992', 'handler': 'execute', '_event_tag': 'obd/req/672df8c1-8302-4d34-822d-27314b606012', 'args': ['STSLCS']}}
  12863. Traceback (most recent call last):
  12864. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  12865. res = self.process(message)
  12866. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  12867. result = func(message, **settings)
  12868. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  12869. found, result = self._call_hook_for(message, "workflow", message)
  12870. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12871. return True, func(*args, **kwargs)
  12872. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  12873. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12874. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12875. return True, func(*args, **kwargs)
  12876. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12877. return func(*args, **kwargs)
  12878. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  12879. res = conn.execute(cmd)
  12880. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  12881. return func(self, *args, **kwargs)
  12882. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  12883. return self._obd.execute(cmd, **kwargs)
  12884. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  12885. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  12886. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  12887. lines = self.send(cmd, raw_response=raw_response)
  12888. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  12889. raise ELM327Error(self.ERRORS[line], code=line)
  12890. ELM327Error: Operation interrupted by a received RS232 character
  12891. 2020-08-04 12:15:23,814 [salt.utils.parsers:1050][WARNING ][423] Minion received a SIGTERM. Exiting.
  12892. 2020-08-04 12:15:41,308 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  12893. 2020-08-04 12:15:41,326 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  12894. 2020-08-04 12:15:41,329 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  12895. 2020-08-04 12:15:41,986 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  12896. Traceback (most recent call last):
  12897. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12898. self._serial.open()
  12899. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12900. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12901. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12902. 2020-08-04 12:15:43,008 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  12903. Traceback (most recent call last):
  12904. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12905. self._serial.open()
  12906. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12907. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12908. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12909. 2020-08-04 12:15:43,368 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  12910. 2020-08-04 12:15:43,871 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  12911. 2020-08-04 12:15:44,012 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  12912. Traceback (most recent call last):
  12913. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12914. self._serial.open()
  12915. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12916. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12917. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12918. 2020-08-04 12:15:44,373 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  12919. 2020-08-04 12:15:44,376 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  12920. 2020-08-04 12:15:44,587 [messaging :208 ][ERROR ][616] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  12921. Traceback (most recent call last):
  12922. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  12923. self._call_hook_for(message, "workflow", message)
  12924. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12925. return True, func(*args, **kwargs)
  12926. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  12927. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  12928. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  12929. return True, func(*args, **kwargs)
  12930. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  12931. return func(*args, **kwargs)
  12932. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  12933. res = _exec("AT+CCLK?")
  12934. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  12935. conn.write_line(cmd)
  12936. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  12937. self.ensure_open()
  12938. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  12939. self.open()
  12940. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  12941. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  12942. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  12943. raise attempt.get()
  12944. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  12945. six.reraise(self.value[0], self.value[1], self.value[2])
  12946. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  12947. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  12948. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12949. self._serial.open()
  12950. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12951. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12952. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12953. 2020-08-04 12:15:44,880 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  12954. 2020-08-04 12:15:45,385 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  12955. 2020-08-04 12:15:45,891 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  12956. 2020-08-04 12:15:45,893 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  12957. 2020-08-04 12:15:46,396 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  12958. 2020-08-04 12:15:46,910 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  12959. 2020-08-04 12:15:47,415 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  12960. 2020-08-04 12:15:47,418 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  12961. 2020-08-04 12:15:47,421 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  12962. 2020-08-04 12:15:47,924 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  12963. 2020-08-04 12:15:48,362 [salt.utils :831 ][ERROR ][416] DNS lookup or connection check of 'hub' failed.
  12964. 2020-08-04 12:15:48,429 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  12965. 2020-08-04 12:15:48,431 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  12966. 2020-08-04 12:15:48,673 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  12967. Traceback (most recent call last):
  12968. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12969. self._serial.open()
  12970. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12971. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12972. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12973. 2020-08-04 12:15:48,935 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  12974. 2020-08-04 12:15:49,446 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  12975. 2020-08-04 12:15:49,693 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  12976. Traceback (most recent call last):
  12977. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12978. self._serial.open()
  12979. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12980. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12981. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12982. 2020-08-04 12:15:49,937 [cloud_cache :432 ][WARNING ][657] Temporarily unable to upload batch with 8 entries from queue 'pend': HTTPSConnectionPool(host='api.autopi.io', port=443): Max retries exceeded with url: /logbook/storage (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x73506a30>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))
  12983. 2020-08-04 12:15:49,949 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  12984. 2020-08-04 12:15:49,952 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  12985. 2020-08-04 12:15:50,456 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  12986. 2020-08-04 12:15:50,697 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  12987. Traceback (most recent call last):
  12988. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  12989. self._serial.open()
  12990. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  12991. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  12992. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  12993. 2020-08-04 12:15:50,706 [messaging :742 ][ERROR ][616] Exception while processing event: {'tag': 'ec2x/req/56d18d29-3d0b-4e45-bf82-33d968a2bcc1', 'data': {'_stamp': '2020-08-04T12:15:41.388984', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/56d18d29-3d0b-4e45-bf82-33d968a2bcc1', 'kwargs': {'cooldown_delay': None}}}
  12994. Traceback (most recent call last):
  12995. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  12996. res = self.process(message)
  12997. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  12998. result = func(message, **settings)
  12999. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  13000. found, result = self._call_hook_for(message, "workflow", message)
  13001. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13002. return True, func(*args, **kwargs)
  13003. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  13004. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13005. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13006. return True, func(*args, **kwargs)
  13007. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13008. return func(*args, **kwargs)
  13009. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  13010. return _exec(cmd, **kwargs)
  13011. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  13012. conn.write_line(cmd)
  13013. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  13014. self.ensure_open()
  13015. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  13016. self.open()
  13017. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  13018. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  13019. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  13020. raise attempt.get()
  13021. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  13022. six.reraise(self.value[0], self.value[1], self.value[2])
  13023. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  13024. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  13025. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13026. self._serial.open()
  13027. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13028. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13029. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13030. 2020-08-04 12:15:50,756 [messaging :208 ][ERROR ][617] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  13031. Traceback (most recent call last):
  13032. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  13033. self._call_hook_for(message, "workflow", message)
  13034. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13035. return True, func(*args, **kwargs)
  13036. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  13037. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13038. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13039. return True, func(*args, **kwargs)
  13040. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13041. return func(*args, **kwargs)
  13042. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  13043. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  13044. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  13045. res = query("AT+QGPSLOC={:d}".format(mode))
  13046. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  13047. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  13048. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  13049. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  13050. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  13051. raise salt.exceptions.CommandExecutionError(message["error"])
  13052. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13053. 2020-08-04 12:15:50,959 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  13054. 2020-08-04 12:15:51,291 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13055. Traceback (most recent call last):
  13056. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13057. self._serial.open()
  13058. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13059. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13060. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13061. 2020-08-04 12:15:51,463 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  13062. 2020-08-04 12:15:51,465 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  13063. 2020-08-04 12:15:51,475 [messaging :208 ][ERROR ][619] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  13064. Traceback (most recent call last):
  13065. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  13066. self._call_hook_for(message, "workflow", message)
  13067. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13068. return True, func(*args, **kwargs)
  13069. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  13070. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13071. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13072. return True, func(*args, **kwargs)
  13073. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13074. return func(*args, **kwargs)
  13075. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  13076. conn.heartbeat()
  13077. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  13078. self.noop()
  13079. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  13080. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  13081. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  13082. raise attempt.get()
  13083. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  13084. six.reraise(self.value[0], self.value[1], self.value[2])
  13085. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  13086. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  13087. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  13088. self._begin_message()
  13089. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  13090. self.recv(ack=ACK_MESSAGE_BEGIN)
  13091. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  13092. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  13093. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  13094. raise attempt.get()
  13095. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  13096. six.reraise(self.value[0], self.value[1], self.value[2])
  13097. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  13098. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  13099. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  13100. raise Exception(msg)
  13101. Exception: Expected ack '12' but got '255'
  13102. 2020-08-04 12:15:52,296 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13103. Traceback (most recent call last):
  13104. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13105. self._serial.open()
  13106. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13107. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13108. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13109. 2020-08-04 12:15:53,300 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13110. Traceback (most recent call last):
  13111. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13112. self._serial.open()
  13113. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13114. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13115. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13116. 2020-08-04 12:15:53,787 [messaging :206 ][ERROR ][616] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  13117. Traceback (most recent call last):
  13118. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  13119. self._call_hook_for(message, "workflow", message)
  13120. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13121. return True, func(*args, **kwargs)
  13122. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  13123. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13124. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13125. return True, func(*args, **kwargs)
  13126. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13127. return func(*args, **kwargs)
  13128. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  13129. res = _exec("AT+CCLK?")
  13130. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  13131. conn.write_line(cmd)
  13132. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  13133. self.ensure_open()
  13134. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  13135. self.open()
  13136. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  13137. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  13138. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  13139. raise attempt.get()
  13140. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  13141. six.reraise(self.value[0], self.value[1], self.value[2])
  13142. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  13143. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  13144. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13145. self._serial.open()
  13146. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13147. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13148. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13149. 2020-08-04 12:15:55,811 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13150. Traceback (most recent call last):
  13151. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13152. self._serial.open()
  13153. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13154. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13155. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13156. 2020-08-04 12:15:56,816 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13157. Traceback (most recent call last):
  13158. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13159. self._serial.open()
  13160. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13161. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13162. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13163. 2020-08-04 12:15:57,819 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13164. Traceback (most recent call last):
  13165. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13166. self._serial.open()
  13167. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13168. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13169. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13170. 2020-08-04 12:15:57,822 [messaging :742 ][ERROR ][616] Exception while processing event: {'tag': 'ec2x/req/56d41714-e443-4b79-858c-6db8f2fa4d90', 'data': {'_stamp': '2020-08-04T12:15:55.787062', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/56d41714-e443-4b79-858c-6db8f2fa4d90', 'kwargs': {'cooldown_delay': None}}}
  13171. Traceback (most recent call last):
  13172. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  13173. res = self.process(message)
  13174. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  13175. result = func(message, **settings)
  13176. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  13177. found, result = self._call_hook_for(message, "workflow", message)
  13178. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13179. return True, func(*args, **kwargs)
  13180. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  13181. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13182. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13183. return True, func(*args, **kwargs)
  13184. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13185. return func(*args, **kwargs)
  13186. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  13187. return _exec(cmd, **kwargs)
  13188. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  13189. conn.write_line(cmd)
  13190. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  13191. self.ensure_open()
  13192. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  13193. self.open()
  13194. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  13195. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  13196. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  13197. raise attempt.get()
  13198. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  13199. six.reraise(self.value[0], self.value[1], self.value[2])
  13200. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  13201. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  13202. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13203. self._serial.open()
  13204. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13205. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13206. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13207. 2020-08-04 12:15:57,845 [messaging :206 ][ERROR ][617] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  13208. Traceback (most recent call last):
  13209. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  13210. self._call_hook_for(message, "workflow", message)
  13211. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13212. return True, func(*args, **kwargs)
  13213. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  13214. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13215. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13216. return True, func(*args, **kwargs)
  13217. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13218. return func(*args, **kwargs)
  13219. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  13220. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  13221. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  13222. res = query("AT+QGPSLOC={:d}".format(mode))
  13223. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  13224. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  13225. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  13226. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  13227. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  13228. raise salt.exceptions.CommandExecutionError(message["error"])
  13229. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13230. 2020-08-04 12:15:59,362 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13231. Traceback (most recent call last):
  13232. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13233. self._serial.open()
  13234. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13235. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13236. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13237. 2020-08-04 12:16:00,367 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13238. Traceback (most recent call last):
  13239. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13240. self._serial.open()
  13241. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13242. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13243. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13244. 2020-08-04 12:16:01,371 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13245. Traceback (most recent call last):
  13246. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13247. self._serial.open()
  13248. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13249. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13250. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13251. 2020-08-04 12:16:01,904 [messaging :206 ][ERROR ][616] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  13252. Traceback (most recent call last):
  13253. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  13254. self._call_hook_for(message, "workflow", message)
  13255. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13256. return True, func(*args, **kwargs)
  13257. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  13258. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13259. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13260. return True, func(*args, **kwargs)
  13261. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13262. return func(*args, **kwargs)
  13263. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  13264. res = _exec("AT+CCLK?")
  13265. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  13266. conn.write_line(cmd)
  13267. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  13268. self.ensure_open()
  13269. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  13270. self.open()
  13271. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  13272. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  13273. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  13274. raise attempt.get()
  13275. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  13276. six.reraise(self.value[0], self.value[1], self.value[2])
  13277. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  13278. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  13279. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13280. self._serial.open()
  13281. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13282. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13283. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13284. 2020-08-04 12:16:17,024 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][656] Timeout after 1.28205128205 second(s) waiting for interrupt
  13285. 2020-08-04 12:16:17,577 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13286. Traceback (most recent call last):
  13287. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13288. self._serial.open()
  13289. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13290. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13291. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13292. 2020-08-04 12:16:18,581 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13293. Traceback (most recent call last):
  13294. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13295. self._serial.open()
  13296. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13297. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13298. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13299. 2020-08-04 12:16:19,585 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13300. Traceback (most recent call last):
  13301. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13302. self._serial.open()
  13303. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13304. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13305. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13306. 2020-08-04 12:16:20,122 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13307. Traceback (most recent call last):
  13308. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13309. self._serial.open()
  13310. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13311. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13312. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13313. 2020-08-04 12:16:21,127 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13314. Traceback (most recent call last):
  13315. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13316. self._serial.open()
  13317. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13318. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13319. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13320. 2020-08-04 12:16:22,131 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13321. Traceback (most recent call last):
  13322. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13323. self._serial.open()
  13324. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13325. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13326. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13327. 2020-08-04 12:16:22,135 [messaging :742 ][ERROR ][616] Exception while processing event: {'tag': 'ec2x/req/d1e45670-9489-4051-8203-f6932385b9ca', 'data': {'_stamp': '2020-08-04T12:16:17.023698', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/d1e45670-9489-4051-8203-f6932385b9ca', 'kwargs': {'cooldown_delay': None}}}
  13328. Traceback (most recent call last):
  13329. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  13330. res = self.process(message)
  13331. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  13332. result = func(message, **settings)
  13333. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  13334. found, result = self._call_hook_for(message, "workflow", message)
  13335. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13336. return True, func(*args, **kwargs)
  13337. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  13338. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13339. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13340. return True, func(*args, **kwargs)
  13341. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13342. return func(*args, **kwargs)
  13343. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  13344. return _exec(cmd, **kwargs)
  13345. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  13346. conn.write_line(cmd)
  13347. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  13348. self.ensure_open()
  13349. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  13350. self.open()
  13351. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  13352. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  13353. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  13354. raise attempt.get()
  13355. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  13356. six.reraise(self.value[0], self.value[1], self.value[2])
  13357. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  13358. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  13359. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13360. self._serial.open()
  13361. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13362. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13363. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13364. 2020-08-04 12:16:24,057 [messaging :206 ][ERROR ][617] Recurring exception (3 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  13365. Traceback (most recent call last):
  13366. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  13367. self._call_hook_for(message, "workflow", message)
  13368. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13369. return True, func(*args, **kwargs)
  13370. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  13371. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13372. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13373. return True, func(*args, **kwargs)
  13374. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13375. return func(*args, **kwargs)
  13376. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  13377. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  13378. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  13379. res = query("AT+QGPSLOC={:d}".format(mode))
  13380. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  13381. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  13382. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  13383. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  13384. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  13385. raise salt.exceptions.CommandExecutionError(message["error"])
  13386. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13387. 2020-08-04 12:16:25,737 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13388. Traceback (most recent call last):
  13389. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13390. self._serial.open()
  13391. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13392. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13393. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13394. 2020-08-04 12:16:26,742 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13395. Traceback (most recent call last):
  13396. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13397. self._serial.open()
  13398. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13399. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13400. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13401. 2020-08-04 12:16:27,746 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13402. Traceback (most recent call last):
  13403. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13404. self._serial.open()
  13405. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13406. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13407. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13408. 2020-08-04 12:16:29,134 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13409. Traceback (most recent call last):
  13410. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13411. self._serial.open()
  13412. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13413. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13414. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13415. 2020-08-04 12:16:30,150 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13416. Traceback (most recent call last):
  13417. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13418. self._serial.open()
  13419. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13420. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13421. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13422. 2020-08-04 12:16:31,154 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  13423. Traceback (most recent call last):
  13424. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13425. self._serial.open()
  13426. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13427. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13428. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13429. 2020-08-04 12:16:31,157 [messaging :742 ][ERROR ][616] Exception while processing event: {'tag': 'ec2x/req/60fdc481-dcc2-4add-aca6-51263d0730ae', 'data': {'_stamp': '2020-08-04T12:16:29.111443', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/60fdc481-dcc2-4add-aca6-51263d0730ae', 'kwargs': {'cooldown_delay': None}}}
  13430. Traceback (most recent call last):
  13431. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  13432. res = self.process(message)
  13433. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  13434. result = func(message, **settings)
  13435. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  13436. found, result = self._call_hook_for(message, "workflow", message)
  13437. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13438. return True, func(*args, **kwargs)
  13439. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  13440. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13441. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13442. return True, func(*args, **kwargs)
  13443. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13444. return func(*args, **kwargs)
  13445. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  13446. return _exec(cmd, **kwargs)
  13447. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  13448. conn.write_line(cmd)
  13449. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  13450. self.ensure_open()
  13451. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  13452. self.open()
  13453. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  13454. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  13455. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  13456. raise attempt.get()
  13457. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  13458. six.reraise(self.value[0], self.value[1], self.value[2])
  13459. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  13460. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  13461. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13462. self._serial.open()
  13463. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13464. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13465. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13466. 2020-08-04 12:16:33,343 [salt.loaded.int.module.cmdmod:693 ][ERROR ][616] Command '['timedatectl', 'status']' failed with return code: 1
  13467. 2020-08-04 12:16:33,346 [salt.loaded.int.module.cmdmod:695 ][ERROR ][616] stdout: Failed to query server: Operation canceled
  13468. 2020-08-04 12:16:33,348 [salt.loaded.int.module.cmdmod:699 ][ERROR ][616] retcode: 1
  13469. 2020-08-04 12:16:33,350 [messaging :208 ][ERROR ][616] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  13470. Traceback (most recent call last):
  13471. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  13472. self._call_hook_for(message, "workflow", message)
  13473. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13474. return True, func(*args, **kwargs)
  13475. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  13476. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13477. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13478. return True, func(*args, **kwargs)
  13479. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13480. return func(*args, **kwargs)
  13481. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 215, in sync_time_handler
  13482. if not force and status["ntp_synchronized"] == "yes":
  13483. KeyError: 'ntp_synchronized'
  13484. 2020-08-04 12:16:34,741 [obd.obd :107 ][ERROR ][653] Failed to use explicit port '/dev/serial0'
  13485. Traceback (most recent call last):
  13486. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  13487. self.interface.open(baudrate, protocol=protocol)
  13488. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  13489. self.set_protocol(prot.pop("id", None), **prot)
  13490. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  13491. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  13492. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  13493. self._protocol = self._auto_protocol(**kwargs)
  13494. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  13495. res_0100 = self._verify_protocol("auto", test=not verify)
  13496. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  13497. for line in self.query("0100", parse=False, read_timeout=10):
  13498. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  13499. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  13500. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  13501. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  13502. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  13503. data = self._port.read(self._port.in_waiting or 1)
  13504. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  13505. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  13506. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  13507. sys.exit(salt.defaults.exitcodes.EX_OK)
  13508. SystemExit: 0
  13509. 2020-08-04 12:16:34,766 [obd.obd :120 ][WARNING ][653] Cannot load commands - no connection to bus
  13510. 2020-08-04 12:16:34,790 [obd.interfaces.elm327:730 ][ERROR ][653] Failed to relay command 'STSLCS' to interface
  13511. Traceback (most recent call last):
  13512. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  13513. lines = self.send(cmd, raw_response=raw_response)
  13514. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  13515. raise ELM327Error(self.ERRORS[line], code=line)
  13516. ELM327Error: Operation interrupted by a received RS232 character
  13517. 2020-08-04 12:16:34,793 [messaging :742 ][ERROR ][653] Exception while processing event: {'tag': 'obd/req/5a66ba86-1308-4488-9d87-0d7db6134f53', 'data': {'_stamp': '2020-08-04T12:16:29.212598', 'handler': 'execute', '_event_tag': 'obd/req/5a66ba86-1308-4488-9d87-0d7db6134f53', 'args': ['STSLCS']}}
  13518. Traceback (most recent call last):
  13519. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  13520. res = self.process(message)
  13521. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  13522. result = func(message, **settings)
  13523. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  13524. found, result = self._call_hook_for(message, "workflow", message)
  13525. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13526. return True, func(*args, **kwargs)
  13527. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  13528. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13529. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13530. return True, func(*args, **kwargs)
  13531. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13532. return func(*args, **kwargs)
  13533. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  13534. res = conn.execute(cmd)
  13535. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  13536. return func(self, *args, **kwargs)
  13537. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  13538. return self._obd.execute(cmd, **kwargs)
  13539. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  13540. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  13541. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  13542. lines = self.send(cmd, raw_response=raw_response)
  13543. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  13544. raise ELM327Error(self.ERRORS[line], code=line)
  13545. ELM327Error: Operation interrupted by a received RS232 character
  13546. 2020-08-04 12:16:35,519 [salt.utils.parsers:1050][WARNING ][416] Minion received a SIGTERM. Exiting.
  13547. 2020-08-04 12:16:36,059 [messaging :871 ][WARNING ][900] No reply message with tag 'obd/res/5a66ba86-1308-4488-9d87-0d7db6134f53' received within timeout of 30 secs
  13548. 2020-08-04 12:16:36,064 [salt.state :292 ][ERROR ][900] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  13549. 2020-08-04 12:16:53,190 [gpio_spi_conn :42 ][WARNING ][649] Unable to clear buffer - got unexpected value: 255
  13550. 2020-08-04 12:16:53,206 [gpio_spi_conn :42 ][WARNING ][649] Unable to clear buffer - got unexpected value: 255
  13551. 2020-08-04 12:16:53,224 [gpio_spi_conn :42 ][WARNING ][649] Unable to clear buffer - got unexpected value: 255
  13552. 2020-08-04 12:16:53,859 [serial_conn :79 ][ERROR ][646] Failed to open serial connection
  13553. Traceback (most recent call last):
  13554. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13555. self._serial.open()
  13556. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13557. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13558. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13559. 2020-08-04 12:16:54,872 [serial_conn :79 ][ERROR ][646] Failed to open serial connection
  13560. Traceback (most recent call last):
  13561. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13562. self._serial.open()
  13563. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13564. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13565. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13566. 2020-08-04 12:16:55,275 [gpio_spi_conn :109 ][WARNING ][649] Expected ack '12' but got '255'
  13567. 2020-08-04 12:16:55,778 [gpio_spi_conn :109 ][WARNING ][649] Expected ack '12' but got '255'
  13568. 2020-08-04 12:16:55,876 [serial_conn :79 ][ERROR ][646] Failed to open serial connection
  13569. Traceback (most recent call last):
  13570. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13571. self._serial.open()
  13572. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13573. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13574. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13575. 2020-08-04 12:16:56,281 [gpio_spi_conn :109 ][WARNING ][649] Expected ack '12' but got '255'
  13576. 2020-08-04 12:16:56,283 [spm_conn :139 ][WARNING ][649] Unable to get status: Expected ack '12' but got '255'
  13577. 2020-08-04 12:16:56,517 [messaging :208 ][ERROR ][646] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  13578. Traceback (most recent call last):
  13579. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  13580. self._call_hook_for(message, "workflow", message)
  13581. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13582. return True, func(*args, **kwargs)
  13583. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  13584. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13585. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13586. return True, func(*args, **kwargs)
  13587. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13588. return func(*args, **kwargs)
  13589. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  13590. res = _exec("AT+CCLK?")
  13591. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  13592. conn.write_line(cmd)
  13593. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  13594. self.ensure_open()
  13595. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  13596. self.open()
  13597. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  13598. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  13599. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  13600. raise attempt.get()
  13601. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  13602. six.reraise(self.value[0], self.value[1], self.value[2])
  13603. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  13604. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  13605. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13606. self._serial.open()
  13607. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13608. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13609. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13610. 2020-08-04 12:16:56,787 [gpio_spi_conn :109 ][WARNING ][649] Expected ack '12' but got '255'
  13611. 2020-08-04 12:16:57,291 [gpio_spi_conn :109 ][WARNING ][649] Expected ack '12' but got '255'
  13612. 2020-08-04 12:16:57,794 [gpio_spi_conn :109 ][WARNING ][649] Expected ack '12' but got '255'
  13613. 2020-08-04 12:16:57,796 [spm_conn :139 ][WARNING ][649] Unable to get status: Expected ack '12' but got '255'
  13614. 2020-08-04 12:16:58,300 [gpio_spi_conn :109 ][WARNING ][649] Expected ack '12' but got '255'
  13615. 2020-08-04 12:16:58,803 [gpio_spi_conn :109 ][WARNING ][649] Expected ack '12' but got '255'
  13616. 2020-08-04 12:16:59,306 [gpio_spi_conn :109 ][WARNING ][649] Expected ack '12' but got '255'
  13617. 2020-08-04 12:16:59,308 [spm_conn :139 ][WARNING ][649] Unable to get status: Expected ack '12' but got '255'
  13618. 2020-08-04 12:16:59,312 [gpio_spi_conn :109 ][WARNING ][649] Expected ack '12' but got '255'
  13619. 2020-08-04 12:16:59,815 [gpio_spi_conn :109 ][WARNING ][649] Expected ack '12' but got '255'
  13620. 2020-08-04 12:17:00,318 [gpio_spi_conn :109 ][WARNING ][649] Expected ack '12' but got '255'
  13621. 2020-08-04 12:17:00,321 [spm_conn :82 ][WARNING ][649] Unable to send noop: Expected ack '12' but got '255'
  13622. 2020-08-04 12:17:00,664 [serial_conn :79 ][ERROR ][646] Failed to open serial connection
  13623. Traceback (most recent call last):
  13624. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13625. self._serial.open()
  13626. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13627. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13628. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13629. 2020-08-04 12:17:00,826 [gpio_spi_conn :109 ][WARNING ][649] Expected ack '12' but got '255'
  13630. 2020-08-04 12:17:01,329 [gpio_spi_conn :109 ][WARNING ][649] Expected ack '12' but got '255'
  13631. 2020-08-04 12:17:01,688 [serial_conn :79 ][ERROR ][646] Failed to open serial connection
  13632. Traceback (most recent call last):
  13633. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13634. self._serial.open()
  13635. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13636. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13637. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13638. 2020-08-04 12:17:01,832 [gpio_spi_conn :109 ][WARNING ][649] Expected ack '12' but got '255'
  13639. 2020-08-04 12:17:01,834 [spm_conn :82 ][WARNING ][649] Unable to send noop: Expected ack '12' but got '255'
  13640. 2020-08-04 12:17:02,338 [gpio_spi_conn :109 ][WARNING ][649] Expected ack '12' but got '255'
  13641. 2020-08-04 12:17:02,692 [serial_conn :79 ][ERROR ][646] Failed to open serial connection
  13642. Traceback (most recent call last):
  13643. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13644. self._serial.open()
  13645. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13646. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13647. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13648. 2020-08-04 12:17:02,696 [messaging :742 ][ERROR ][646] Exception while processing event: {'tag': 'ec2x/req/aac3aace-c68d-40c9-bec7-5c0dfa2b4a93', 'data': {'_stamp': '2020-08-04T12:16:53.277667', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/aac3aace-c68d-40c9-bec7-5c0dfa2b4a93', 'kwargs': {'cooldown_delay': None}}}
  13649. Traceback (most recent call last):
  13650. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  13651. res = self.process(message)
  13652. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  13653. result = func(message, **settings)
  13654. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  13655. found, result = self._call_hook_for(message, "workflow", message)
  13656. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13657. return True, func(*args, **kwargs)
  13658. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  13659. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13660. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13661. return True, func(*args, **kwargs)
  13662. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13663. return func(*args, **kwargs)
  13664. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  13665. return _exec(cmd, **kwargs)
  13666. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  13667. conn.write_line(cmd)
  13668. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  13669. self.ensure_open()
  13670. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  13671. self.open()
  13672. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  13673. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  13674. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  13675. raise attempt.get()
  13676. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  13677. six.reraise(self.value[0], self.value[1], self.value[2])
  13678. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  13679. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  13680. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13681. self._serial.open()
  13682. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13683. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13684. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13685. 2020-08-04 12:17:02,843 [gpio_spi_conn :109 ][WARNING ][649] Expected ack '12' but got '255'
  13686. 2020-08-04 12:17:03,310 [serial_conn :79 ][ERROR ][646] Failed to open serial connection
  13687. Traceback (most recent call last):
  13688. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13689. self._serial.open()
  13690. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13691. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13692. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13693. 2020-08-04 12:17:03,349 [gpio_spi_conn :109 ][WARNING ][649] Expected ack '12' but got '255'
  13694. 2020-08-04 12:17:03,352 [spm_conn :82 ][WARNING ][649] Unable to send noop: Expected ack '12' but got '255'
  13695. 2020-08-04 12:17:03,355 [messaging :208 ][ERROR ][649] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  13696. Traceback (most recent call last):
  13697. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  13698. self._call_hook_for(message, "workflow", message)
  13699. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13700. return True, func(*args, **kwargs)
  13701. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  13702. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13703. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13704. return True, func(*args, **kwargs)
  13705. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13706. return func(*args, **kwargs)
  13707. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  13708. conn.heartbeat()
  13709. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  13710. self.noop()
  13711. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  13712. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  13713. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  13714. raise attempt.get()
  13715. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  13716. six.reraise(self.value[0], self.value[1], self.value[2])
  13717. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  13718. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  13719. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  13720. self._begin_message()
  13721. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  13722. self.recv(ack=ACK_MESSAGE_BEGIN)
  13723. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  13724. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  13725. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  13726. raise attempt.get()
  13727. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  13728. six.reraise(self.value[0], self.value[1], self.value[2])
  13729. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  13730. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  13731. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  13732. raise Exception(msg)
  13733. Exception: Expected ack '12' but got '255'
  13734. 2020-08-04 12:17:04,315 [serial_conn :79 ][ERROR ][646] Failed to open serial connection
  13735. Traceback (most recent call last):
  13736. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13737. self._serial.open()
  13738. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13739. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13740. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13741. 2020-08-04 12:17:05,054 [messaging :208 ][ERROR ][647] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  13742. Traceback (most recent call last):
  13743. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  13744. self._call_hook_for(message, "workflow", message)
  13745. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13746. return True, func(*args, **kwargs)
  13747. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  13748. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13749. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13750. return True, func(*args, **kwargs)
  13751. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13752. return func(*args, **kwargs)
  13753. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  13754. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  13755. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  13756. res = query("AT+QGPSLOC={:d}".format(mode))
  13757. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  13758. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  13759. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  13760. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  13761. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  13762. raise salt.exceptions.CommandExecutionError(message["error"])
  13763. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13764. 2020-08-04 12:17:05,319 [serial_conn :79 ][ERROR ][646] Failed to open serial connection
  13765. Traceback (most recent call last):
  13766. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13767. self._serial.open()
  13768. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13769. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13770. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13771. 2020-08-04 12:17:05,832 [messaging :206 ][ERROR ][646] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  13772. Traceback (most recent call last):
  13773. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  13774. self._call_hook_for(message, "workflow", message)
  13775. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13776. return True, func(*args, **kwargs)
  13777. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  13778. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13779. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13780. return True, func(*args, **kwargs)
  13781. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13782. return func(*args, **kwargs)
  13783. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  13784. res = _exec("AT+CCLK?")
  13785. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  13786. conn.write_line(cmd)
  13787. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  13788. self.ensure_open()
  13789. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  13790. self.open()
  13791. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  13792. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  13793. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  13794. raise attempt.get()
  13795. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  13796. six.reraise(self.value[0], self.value[1], self.value[2])
  13797. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  13798. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  13799. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13800. self._serial.open()
  13801. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13802. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13803. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13804. 2020-08-04 12:17:20,515 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][736] Timeout after 1.28205128205 second(s) waiting for interrupt
  13805. 2020-08-04 12:17:20,614 [serial_conn :79 ][ERROR ][646] Failed to open serial connection
  13806. Traceback (most recent call last):
  13807. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13808. self._serial.open()
  13809. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13810. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13811. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13812. 2020-08-04 12:17:21,619 [serial_conn :79 ][ERROR ][646] Failed to open serial connection
  13813. Traceback (most recent call last):
  13814. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13815. self._serial.open()
  13816. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13817. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13818. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13819. 2020-08-04 12:17:22,622 [serial_conn :79 ][ERROR ][646] Failed to open serial connection
  13820. Traceback (most recent call last):
  13821. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13822. self._serial.open()
  13823. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13824. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13825. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13826. 2020-08-04 12:17:22,626 [messaging :206 ][ERROR ][646] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  13827. Traceback (most recent call last):
  13828. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  13829. self._call_hook_for(message, "workflow", message)
  13830. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13831. return True, func(*args, **kwargs)
  13832. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  13833. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13834. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13835. return True, func(*args, **kwargs)
  13836. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13837. return func(*args, **kwargs)
  13838. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  13839. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  13840. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  13841. conn.write_line(cmd)
  13842. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  13843. self.ensure_open()
  13844. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  13845. self.open()
  13846. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  13847. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  13848. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  13849. raise attempt.get()
  13850. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  13851. six.reraise(self.value[0], self.value[1], self.value[2])
  13852. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  13853. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  13854. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13855. self._serial.open()
  13856. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13857. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13858. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13859. 2020-08-04 12:17:22,628 [serial_conn :79 ][ERROR ][646] Failed to open serial connection
  13860. Traceback (most recent call last):
  13861. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13862. self._serial.open()
  13863. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13864. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13865. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13866. 2020-08-04 12:17:23,636 [serial_conn :79 ][ERROR ][646] Failed to open serial connection
  13867. Traceback (most recent call last):
  13868. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13869. self._serial.open()
  13870. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13871. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13872. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13873. 2020-08-04 12:17:24,641 [serial_conn :79 ][ERROR ][646] Failed to open serial connection
  13874. Traceback (most recent call last):
  13875. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13876. self._serial.open()
  13877. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13878. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13879. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13880. 2020-08-04 12:17:24,645 [messaging :742 ][ERROR ][646] Exception while processing event: {'tag': 'ec2x/req/2f04ff35-b3d3-4a41-b04a-5662cd9ae22e', 'data': {'_stamp': '2020-08-04T12:17:20.550668', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/2f04ff35-b3d3-4a41-b04a-5662cd9ae22e', 'kwargs': {'cooldown_delay': None}}}
  13881. Traceback (most recent call last):
  13882. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  13883. res = self.process(message)
  13884. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  13885. result = func(message, **settings)
  13886. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  13887. found, result = self._call_hook_for(message, "workflow", message)
  13888. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13889. return True, func(*args, **kwargs)
  13890. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  13891. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13892. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13893. return True, func(*args, **kwargs)
  13894. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13895. return func(*args, **kwargs)
  13896. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  13897. return _exec(cmd, **kwargs)
  13898. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  13899. conn.write_line(cmd)
  13900. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  13901. self.ensure_open()
  13902. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  13903. self.open()
  13904. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  13905. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  13906. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  13907. raise attempt.get()
  13908. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  13909. six.reraise(self.value[0], self.value[1], self.value[2])
  13910. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  13911. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  13912. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  13913. self._serial.open()
  13914. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  13915. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  13916. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13917. 2020-08-04 12:17:24,685 [messaging :206 ][ERROR ][647] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  13918. Traceback (most recent call last):
  13919. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  13920. self._call_hook_for(message, "workflow", message)
  13921. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13922. return True, func(*args, **kwargs)
  13923. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  13924. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13925. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13926. return True, func(*args, **kwargs)
  13927. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13928. return func(*args, **kwargs)
  13929. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  13930. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  13931. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  13932. res = query("AT+QGPSLOC={:d}".format(mode))
  13933. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  13934. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  13935. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  13936. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  13937. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  13938. raise salt.exceptions.CommandExecutionError(message["error"])
  13939. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  13940. 2020-08-04 12:17:29,824 [obd.obd :107 ][ERROR ][735] Failed to use explicit port '/dev/serial0'
  13941. Traceback (most recent call last):
  13942. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  13943. self.interface.open(baudrate, protocol=protocol)
  13944. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  13945. self.set_protocol(prot.pop("id", None), **prot)
  13946. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  13947. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  13948. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  13949. self._protocol = self._auto_protocol(**kwargs)
  13950. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  13951. res_0100 = self._verify_protocol("auto", test=not verify)
  13952. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  13953. for line in self.query("0100", parse=False, read_timeout=10):
  13954. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  13955. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  13956. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  13957. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  13958. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  13959. data = self._port.read(self._port.in_waiting or 1)
  13960. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  13961. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  13962. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  13963. sys.exit(salt.defaults.exitcodes.EX_OK)
  13964. SystemExit: 0
  13965. 2020-08-04 12:17:29,845 [obd.obd :120 ][WARNING ][735] Cannot load commands - no connection to bus
  13966. 2020-08-04 12:17:29,874 [obd.interfaces.elm327:730 ][ERROR ][735] Failed to relay command 'STSLCS' to interface
  13967. Traceback (most recent call last):
  13968. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  13969. lines = self.send(cmd, raw_response=raw_response)
  13970. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  13971. raise ELM327Error(self.ERRORS[line], code=line)
  13972. ELM327Error: Operation interrupted by a received RS232 character
  13973. 2020-08-04 12:17:29,877 [messaging :742 ][ERROR ][735] Exception while processing event: {'tag': 'obd/req/1b4ac010-437d-4c6c-873f-7009e4b44205', 'data': {'_stamp': '2020-08-04T12:17:24.310350', 'handler': 'execute', '_event_tag': 'obd/req/1b4ac010-437d-4c6c-873f-7009e4b44205', 'args': ['STSLCS']}}
  13974. Traceback (most recent call last):
  13975. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  13976. res = self.process(message)
  13977. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  13978. result = func(message, **settings)
  13979. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  13980. found, result = self._call_hook_for(message, "workflow", message)
  13981. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13982. return True, func(*args, **kwargs)
  13983. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  13984. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  13985. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  13986. return True, func(*args, **kwargs)
  13987. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  13988. return func(*args, **kwargs)
  13989. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  13990. res = conn.execute(cmd)
  13991. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  13992. return func(self, *args, **kwargs)
  13993. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  13994. return self._obd.execute(cmd, **kwargs)
  13995. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  13996. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  13997. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  13998. lines = self.send(cmd, raw_response=raw_response)
  13999. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  14000. raise ELM327Error(self.ERRORS[line], code=line)
  14001. ELM327Error: Operation interrupted by a received RS232 character
  14002. 2020-08-04 12:17:30,644 [salt.utils.parsers:1050][WARNING ][444] Minion received a SIGTERM. Exiting.
  14003. 2020-08-04 12:17:31,181 [messaging :871 ][WARNING ][874] No reply message with tag 'obd/res/1b4ac010-437d-4c6c-873f-7009e4b44205' received within timeout of 30 secs
  14004. 2020-08-04 12:17:31,185 [salt.state :292 ][ERROR ][874] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  14005. 2020-08-04 12:17:48,232 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  14006. 2020-08-04 12:17:48,250 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  14007. 2020-08-04 12:17:48,271 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  14008. 2020-08-04 12:17:48,911 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  14009. Traceback (most recent call last):
  14010. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14011. self._serial.open()
  14012. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14013. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14014. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14015. 2020-08-04 12:17:49,923 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  14016. Traceback (most recent call last):
  14017. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14018. self._serial.open()
  14019. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14020. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14021. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14022. 2020-08-04 12:17:50,306 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  14023. 2020-08-04 12:17:50,809 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  14024. 2020-08-04 12:17:50,927 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  14025. Traceback (most recent call last):
  14026. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14027. self._serial.open()
  14028. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14029. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14030. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14031. 2020-08-04 12:17:51,311 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  14032. 2020-08-04 12:17:51,314 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  14033. 2020-08-04 12:17:51,495 [messaging :208 ][ERROR ][618] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  14034. Traceback (most recent call last):
  14035. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  14036. self._call_hook_for(message, "workflow", message)
  14037. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14038. return True, func(*args, **kwargs)
  14039. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  14040. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14041. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14042. return True, func(*args, **kwargs)
  14043. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14044. return func(*args, **kwargs)
  14045. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  14046. res = _exec("AT+CCLK?")
  14047. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  14048. conn.write_line(cmd)
  14049. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  14050. self.ensure_open()
  14051. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  14052. self.open()
  14053. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  14054. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  14055. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  14056. raise attempt.get()
  14057. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  14058. six.reraise(self.value[0], self.value[1], self.value[2])
  14059. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  14060. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  14061. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14062. self._serial.open()
  14063. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14064. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14065. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14066. 2020-08-04 12:17:51,817 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  14067. 2020-08-04 12:17:52,321 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  14068. 2020-08-04 12:17:52,823 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  14069. 2020-08-04 12:17:52,826 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  14070. 2020-08-04 12:17:53,329 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  14071. 2020-08-04 12:17:53,841 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  14072. 2020-08-04 12:17:54,344 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  14073. 2020-08-04 12:17:54,346 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  14074. 2020-08-04 12:17:54,350 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  14075. 2020-08-04 12:17:54,853 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  14076. 2020-08-04 12:17:55,356 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  14077. 2020-08-04 12:17:55,358 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  14078. 2020-08-04 12:17:55,656 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  14079. Traceback (most recent call last):
  14080. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14081. self._serial.open()
  14082. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14083. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14084. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14085. 2020-08-04 12:17:55,861 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  14086. 2020-08-04 12:17:56,364 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  14087. 2020-08-04 12:17:56,691 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  14088. Traceback (most recent call last):
  14089. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14090. self._serial.open()
  14091. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14092. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14093. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14094. 2020-08-04 12:17:56,867 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  14095. 2020-08-04 12:17:56,870 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  14096. 2020-08-04 12:17:57,373 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  14097. 2020-08-04 12:17:57,696 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  14098. Traceback (most recent call last):
  14099. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14100. self._serial.open()
  14101. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14102. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14103. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14104. 2020-08-04 12:17:57,699 [messaging :742 ][ERROR ][618] Exception while processing event: {'tag': 'ec2x/req/7fa0f133-5445-4a45-8094-bb18213133fd', 'data': {'_stamp': '2020-08-04T12:17:48.329756', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/7fa0f133-5445-4a45-8094-bb18213133fd', 'kwargs': {'cooldown_delay': None}}}
  14105. Traceback (most recent call last):
  14106. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  14107. res = self.process(message)
  14108. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  14109. result = func(message, **settings)
  14110. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  14111. found, result = self._call_hook_for(message, "workflow", message)
  14112. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14113. return True, func(*args, **kwargs)
  14114. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  14115. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14116. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14117. return True, func(*args, **kwargs)
  14118. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14119. return func(*args, **kwargs)
  14120. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  14121. return _exec(cmd, **kwargs)
  14122. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  14123. conn.write_line(cmd)
  14124. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  14125. self.ensure_open()
  14126. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  14127. self.open()
  14128. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  14129. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  14130. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  14131. raise attempt.get()
  14132. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  14133. six.reraise(self.value[0], self.value[1], self.value[2])
  14134. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  14135. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  14136. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14137. self._serial.open()
  14138. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14139. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14140. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14141. 2020-08-04 12:17:57,876 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  14142. 2020-08-04 12:17:58,344 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  14143. Traceback (most recent call last):
  14144. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14145. self._serial.open()
  14146. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14147. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14148. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14149. 2020-08-04 12:17:58,379 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  14150. 2020-08-04 12:17:58,382 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  14151. 2020-08-04 12:17:58,393 [messaging :208 ][ERROR ][621] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  14152. Traceback (most recent call last):
  14153. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  14154. self._call_hook_for(message, "workflow", message)
  14155. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14156. return True, func(*args, **kwargs)
  14157. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  14158. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14159. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14160. return True, func(*args, **kwargs)
  14161. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14162. return func(*args, **kwargs)
  14163. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  14164. conn.heartbeat()
  14165. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  14166. self.noop()
  14167. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  14168. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  14169. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  14170. raise attempt.get()
  14171. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  14172. six.reraise(self.value[0], self.value[1], self.value[2])
  14173. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  14174. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  14175. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  14176. self._begin_message()
  14177. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  14178. self.recv(ack=ACK_MESSAGE_BEGIN)
  14179. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  14180. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  14181. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  14182. raise attempt.get()
  14183. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  14184. six.reraise(self.value[0], self.value[1], self.value[2])
  14185. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  14186. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  14187. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  14188. raise Exception(msg)
  14189. Exception: Expected ack '12' but got '255'
  14190. 2020-08-04 12:17:59,348 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  14191. Traceback (most recent call last):
  14192. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14193. self._serial.open()
  14194. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14195. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14196. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14197. 2020-08-04 12:17:59,966 [messaging :208 ][ERROR ][619] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  14198. Traceback (most recent call last):
  14199. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  14200. self._call_hook_for(message, "workflow", message)
  14201. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14202. return True, func(*args, **kwargs)
  14203. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  14204. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14205. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14206. return True, func(*args, **kwargs)
  14207. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14208. return func(*args, **kwargs)
  14209. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  14210. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  14211. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  14212. res = query("AT+QGPSLOC={:d}".format(mode))
  14213. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  14214. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  14215. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  14216. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  14217. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  14218. raise salt.exceptions.CommandExecutionError(message["error"])
  14219. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14220. 2020-08-04 12:18:00,353 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  14221. Traceback (most recent call last):
  14222. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14223. self._serial.open()
  14224. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14225. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14226. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14227. 2020-08-04 12:18:00,899 [messaging :206 ][ERROR ][618] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  14228. Traceback (most recent call last):
  14229. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  14230. self._call_hook_for(message, "workflow", message)
  14231. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14232. return True, func(*args, **kwargs)
  14233. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  14234. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14235. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14236. return True, func(*args, **kwargs)
  14237. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14238. return func(*args, **kwargs)
  14239. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  14240. res = _exec("AT+CCLK?")
  14241. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  14242. conn.write_line(cmd)
  14243. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  14244. self.ensure_open()
  14245. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  14246. self.open()
  14247. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  14248. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  14249. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  14250. raise attempt.get()
  14251. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  14252. six.reraise(self.value[0], self.value[1], self.value[2])
  14253. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  14254. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  14255. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14256. self._serial.open()
  14257. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14258. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14259. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14260. 2020-08-04 12:18:15,814 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][658] Timeout after 1.28205128205 second(s) waiting for interrupt
  14261. 2020-08-04 12:18:15,887 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  14262. Traceback (most recent call last):
  14263. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14264. self._serial.open()
  14265. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14266. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14267. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14268. 2020-08-04 12:18:16,892 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  14269. Traceback (most recent call last):
  14270. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14271. self._serial.open()
  14272. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14273. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14274. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14275. 2020-08-04 12:18:17,896 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  14276. Traceback (most recent call last):
  14277. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14278. self._serial.open()
  14279. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14280. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14281. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14282. 2020-08-04 12:18:17,899 [messaging :206 ][ERROR ][618] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  14283. Traceback (most recent call last):
  14284. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  14285. self._call_hook_for(message, "workflow", message)
  14286. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14287. return True, func(*args, **kwargs)
  14288. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  14289. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14290. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14291. return True, func(*args, **kwargs)
  14292. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14293. return func(*args, **kwargs)
  14294. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  14295. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  14296. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  14297. conn.write_line(cmd)
  14298. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  14299. self.ensure_open()
  14300. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  14301. self.open()
  14302. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  14303. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  14304. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  14305. raise attempt.get()
  14306. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  14307. six.reraise(self.value[0], self.value[1], self.value[2])
  14308. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  14309. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  14310. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14311. self._serial.open()
  14312. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14313. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14314. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14315. 2020-08-04 12:18:17,901 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  14316. Traceback (most recent call last):
  14317. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14318. self._serial.open()
  14319. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14320. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14321. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14322. 2020-08-04 12:18:18,911 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  14323. Traceback (most recent call last):
  14324. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14325. self._serial.open()
  14326. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14327. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14328. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14329. 2020-08-04 12:18:19,915 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  14330. Traceback (most recent call last):
  14331. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14332. self._serial.open()
  14333. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14334. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14335. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14336. 2020-08-04 12:18:19,918 [messaging :742 ][ERROR ][618] Exception while processing event: {'tag': 'ec2x/req/014e8369-39b4-40b8-8fea-2902d510c760', 'data': {'_stamp': '2020-08-04T12:18:15.809313', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/014e8369-39b4-40b8-8fea-2902d510c760', 'kwargs': {'cooldown_delay': None}}}
  14337. Traceback (most recent call last):
  14338. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  14339. res = self.process(message)
  14340. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  14341. result = func(message, **settings)
  14342. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  14343. found, result = self._call_hook_for(message, "workflow", message)
  14344. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14345. return True, func(*args, **kwargs)
  14346. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  14347. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14348. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14349. return True, func(*args, **kwargs)
  14350. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14351. return func(*args, **kwargs)
  14352. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  14353. return _exec(cmd, **kwargs)
  14354. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  14355. conn.write_line(cmd)
  14356. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  14357. self.ensure_open()
  14358. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  14359. self.open()
  14360. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  14361. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  14362. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  14363. raise attempt.get()
  14364. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  14365. six.reraise(self.value[0], self.value[1], self.value[2])
  14366. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  14367. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  14368. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14369. self._serial.open()
  14370. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14371. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14372. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14373. 2020-08-04 12:18:19,945 [messaging :206 ][ERROR ][619] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  14374. Traceback (most recent call last):
  14375. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  14376. self._call_hook_for(message, "workflow", message)
  14377. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14378. return True, func(*args, **kwargs)
  14379. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  14380. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14381. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14382. return True, func(*args, **kwargs)
  14383. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14384. return func(*args, **kwargs)
  14385. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  14386. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  14387. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  14388. res = query("AT+QGPSLOC={:d}".format(mode))
  14389. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  14390. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  14391. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  14392. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  14393. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  14394. raise salt.exceptions.CommandExecutionError(message["error"])
  14395. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14396. 2020-08-04 12:18:24,972 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  14397. Traceback (most recent call last):
  14398. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14399. self._serial.open()
  14400. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14401. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14402. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14403. 2020-08-04 12:18:25,252 [obd.obd :107 ][ERROR ][657] Failed to use explicit port '/dev/serial0'
  14404. Traceback (most recent call last):
  14405. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  14406. self.interface.open(baudrate, protocol=protocol)
  14407. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  14408. self.set_protocol(prot.pop("id", None), **prot)
  14409. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  14410. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  14411. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  14412. self._protocol = self._auto_protocol(**kwargs)
  14413. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  14414. res_0100 = self._verify_protocol("auto", test=not verify)
  14415. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  14416. for line in self.query("0100", parse=False, read_timeout=10):
  14417. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  14418. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  14419. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  14420. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  14421. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  14422. data = self._port.read(self._port.in_waiting or 1)
  14423. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  14424. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  14425. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  14426. sys.exit(salt.defaults.exitcodes.EX_OK)
  14427. SystemExit: 0
  14428. 2020-08-04 12:18:25,346 [obd.obd :120 ][WARNING ][657] Cannot load commands - no connection to bus
  14429. 2020-08-04 12:18:25,346 [messaging :753 ][WARNING ][618] No reply to send back for event: {'tag': 'ec2x/req/e5ae8563-6bc3-4003-9847-4e591493f720', 'data': {'_stamp': '2020-08-04T12:18:24.964294', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/e5ae8563-6bc3-4003-9847-4e591493f720', 'kwargs': {'cooldown_delay': None}}}
  14430. 2020-08-04 12:18:25,374 [obd.interfaces.elm327:730 ][ERROR ][657] Failed to relay command 'STSLCS' to interface
  14431. Traceback (most recent call last):
  14432. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  14433. lines = self.send(cmd, raw_response=raw_response)
  14434. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  14435. raise ELM327Error(self.ERRORS[line], code=line)
  14436. ELM327Error: Operation interrupted by a received RS232 character
  14437. 2020-08-04 12:18:25,379 [messaging :742 ][ERROR ][657] Exception while processing event: {'tag': 'obd/req/c725eb39-cf89-4595-9e86-6fc3a14511ec', 'data': {'_stamp': '2020-08-04T12:18:19.734932', 'handler': 'execute', '_event_tag': 'obd/req/c725eb39-cf89-4595-9e86-6fc3a14511ec', 'args': ['STSLCS']}}
  14438. Traceback (most recent call last):
  14439. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  14440. res = self.process(message)
  14441. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  14442. result = func(message, **settings)
  14443. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  14444. found, result = self._call_hook_for(message, "workflow", message)
  14445. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14446. return True, func(*args, **kwargs)
  14447. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  14448. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14449. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14450. return True, func(*args, **kwargs)
  14451. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14452. return func(*args, **kwargs)
  14453. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  14454. res = conn.execute(cmd)
  14455. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  14456. return func(self, *args, **kwargs)
  14457. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  14458. return self._obd.execute(cmd, **kwargs)
  14459. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  14460. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  14461. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  14462. lines = self.send(cmd, raw_response=raw_response)
  14463. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  14464. raise ELM327Error(self.ERRORS[line], code=line)
  14465. ELM327Error: Operation interrupted by a received RS232 character
  14466. 2020-08-04 12:18:26,115 [salt.utils.parsers:1050][WARNING ][418] Minion received a SIGTERM. Exiting.
  14467. 2020-08-04 12:18:26,652 [messaging :871 ][WARNING ][832] No reply message with tag 'obd/res/c725eb39-cf89-4595-9e86-6fc3a14511ec' received within timeout of 30 secs
  14468. 2020-08-04 12:18:26,656 [salt.state :292 ][ERROR ][832] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  14469. 2020-08-04 12:18:43,076 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  14470. 2020-08-04 12:18:43,087 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  14471. 2020-08-04 12:18:43,098 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  14472. 2020-08-04 12:18:43,705 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  14473. Traceback (most recent call last):
  14474. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14475. self._serial.open()
  14476. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14477. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14478. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14479. 2020-08-04 12:18:44,716 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  14480. Traceback (most recent call last):
  14481. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14482. self._serial.open()
  14483. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14484. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14485. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14486. 2020-08-04 12:18:45,126 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  14487. 2020-08-04 12:18:45,629 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  14488. 2020-08-04 12:18:45,720 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  14489. Traceback (most recent call last):
  14490. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14491. self._serial.open()
  14492. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14493. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14494. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14495. 2020-08-04 12:18:46,132 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  14496. 2020-08-04 12:18:46,134 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  14497. 2020-08-04 12:18:46,400 [messaging :208 ][ERROR ][616] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  14498. Traceback (most recent call last):
  14499. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  14500. self._call_hook_for(message, "workflow", message)
  14501. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14502. return True, func(*args, **kwargs)
  14503. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  14504. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14505. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14506. return True, func(*args, **kwargs)
  14507. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14508. return func(*args, **kwargs)
  14509. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  14510. res = _exec("AT+CCLK?")
  14511. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  14512. conn.write_line(cmd)
  14513. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  14514. self.ensure_open()
  14515. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  14516. self.open()
  14517. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  14518. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  14519. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  14520. raise attempt.get()
  14521. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  14522. six.reraise(self.value[0], self.value[1], self.value[2])
  14523. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  14524. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  14525. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14526. self._serial.open()
  14527. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14528. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14529. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14530. 2020-08-04 12:18:46,638 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  14531. 2020-08-04 12:19:01,729 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][694] Timeout after 1.28205128205 second(s) waiting for interrupt
  14532. 2020-08-04 12:19:01,815 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  14533. Traceback (most recent call last):
  14534. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14535. self._serial.open()
  14536. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14537. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14538. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14539. 2020-08-04 12:19:02,048 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  14540. 2020-08-04 12:19:02,551 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  14541. 2020-08-04 12:19:02,554 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  14542. 2020-08-04 12:19:02,820 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  14543. Traceback (most recent call last):
  14544. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14545. self._serial.open()
  14546. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14547. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14548. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14549. 2020-08-04 12:19:03,058 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  14550. 2020-08-04 12:19:03,561 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  14551. 2020-08-04 12:19:03,824 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  14552. Traceback (most recent call last):
  14553. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14554. self._serial.open()
  14555. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14556. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14557. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14558. 2020-08-04 12:19:03,827 [messaging :206 ][ERROR ][616] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  14559. Traceback (most recent call last):
  14560. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  14561. self._call_hook_for(message, "workflow", message)
  14562. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14563. return True, func(*args, **kwargs)
  14564. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  14565. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14566. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14567. return True, func(*args, **kwargs)
  14568. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14569. return func(*args, **kwargs)
  14570. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  14571. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  14572. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  14573. conn.write_line(cmd)
  14574. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  14575. self.ensure_open()
  14576. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  14577. self.open()
  14578. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  14579. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  14580. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  14581. raise attempt.get()
  14582. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  14583. six.reraise(self.value[0], self.value[1], self.value[2])
  14584. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  14585. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  14586. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14587. self._serial.open()
  14588. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14589. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14590. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14591. 2020-08-04 12:19:04,064 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  14592. 2020-08-04 12:19:04,066 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  14593. 2020-08-04 12:19:04,069 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  14594. 2020-08-04 12:19:04,572 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  14595. 2020-08-04 12:19:05,075 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  14596. 2020-08-04 12:19:05,077 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  14597. 2020-08-04 12:19:05,533 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  14598. Traceback (most recent call last):
  14599. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14600. self._serial.open()
  14601. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14602. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14603. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14604. 2020-08-04 12:19:05,583 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  14605. 2020-08-04 12:19:06,086 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  14606. 2020-08-04 12:19:06,547 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  14607. Traceback (most recent call last):
  14608. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14609. self._serial.open()
  14610. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14611. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14612. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14613. 2020-08-04 12:19:06,589 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  14614. 2020-08-04 12:19:06,591 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  14615. 2020-08-04 12:19:07,095 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  14616. 2020-08-04 12:19:07,551 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  14617. Traceback (most recent call last):
  14618. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14619. self._serial.open()
  14620. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14621. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14622. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14623. 2020-08-04 12:19:07,554 [messaging :742 ][ERROR ][616] Exception while processing event: {'tag': 'ec2x/req/820c1573-0ade-4ff8-ba60-21467daddb5c', 'data': {'_stamp': '2020-08-04T12:18:43.151704', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/820c1573-0ade-4ff8-ba60-21467daddb5c', 'kwargs': {'cooldown_delay': None}}}
  14624. Traceback (most recent call last):
  14625. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  14626. res = self.process(message)
  14627. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  14628. result = func(message, **settings)
  14629. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  14630. found, result = self._call_hook_for(message, "workflow", message)
  14631. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14632. return True, func(*args, **kwargs)
  14633. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  14634. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14635. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14636. return True, func(*args, **kwargs)
  14637. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14638. return func(*args, **kwargs)
  14639. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  14640. return _exec(cmd, **kwargs)
  14641. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  14642. conn.write_line(cmd)
  14643. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  14644. self.ensure_open()
  14645. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  14646. self.open()
  14647. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  14648. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  14649. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  14650. raise attempt.get()
  14651. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  14652. six.reraise(self.value[0], self.value[1], self.value[2])
  14653. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  14654. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  14655. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14656. self._serial.open()
  14657. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14658. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14659. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14660. 2020-08-04 12:19:07,597 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  14661. 2020-08-04 12:19:08,100 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  14662. 2020-08-04 12:19:08,102 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  14663. 2020-08-04 12:19:08,105 [messaging :208 ][ERROR ][619] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  14664. Traceback (most recent call last):
  14665. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  14666. self._call_hook_for(message, "workflow", message)
  14667. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14668. return True, func(*args, **kwargs)
  14669. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  14670. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14671. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14672. return True, func(*args, **kwargs)
  14673. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14674. return func(*args, **kwargs)
  14675. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  14676. conn.heartbeat()
  14677. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  14678. self.noop()
  14679. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  14680. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  14681. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  14682. raise attempt.get()
  14683. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  14684. six.reraise(self.value[0], self.value[1], self.value[2])
  14685. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  14686. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  14687. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  14688. self._begin_message()
  14689. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  14690. self.recv(ack=ACK_MESSAGE_BEGIN)
  14691. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  14692. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  14693. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  14694. raise attempt.get()
  14695. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  14696. six.reraise(self.value[0], self.value[1], self.value[2])
  14697. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  14698. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  14699. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  14700. raise Exception(msg)
  14701. Exception: Expected ack '12' but got '255'
  14702. 2020-08-04 12:19:09,874 [messaging :208 ][ERROR ][617] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  14703. Traceback (most recent call last):
  14704. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  14705. self._call_hook_for(message, "workflow", message)
  14706. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14707. return True, func(*args, **kwargs)
  14708. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  14709. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14710. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14711. return True, func(*args, **kwargs)
  14712. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14713. return func(*args, **kwargs)
  14714. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  14715. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  14716. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  14717. res = query("AT+QGPSLOC={:d}".format(mode))
  14718. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  14719. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  14720. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  14721. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  14722. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  14723. raise salt.exceptions.CommandExecutionError(message["error"])
  14724. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14725. 2020-08-04 12:19:14,923 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  14726. Traceback (most recent call last):
  14727. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14728. self._serial.open()
  14729. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14730. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14731. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14732. 2020-08-04 12:19:15,935 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  14733. Traceback (most recent call last):
  14734. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14735. self._serial.open()
  14736. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14737. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14738. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14739. 2020-08-04 12:19:16,939 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  14740. Traceback (most recent call last):
  14741. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14742. self._serial.open()
  14743. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14744. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14745. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14746. 2020-08-04 12:19:16,942 [messaging :742 ][ERROR ][616] Exception while processing event: {'tag': 'ec2x/req/7fa7f71d-c7f4-49d6-9674-301f0b37d880', 'data': {'_stamp': '2020-08-04T12:19:14.904721', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/7fa7f71d-c7f4-49d6-9674-301f0b37d880', 'kwargs': {'cooldown_delay': None}}}
  14747. Traceback (most recent call last):
  14748. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  14749. res = self.process(message)
  14750. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  14751. result = func(message, **settings)
  14752. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  14753. found, result = self._call_hook_for(message, "workflow", message)
  14754. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14755. return True, func(*args, **kwargs)
  14756. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  14757. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14758. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14759. return True, func(*args, **kwargs)
  14760. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14761. return func(*args, **kwargs)
  14762. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  14763. return _exec(cmd, **kwargs)
  14764. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  14765. conn.write_line(cmd)
  14766. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  14767. self.ensure_open()
  14768. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  14769. self.open()
  14770. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  14771. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  14772. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  14773. raise attempt.get()
  14774. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  14775. six.reraise(self.value[0], self.value[1], self.value[2])
  14776. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  14777. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  14778. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14779. self._serial.open()
  14780. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14781. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14782. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14783. 2020-08-04 12:19:16,974 [messaging :206 ][ERROR ][617] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  14784. Traceback (most recent call last):
  14785. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  14786. self._call_hook_for(message, "workflow", message)
  14787. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14788. return True, func(*args, **kwargs)
  14789. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  14790. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14791. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14792. return True, func(*args, **kwargs)
  14793. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14794. return func(*args, **kwargs)
  14795. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  14796. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  14797. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  14798. res = query("AT+QGPSLOC={:d}".format(mode))
  14799. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  14800. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  14801. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  14802. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  14803. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  14804. raise salt.exceptions.CommandExecutionError(message["error"])
  14805. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14806. 2020-08-04 12:19:20,455 [obd.obd :107 ][ERROR ][681] Failed to use explicit port '/dev/serial0'
  14807. Traceback (most recent call last):
  14808. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  14809. self.interface.open(baudrate, protocol=protocol)
  14810. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  14811. self.set_protocol(prot.pop("id", None), **prot)
  14812. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  14813. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  14814. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  14815. self._protocol = self._auto_protocol(**kwargs)
  14816. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  14817. res_0100 = self._verify_protocol("auto", test=not verify)
  14818. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  14819. for line in self.query("0100", parse=False, read_timeout=10):
  14820. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  14821. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  14822. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  14823. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  14824. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  14825. data = self._port.read(self._port.in_waiting or 1)
  14826. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  14827. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  14828. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  14829. sys.exit(salt.defaults.exitcodes.EX_OK)
  14830. SystemExit: 0
  14831. 2020-08-04 12:19:20,480 [obd.obd :120 ][WARNING ][681] Cannot load commands - no connection to bus
  14832. 2020-08-04 12:19:20,505 [obd.interfaces.elm327:730 ][ERROR ][681] Failed to relay command 'STSLCS' to interface
  14833. Traceback (most recent call last):
  14834. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  14835. lines = self.send(cmd, raw_response=raw_response)
  14836. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  14837. raise ELM327Error(self.ERRORS[line], code=line)
  14838. ELM327Error: Operation interrupted by a received RS232 character
  14839. 2020-08-04 12:19:20,508 [messaging :742 ][ERROR ][681] Exception while processing event: {'tag': 'obd/req/08a48598-ef60-4cdf-a330-3ec6cb8ea6db', 'data': {'_stamp': '2020-08-04T12:19:14.907141', 'handler': 'execute', '_event_tag': 'obd/req/08a48598-ef60-4cdf-a330-3ec6cb8ea6db', 'args': ['STSLCS']}}
  14840. Traceback (most recent call last):
  14841. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  14842. res = self.process(message)
  14843. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  14844. result = func(message, **settings)
  14845. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  14846. found, result = self._call_hook_for(message, "workflow", message)
  14847. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14848. return True, func(*args, **kwargs)
  14849. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  14850. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14851. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14852. return True, func(*args, **kwargs)
  14853. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14854. return func(*args, **kwargs)
  14855. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  14856. res = conn.execute(cmd)
  14857. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  14858. return func(self, *args, **kwargs)
  14859. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  14860. return self._obd.execute(cmd, **kwargs)
  14861. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  14862. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  14863. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  14864. lines = self.send(cmd, raw_response=raw_response)
  14865. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  14866. raise ELM327Error(self.ERRORS[line], code=line)
  14867. ELM327Error: Operation interrupted by a received RS232 character
  14868. 2020-08-04 12:19:21,244 [salt.utils.parsers:1050][WARNING ][416] Minion received a SIGTERM. Exiting.
  14869. 2020-08-04 12:19:21,784 [messaging :871 ][WARNING ][816] No reply message with tag 'obd/res/08a48598-ef60-4cdf-a330-3ec6cb8ea6db' received within timeout of 30 secs
  14870. 2020-08-04 12:19:21,788 [salt.state :292 ][ERROR ][816] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  14871. 2020-08-04 12:19:38,230 [gpio_spi_conn :42 ][WARNING ][618] Unable to clear buffer - got unexpected value: 255
  14872. 2020-08-04 12:19:38,241 [gpio_spi_conn :42 ][WARNING ][618] Unable to clear buffer - got unexpected value: 255
  14873. 2020-08-04 12:19:38,254 [gpio_spi_conn :42 ][WARNING ][618] Unable to clear buffer - got unexpected value: 255
  14874. 2020-08-04 12:19:38,913 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  14875. Traceback (most recent call last):
  14876. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14877. self._serial.open()
  14878. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14879. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14880. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14881. 2020-08-04 12:19:39,927 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  14882. Traceback (most recent call last):
  14883. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14884. self._serial.open()
  14885. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14886. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14887. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14888. 2020-08-04 12:19:40,286 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  14889. 2020-08-04 12:19:40,789 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  14890. 2020-08-04 12:19:40,932 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  14891. Traceback (most recent call last):
  14892. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14893. self._serial.open()
  14894. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14895. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14896. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14897. 2020-08-04 12:19:41,292 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  14898. 2020-08-04 12:19:41,294 [spm_conn :139 ][WARNING ][618] Unable to get status: Expected ack '12' but got '255'
  14899. 2020-08-04 12:19:41,516 [messaging :208 ][ERROR ][615] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  14900. Traceback (most recent call last):
  14901. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  14902. self._call_hook_for(message, "workflow", message)
  14903. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14904. return True, func(*args, **kwargs)
  14905. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  14906. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14907. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14908. return True, func(*args, **kwargs)
  14909. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14910. return func(*args, **kwargs)
  14911. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  14912. res = _exec("AT+CCLK?")
  14913. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  14914. conn.write_line(cmd)
  14915. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  14916. self.ensure_open()
  14917. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  14918. self.open()
  14919. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  14920. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  14921. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  14922. raise attempt.get()
  14923. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  14924. six.reraise(self.value[0], self.value[1], self.value[2])
  14925. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  14926. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  14927. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14928. self._serial.open()
  14929. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14930. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14931. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14932. 2020-08-04 12:19:41,797 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  14933. 2020-08-04 12:19:42,303 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  14934. 2020-08-04 12:19:42,807 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  14935. 2020-08-04 12:19:42,809 [spm_conn :139 ][WARNING ][618] Unable to get status: Expected ack '12' but got '255'
  14936. 2020-08-04 12:19:43,313 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  14937. 2020-08-04 12:19:43,826 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  14938. 2020-08-04 12:19:44,329 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  14939. 2020-08-04 12:19:44,331 [spm_conn :139 ][WARNING ][618] Unable to get status: Expected ack '12' but got '255'
  14940. 2020-08-04 12:19:44,335 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  14941. 2020-08-04 12:19:44,838 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  14942. 2020-08-04 12:19:45,336 [salt.utils :831 ][ERROR ][415] DNS lookup or connection check of 'hub' failed.
  14943. 2020-08-04 12:19:45,341 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  14944. 2020-08-04 12:19:45,345 [spm_conn :82 ][WARNING ][618] Unable to send noop: Expected ack '12' but got '255'
  14945. 2020-08-04 12:19:45,655 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  14946. Traceback (most recent call last):
  14947. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14948. self._serial.open()
  14949. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14950. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14951. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14952. 2020-08-04 12:19:45,849 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  14953. 2020-08-04 12:19:46,353 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  14954. 2020-08-04 12:19:46,672 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  14955. Traceback (most recent call last):
  14956. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14957. self._serial.open()
  14958. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14959. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14960. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14961. 2020-08-04 12:19:46,856 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  14962. 2020-08-04 12:19:46,858 [spm_conn :82 ][WARNING ][618] Unable to send noop: Expected ack '12' but got '255'
  14963. 2020-08-04 12:19:46,934 [cloud_cache :432 ][WARNING ][657] Temporarily unable to upload batch with 10 entries from queue 'pend': HTTPSConnectionPool(host='api.autopi.io', port=443): Max retries exceeded with url: /logbook/storage (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x735f39b0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))
  14964. 2020-08-04 12:19:47,362 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  14965. 2020-08-04 12:19:47,677 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  14966. Traceback (most recent call last):
  14967. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  14968. self._serial.open()
  14969. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  14970. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  14971. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  14972. 2020-08-04 12:19:47,680 [messaging :742 ][ERROR ][615] Exception while processing event: {'tag': 'ec2x/req/b78c3a89-ca51-4cb9-bcb3-c6deaca8c6cd', 'data': {'_stamp': '2020-08-04T12:19:38.299622', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/b78c3a89-ca51-4cb9-bcb3-c6deaca8c6cd', 'kwargs': {'cooldown_delay': None}}}
  14973. Traceback (most recent call last):
  14974. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  14975. res = self.process(message)
  14976. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  14977. result = func(message, **settings)
  14978. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  14979. found, result = self._call_hook_for(message, "workflow", message)
  14980. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14981. return True, func(*args, **kwargs)
  14982. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  14983. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  14984. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  14985. return True, func(*args, **kwargs)
  14986. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  14987. return func(*args, **kwargs)
  14988. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  14989. return _exec(cmd, **kwargs)
  14990. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  14991. conn.write_line(cmd)
  14992. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  14993. self.ensure_open()
  14994. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  14995. self.open()
  14996. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  14997. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  14998. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  14999. raise attempt.get()
  15000. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  15001. six.reraise(self.value[0], self.value[1], self.value[2])
  15002. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  15003. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  15004. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15005. self._serial.open()
  15006. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15007. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15008. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15009. 2020-08-04 12:19:47,736 [messaging :208 ][ERROR ][616] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  15010. Traceback (most recent call last):
  15011. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  15012. self._call_hook_for(message, "workflow", message)
  15013. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15014. return True, func(*args, **kwargs)
  15015. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  15016. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15017. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15018. return True, func(*args, **kwargs)
  15019. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15020. return func(*args, **kwargs)
  15021. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  15022. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  15023. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  15024. res = query("AT+QGPSLOC={:d}".format(mode))
  15025. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  15026. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  15027. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  15028. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  15029. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  15030. raise salt.exceptions.CommandExecutionError(message["error"])
  15031. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15032. 2020-08-04 12:19:47,865 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  15033. 2020-08-04 12:19:48,318 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  15034. Traceback (most recent call last):
  15035. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15036. self._serial.open()
  15037. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15038. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15039. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15040. 2020-08-04 12:19:48,368 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  15041. 2020-08-04 12:19:48,371 [spm_conn :82 ][WARNING ][618] Unable to send noop: Expected ack '12' but got '255'
  15042. 2020-08-04 12:19:48,373 [messaging :208 ][ERROR ][618] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  15043. Traceback (most recent call last):
  15044. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  15045. self._call_hook_for(message, "workflow", message)
  15046. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15047. return True, func(*args, **kwargs)
  15048. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  15049. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15050. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15051. return True, func(*args, **kwargs)
  15052. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15053. return func(*args, **kwargs)
  15054. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  15055. conn.heartbeat()
  15056. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  15057. self.noop()
  15058. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  15059. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  15060. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  15061. raise attempt.get()
  15062. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  15063. six.reraise(self.value[0], self.value[1], self.value[2])
  15064. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  15065. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  15066. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  15067. self._begin_message()
  15068. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  15069. self.recv(ack=ACK_MESSAGE_BEGIN)
  15070. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  15071. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  15072. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  15073. raise attempt.get()
  15074. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  15075. six.reraise(self.value[0], self.value[1], self.value[2])
  15076. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  15077. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  15078. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  15079. raise Exception(msg)
  15080. Exception: Expected ack '12' but got '255'
  15081. 2020-08-04 12:19:49,325 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  15082. Traceback (most recent call last):
  15083. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15084. self._serial.open()
  15085. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15086. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15087. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15088. 2020-08-04 12:19:50,329 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  15089. Traceback (most recent call last):
  15090. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15091. self._serial.open()
  15092. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15093. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15094. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15095. 2020-08-04 12:19:50,873 [messaging :206 ][ERROR ][615] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  15096. Traceback (most recent call last):
  15097. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  15098. self._call_hook_for(message, "workflow", message)
  15099. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15100. return True, func(*args, **kwargs)
  15101. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  15102. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15103. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15104. return True, func(*args, **kwargs)
  15105. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15106. return func(*args, **kwargs)
  15107. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  15108. res = _exec("AT+CCLK?")
  15109. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  15110. conn.write_line(cmd)
  15111. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  15112. self.ensure_open()
  15113. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  15114. self.open()
  15115. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  15116. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  15117. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  15118. raise attempt.get()
  15119. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  15120. six.reraise(self.value[0], self.value[1], self.value[2])
  15121. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  15122. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  15123. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15124. self._serial.open()
  15125. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15126. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15127. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15128. 2020-08-04 12:19:52,807 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  15129. Traceback (most recent call last):
  15130. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15131. self._serial.open()
  15132. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15133. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15134. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15135. 2020-08-04 12:19:53,812 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  15136. Traceback (most recent call last):
  15137. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15138. self._serial.open()
  15139. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15140. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15141. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15142. 2020-08-04 12:19:54,816 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  15143. Traceback (most recent call last):
  15144. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15145. self._serial.open()
  15146. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15147. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15148. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15149. 2020-08-04 12:19:54,820 [messaging :742 ][ERROR ][615] Exception while processing event: {'tag': 'ec2x/req/a6f6fb2b-3b0f-4bf0-9350-61aed3fa18da', 'data': {'_stamp': '2020-08-04T12:19:52.774092', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/a6f6fb2b-3b0f-4bf0-9350-61aed3fa18da', 'kwargs': {'cooldown_delay': None}}}
  15150. Traceback (most recent call last):
  15151. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  15152. res = self.process(message)
  15153. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  15154. result = func(message, **settings)
  15155. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  15156. found, result = self._call_hook_for(message, "workflow", message)
  15157. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15158. return True, func(*args, **kwargs)
  15159. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  15160. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15161. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15162. return True, func(*args, **kwargs)
  15163. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15164. return func(*args, **kwargs)
  15165. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  15166. return _exec(cmd, **kwargs)
  15167. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  15168. conn.write_line(cmd)
  15169. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  15170. self.ensure_open()
  15171. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  15172. self.open()
  15173. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  15174. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  15175. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  15176. raise attempt.get()
  15177. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  15178. six.reraise(self.value[0], self.value[1], self.value[2])
  15179. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  15180. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  15181. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15182. self._serial.open()
  15183. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15184. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15185. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15186. 2020-08-04 12:19:54,857 [messaging :206 ][ERROR ][616] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  15187. Traceback (most recent call last):
  15188. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  15189. self._call_hook_for(message, "workflow", message)
  15190. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15191. return True, func(*args, **kwargs)
  15192. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  15193. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15194. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15195. return True, func(*args, **kwargs)
  15196. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15197. return func(*args, **kwargs)
  15198. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  15199. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  15200. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  15201. res = query("AT+QGPSLOC={:d}".format(mode))
  15202. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  15203. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  15204. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  15205. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  15206. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  15207. raise salt.exceptions.CommandExecutionError(message["error"])
  15208. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15209. 2020-08-04 12:19:56,445 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  15210. Traceback (most recent call last):
  15211. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15212. self._serial.open()
  15213. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15214. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15215. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15216. 2020-08-04 12:19:57,450 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  15217. Traceback (most recent call last):
  15218. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15219. self._serial.open()
  15220. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15221. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15222. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15223. 2020-08-04 12:19:58,454 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  15224. Traceback (most recent call last):
  15225. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15226. self._serial.open()
  15227. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15228. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15229. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15230. 2020-08-04 12:19:58,959 [messaging :206 ][ERROR ][615] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  15231. Traceback (most recent call last):
  15232. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  15233. self._call_hook_for(message, "workflow", message)
  15234. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15235. return True, func(*args, **kwargs)
  15236. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  15237. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15238. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15239. return True, func(*args, **kwargs)
  15240. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15241. return func(*args, **kwargs)
  15242. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  15243. res = _exec("AT+CCLK?")
  15244. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  15245. conn.write_line(cmd)
  15246. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  15247. self.ensure_open()
  15248. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  15249. self.open()
  15250. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  15251. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  15252. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  15253. raise attempt.get()
  15254. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  15255. six.reraise(self.value[0], self.value[1], self.value[2])
  15256. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  15257. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  15258. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15259. self._serial.open()
  15260. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15261. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15262. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15263. 2020-08-04 12:20:14,435 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][655] Timeout after 1.28205128205 second(s) waiting for interrupt
  15264. 2020-08-04 12:20:14,470 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  15265. Traceback (most recent call last):
  15266. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15267. self._serial.open()
  15268. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15269. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15270. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15271. 2020-08-04 12:20:15,476 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  15272. Traceback (most recent call last):
  15273. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15274. self._serial.open()
  15275. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15276. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15277. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15278. 2020-08-04 12:20:16,480 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  15279. Traceback (most recent call last):
  15280. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15281. self._serial.open()
  15282. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15283. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15284. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15285. 2020-08-04 12:20:16,484 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  15286. Traceback (most recent call last):
  15287. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15288. self._serial.open()
  15289. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15290. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15291. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15292. 2020-08-04 12:20:17,490 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  15293. Traceback (most recent call last):
  15294. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15295. self._serial.open()
  15296. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15297. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15298. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15299. 2020-08-04 12:20:18,494 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  15300. Traceback (most recent call last):
  15301. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15302. self._serial.open()
  15303. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15304. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15305. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15306. 2020-08-04 12:20:18,497 [messaging :742 ][ERROR ][615] Exception while processing event: {'tag': 'ec2x/req/62312056-d21b-40e1-814c-4579365c0f68', 'data': {'_stamp': '2020-08-04T12:20:14.421766', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/62312056-d21b-40e1-814c-4579365c0f68', 'kwargs': {'cooldown_delay': None}}}
  15307. Traceback (most recent call last):
  15308. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  15309. res = self.process(message)
  15310. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  15311. result = func(message, **settings)
  15312. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  15313. found, result = self._call_hook_for(message, "workflow", message)
  15314. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15315. return True, func(*args, **kwargs)
  15316. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  15317. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15318. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15319. return True, func(*args, **kwargs)
  15320. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15321. return func(*args, **kwargs)
  15322. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  15323. return _exec(cmd, **kwargs)
  15324. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  15325. conn.write_line(cmd)
  15326. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  15327. self.ensure_open()
  15328. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  15329. self.open()
  15330. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  15331. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  15332. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  15333. raise attempt.get()
  15334. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  15335. six.reraise(self.value[0], self.value[1], self.value[2])
  15336. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  15337. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  15338. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15339. self._serial.open()
  15340. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15341. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15342. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15343. 2020-08-04 12:20:21,614 [messaging :206 ][ERROR ][616] Recurring exception (3 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  15344. Traceback (most recent call last):
  15345. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  15346. self._call_hook_for(message, "workflow", message)
  15347. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15348. return True, func(*args, **kwargs)
  15349. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  15350. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15351. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15352. return True, func(*args, **kwargs)
  15353. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15354. return func(*args, **kwargs)
  15355. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  15356. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  15357. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  15358. res = query("AT+QGPSLOC={:d}".format(mode))
  15359. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  15360. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  15361. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  15362. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  15363. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  15364. raise salt.exceptions.CommandExecutionError(message["error"])
  15365. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15366. 2020-08-04 12:20:26,643 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  15367. Traceback (most recent call last):
  15368. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15369. self._serial.open()
  15370. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15371. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15372. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15373. 2020-08-04 12:20:27,654 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  15374. Traceback (most recent call last):
  15375. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15376. self._serial.open()
  15377. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15378. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15379. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15380. 2020-08-04 12:20:28,659 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  15381. Traceback (most recent call last):
  15382. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15383. self._serial.open()
  15384. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15385. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15386. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15387. 2020-08-04 12:20:28,662 [messaging :742 ][ERROR ][615] Exception while processing event: {'tag': 'ec2x/req/b6555d19-81b9-4321-8975-48b866605245', 'data': {'_stamp': '2020-08-04T12:20:26.627582', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/b6555d19-81b9-4321-8975-48b866605245', 'kwargs': {'cooldown_delay': None}}}
  15388. Traceback (most recent call last):
  15389. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  15390. res = self.process(message)
  15391. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  15392. result = func(message, **settings)
  15393. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  15394. found, result = self._call_hook_for(message, "workflow", message)
  15395. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15396. return True, func(*args, **kwargs)
  15397. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  15398. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15399. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15400. return True, func(*args, **kwargs)
  15401. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15402. return func(*args, **kwargs)
  15403. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  15404. return _exec(cmd, **kwargs)
  15405. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  15406. conn.write_line(cmd)
  15407. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  15408. self.ensure_open()
  15409. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  15410. self.open()
  15411. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  15412. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  15413. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  15414. raise attempt.get()
  15415. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  15416. six.reraise(self.value[0], self.value[1], self.value[2])
  15417. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  15418. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  15419. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15420. self._serial.open()
  15421. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15422. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15423. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15424. 2020-08-04 12:20:32,230 [obd.obd :107 ][ERROR ][654] Failed to use explicit port '/dev/serial0'
  15425. Traceback (most recent call last):
  15426. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  15427. self.interface.open(baudrate, protocol=protocol)
  15428. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  15429. self.set_protocol(prot.pop("id", None), **prot)
  15430. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  15431. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  15432. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  15433. self._protocol = self._auto_protocol(**kwargs)
  15434. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  15435. res_0100 = self._verify_protocol("auto", test=not verify)
  15436. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  15437. for line in self.query("0100", parse=False, read_timeout=10):
  15438. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  15439. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  15440. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  15441. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  15442. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  15443. data = self._port.read(self._port.in_waiting or 1)
  15444. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  15445. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  15446. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  15447. sys.exit(salt.defaults.exitcodes.EX_OK)
  15448. SystemExit: 0
  15449. 2020-08-04 12:20:32,279 [obd.obd :120 ][WARNING ][654] Cannot load commands - no connection to bus
  15450. 2020-08-04 12:20:32,306 [obd.interfaces.elm327:730 ][ERROR ][654] Failed to relay command 'STSLCS' to interface
  15451. Traceback (most recent call last):
  15452. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  15453. lines = self.send(cmd, raw_response=raw_response)
  15454. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  15455. raise ELM327Error(self.ERRORS[line], code=line)
  15456. ELM327Error: Operation interrupted by a received RS232 character
  15457. 2020-08-04 12:20:32,310 [messaging :742 ][ERROR ][654] Exception while processing event: {'tag': 'obd/req/a01979a8-8d37-4b14-abac-712b9d146ab7', 'data': {'_stamp': '2020-08-04T12:20:26.669371', 'handler': 'execute', '_event_tag': 'obd/req/a01979a8-8d37-4b14-abac-712b9d146ab7', 'args': ['STSLCS']}}
  15458. Traceback (most recent call last):
  15459. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  15460. res = self.process(message)
  15461. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  15462. result = func(message, **settings)
  15463. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  15464. found, result = self._call_hook_for(message, "workflow", message)
  15465. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15466. return True, func(*args, **kwargs)
  15467. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  15468. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15469. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15470. return True, func(*args, **kwargs)
  15471. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15472. return func(*args, **kwargs)
  15473. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  15474. res = conn.execute(cmd)
  15475. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  15476. return func(self, *args, **kwargs)
  15477. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  15478. return self._obd.execute(cmd, **kwargs)
  15479. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  15480. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  15481. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  15482. lines = self.send(cmd, raw_response=raw_response)
  15483. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  15484. raise ELM327Error(self.ERRORS[line], code=line)
  15485. ELM327Error: Operation interrupted by a received RS232 character
  15486. 2020-08-04 12:20:33,105 [salt.utils.parsers:1050][WARNING ][415] Minion received a SIGTERM. Exiting.
  15487. 2020-08-04 12:20:33,646 [messaging :871 ][WARNING ][872] No reply message with tag 'obd/res/a01979a8-8d37-4b14-abac-712b9d146ab7' received within timeout of 30 secs
  15488. 2020-08-04 12:20:33,649 [salt.state :292 ][ERROR ][872] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  15489. 2020-08-04 12:20:50,810 [gpio_spi_conn :42 ][WARNING ][643] Unable to clear buffer - got unexpected value: 255
  15490. 2020-08-04 12:20:50,819 [gpio_spi_conn :42 ][WARNING ][643] Unable to clear buffer - got unexpected value: 255
  15491. 2020-08-04 12:20:50,822 [gpio_spi_conn :42 ][WARNING ][643] Unable to clear buffer - got unexpected value: 255
  15492. 2020-08-04 12:20:51,462 [serial_conn :79 ][ERROR ][640] Failed to open serial connection
  15493. Traceback (most recent call last):
  15494. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15495. self._serial.open()
  15496. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15497. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15498. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15499. 2020-08-04 12:20:52,475 [serial_conn :79 ][ERROR ][640] Failed to open serial connection
  15500. Traceback (most recent call last):
  15501. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15502. self._serial.open()
  15503. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15504. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15505. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15506. 2020-08-04 12:20:52,843 [gpio_spi_conn :109 ][WARNING ][643] Expected ack '12' but got '255'
  15507. 2020-08-04 12:20:53,346 [gpio_spi_conn :109 ][WARNING ][643] Expected ack '12' but got '255'
  15508. 2020-08-04 12:20:53,479 [serial_conn :79 ][ERROR ][640] Failed to open serial connection
  15509. Traceback (most recent call last):
  15510. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15511. self._serial.open()
  15512. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15513. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15514. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15515. 2020-08-04 12:20:53,849 [gpio_spi_conn :109 ][WARNING ][643] Expected ack '12' but got '255'
  15516. 2020-08-04 12:20:53,851 [spm_conn :139 ][WARNING ][643] Unable to get status: Expected ack '12' but got '255'
  15517. 2020-08-04 12:20:54,070 [messaging :208 ][ERROR ][640] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  15518. Traceback (most recent call last):
  15519. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  15520. self._call_hook_for(message, "workflow", message)
  15521. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15522. return True, func(*args, **kwargs)
  15523. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  15524. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15525. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15526. return True, func(*args, **kwargs)
  15527. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15528. return func(*args, **kwargs)
  15529. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  15530. res = _exec("AT+CCLK?")
  15531. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  15532. conn.write_line(cmd)
  15533. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  15534. self.ensure_open()
  15535. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  15536. self.open()
  15537. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  15538. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  15539. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  15540. raise attempt.get()
  15541. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  15542. six.reraise(self.value[0], self.value[1], self.value[2])
  15543. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  15544. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  15545. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15546. self._serial.open()
  15547. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15548. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15549. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15550. 2020-08-04 12:20:54,354 [gpio_spi_conn :109 ][WARNING ][643] Expected ack '12' but got '255'
  15551. 2020-08-04 12:21:10,137 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][730] Timeout after 1.28205128205 second(s) waiting for interrupt
  15552. 2020-08-04 12:21:10,220 [serial_conn :79 ][ERROR ][640] Failed to open serial connection
  15553. Traceback (most recent call last):
  15554. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15555. self._serial.open()
  15556. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15557. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15558. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15559. 2020-08-04 12:21:10,555 [gpio_spi_conn :109 ][WARNING ][643] Expected ack '12' but got '255'
  15560. 2020-08-04 12:21:11,058 [gpio_spi_conn :109 ][WARNING ][643] Expected ack '12' but got '255'
  15561. 2020-08-04 12:21:11,063 [spm_conn :139 ][WARNING ][643] Unable to get status: Expected ack '12' but got '255'
  15562. 2020-08-04 12:21:11,226 [serial_conn :79 ][ERROR ][640] Failed to open serial connection
  15563. Traceback (most recent call last):
  15564. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15565. self._serial.open()
  15566. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15567. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15568. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15569. 2020-08-04 12:21:11,569 [gpio_spi_conn :109 ][WARNING ][643] Expected ack '12' but got '255'
  15570. 2020-08-04 12:21:12,073 [gpio_spi_conn :109 ][WARNING ][643] Expected ack '12' but got '255'
  15571. 2020-08-04 12:21:12,230 [serial_conn :79 ][ERROR ][640] Failed to open serial connection
  15572. Traceback (most recent call last):
  15573. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15574. self._serial.open()
  15575. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15576. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15577. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15578. 2020-08-04 12:21:12,234 [messaging :206 ][ERROR ][640] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  15579. Traceback (most recent call last):
  15580. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  15581. self._call_hook_for(message, "workflow", message)
  15582. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15583. return True, func(*args, **kwargs)
  15584. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  15585. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15586. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15587. return True, func(*args, **kwargs)
  15588. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15589. return func(*args, **kwargs)
  15590. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  15591. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  15592. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  15593. conn.write_line(cmd)
  15594. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  15595. self.ensure_open()
  15596. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  15597. self.open()
  15598. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  15599. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  15600. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  15601. raise attempt.get()
  15602. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  15603. six.reraise(self.value[0], self.value[1], self.value[2])
  15604. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  15605. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  15606. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15607. self._serial.open()
  15608. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15609. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15610. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15611. 2020-08-04 12:21:12,577 [gpio_spi_conn :109 ][WARNING ][643] Expected ack '12' but got '255'
  15612. 2020-08-04 12:21:12,580 [spm_conn :139 ][WARNING ][643] Unable to get status: Expected ack '12' but got '255'
  15613. 2020-08-04 12:21:12,584 [gpio_spi_conn :109 ][WARNING ][643] Expected ack '12' but got '255'
  15614. 2020-08-04 12:21:13,087 [gpio_spi_conn :109 ][WARNING ][643] Expected ack '12' but got '255'
  15615. 2020-08-04 12:21:13,591 [gpio_spi_conn :109 ][WARNING ][643] Expected ack '12' but got '255'
  15616. 2020-08-04 12:21:13,593 [spm_conn :82 ][WARNING ][643] Unable to send noop: Expected ack '12' but got '255'
  15617. 2020-08-04 12:21:14,056 [serial_conn :79 ][ERROR ][640] Failed to open serial connection
  15618. Traceback (most recent call last):
  15619. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15620. self._serial.open()
  15621. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15622. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15623. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15624. 2020-08-04 12:21:14,099 [gpio_spi_conn :109 ][WARNING ][643] Expected ack '12' but got '255'
  15625. 2020-08-04 12:21:14,603 [gpio_spi_conn :109 ][WARNING ][643] Expected ack '12' but got '255'
  15626. 2020-08-04 12:21:15,078 [serial_conn :79 ][ERROR ][640] Failed to open serial connection
  15627. Traceback (most recent call last):
  15628. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15629. self._serial.open()
  15630. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15631. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15632. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15633. 2020-08-04 12:21:15,107 [gpio_spi_conn :109 ][WARNING ][643] Expected ack '12' but got '255'
  15634. 2020-08-04 12:21:15,110 [spm_conn :82 ][WARNING ][643] Unable to send noop: Expected ack '12' but got '255'
  15635. 2020-08-04 12:21:15,613 [gpio_spi_conn :109 ][WARNING ][643] Expected ack '12' but got '255'
  15636. 2020-08-04 12:21:16,082 [serial_conn :79 ][ERROR ][640] Failed to open serial connection
  15637. Traceback (most recent call last):
  15638. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15639. self._serial.open()
  15640. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15641. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15642. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15643. 2020-08-04 12:21:16,086 [messaging :742 ][ERROR ][640] Exception while processing event: {'tag': 'ec2x/req/b1b8108d-3784-4429-a9a3-f9e177af7f5e', 'data': {'_stamp': '2020-08-04T12:20:50.878550', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/b1b8108d-3784-4429-a9a3-f9e177af7f5e', 'kwargs': {'cooldown_delay': None}}}
  15644. Traceback (most recent call last):
  15645. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  15646. res = self.process(message)
  15647. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  15648. result = func(message, **settings)
  15649. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  15650. found, result = self._call_hook_for(message, "workflow", message)
  15651. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15652. return True, func(*args, **kwargs)
  15653. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  15654. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15655. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15656. return True, func(*args, **kwargs)
  15657. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15658. return func(*args, **kwargs)
  15659. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  15660. return _exec(cmd, **kwargs)
  15661. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  15662. conn.write_line(cmd)
  15663. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  15664. self.ensure_open()
  15665. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  15666. self.open()
  15667. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  15668. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  15669. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  15670. raise attempt.get()
  15671. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  15672. six.reraise(self.value[0], self.value[1], self.value[2])
  15673. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  15674. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  15675. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15676. self._serial.open()
  15677. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15678. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15679. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15680. 2020-08-04 12:21:16,119 [gpio_spi_conn :109 ][WARNING ][643] Expected ack '12' but got '255'
  15681. 2020-08-04 12:21:16,622 [gpio_spi_conn :109 ][WARNING ][643] Expected ack '12' but got '255'
  15682. 2020-08-04 12:21:16,625 [spm_conn :82 ][WARNING ][643] Unable to send noop: Expected ack '12' but got '255'
  15683. 2020-08-04 12:21:16,628 [messaging :208 ][ERROR ][643] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  15684. Traceback (most recent call last):
  15685. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  15686. self._call_hook_for(message, "workflow", message)
  15687. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15688. return True, func(*args, **kwargs)
  15689. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  15690. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15691. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15692. return True, func(*args, **kwargs)
  15693. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15694. return func(*args, **kwargs)
  15695. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  15696. conn.heartbeat()
  15697. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  15698. self.noop()
  15699. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  15700. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  15701. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  15702. raise attempt.get()
  15703. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  15704. six.reraise(self.value[0], self.value[1], self.value[2])
  15705. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  15706. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  15707. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  15708. self._begin_message()
  15709. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  15710. self.recv(ack=ACK_MESSAGE_BEGIN)
  15711. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  15712. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  15713. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  15714. raise attempt.get()
  15715. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  15716. six.reraise(self.value[0], self.value[1], self.value[2])
  15717. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  15718. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  15719. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  15720. raise Exception(msg)
  15721. Exception: Expected ack '12' but got '255'
  15722. 2020-08-04 12:21:18,171 [messaging :208 ][ERROR ][641] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  15723. Traceback (most recent call last):
  15724. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  15725. self._call_hook_for(message, "workflow", message)
  15726. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15727. return True, func(*args, **kwargs)
  15728. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  15729. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15730. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15731. return True, func(*args, **kwargs)
  15732. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15733. return func(*args, **kwargs)
  15734. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  15735. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  15736. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  15737. res = query("AT+QGPSLOC={:d}".format(mode))
  15738. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  15739. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  15740. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  15741. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  15742. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  15743. raise salt.exceptions.CommandExecutionError(message["error"])
  15744. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15745. 2020-08-04 12:21:23,207 [serial_conn :79 ][ERROR ][640] Failed to open serial connection
  15746. Traceback (most recent call last):
  15747. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15748. self._serial.open()
  15749. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15750. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15751. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15752. 2020-08-04 12:21:24,211 [serial_conn :79 ][ERROR ][640] Failed to open serial connection
  15753. Traceback (most recent call last):
  15754. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15755. self._serial.open()
  15756. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15757. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15758. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15759. 2020-08-04 12:21:25,215 [serial_conn :79 ][ERROR ][640] Failed to open serial connection
  15760. Traceback (most recent call last):
  15761. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15762. self._serial.open()
  15763. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15764. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15765. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15766. 2020-08-04 12:21:25,219 [messaging :742 ][ERROR ][640] Exception while processing event: {'tag': 'ec2x/req/77759a2f-c715-4092-bcec-3ca66409301d', 'data': {'_stamp': '2020-08-04T12:21:23.200444', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/77759a2f-c715-4092-bcec-3ca66409301d', 'kwargs': {'cooldown_delay': None}}}
  15767. Traceback (most recent call last):
  15768. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  15769. res = self.process(message)
  15770. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  15771. result = func(message, **settings)
  15772. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  15773. found, result = self._call_hook_for(message, "workflow", message)
  15774. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15775. return True, func(*args, **kwargs)
  15776. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  15777. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15778. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15779. return True, func(*args, **kwargs)
  15780. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15781. return func(*args, **kwargs)
  15782. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  15783. return _exec(cmd, **kwargs)
  15784. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  15785. conn.write_line(cmd)
  15786. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  15787. self.ensure_open()
  15788. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  15789. self.open()
  15790. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  15791. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  15792. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  15793. raise attempt.get()
  15794. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  15795. six.reraise(self.value[0], self.value[1], self.value[2])
  15796. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  15797. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  15798. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15799. self._serial.open()
  15800. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15801. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15802. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15803. 2020-08-04 12:21:25,236 [messaging :206 ][ERROR ][641] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  15804. Traceback (most recent call last):
  15805. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  15806. self._call_hook_for(message, "workflow", message)
  15807. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15808. return True, func(*args, **kwargs)
  15809. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  15810. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15811. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15812. return True, func(*args, **kwargs)
  15813. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15814. return func(*args, **kwargs)
  15815. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  15816. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  15817. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  15818. res = query("AT+QGPSLOC={:d}".format(mode))
  15819. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  15820. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  15821. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  15822. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  15823. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  15824. raise salt.exceptions.CommandExecutionError(message["error"])
  15825. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15826. 2020-08-04 12:21:28,627 [obd.obd :107 ][ERROR ][722] Failed to use explicit port '/dev/serial0'
  15827. Traceback (most recent call last):
  15828. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  15829. self.interface.open(baudrate, protocol=protocol)
  15830. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  15831. self.set_protocol(prot.pop("id", None), **prot)
  15832. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  15833. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  15834. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  15835. self._protocol = self._auto_protocol(**kwargs)
  15836. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  15837. res_0100 = self._verify_protocol("auto", test=not verify)
  15838. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  15839. for line in self.query("0100", parse=False, read_timeout=10):
  15840. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  15841. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  15842. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  15843. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  15844. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  15845. data = self._port.read(self._port.in_waiting or 1)
  15846. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  15847. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  15848. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  15849. sys.exit(salt.defaults.exitcodes.EX_OK)
  15850. SystemExit: 0
  15851. 2020-08-04 12:21:28,654 [obd.obd :120 ][WARNING ][722] Cannot load commands - no connection to bus
  15852. 2020-08-04 12:21:28,685 [obd.interfaces.elm327:730 ][ERROR ][722] Failed to relay command 'STSLCS' to interface
  15853. Traceback (most recent call last):
  15854. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  15855. lines = self.send(cmd, raw_response=raw_response)
  15856. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  15857. raise ELM327Error(self.ERRORS[line], code=line)
  15858. ELM327Error: Operation interrupted by a received RS232 character
  15859. 2020-08-04 12:21:28,689 [messaging :742 ][ERROR ][722] Exception while processing event: {'tag': 'obd/req/489e5e83-fa33-4a09-bd28-516e5e71f5e2', 'data': {'_stamp': '2020-08-04T12:21:23.105726', 'handler': 'execute', '_event_tag': 'obd/req/489e5e83-fa33-4a09-bd28-516e5e71f5e2', 'args': ['STSLCS']}}
  15860. Traceback (most recent call last):
  15861. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  15862. res = self.process(message)
  15863. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  15864. result = func(message, **settings)
  15865. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  15866. found, result = self._call_hook_for(message, "workflow", message)
  15867. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15868. return True, func(*args, **kwargs)
  15869. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  15870. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15871. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15872. return True, func(*args, **kwargs)
  15873. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15874. return func(*args, **kwargs)
  15875. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  15876. res = conn.execute(cmd)
  15877. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  15878. return func(self, *args, **kwargs)
  15879. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  15880. return self._obd.execute(cmd, **kwargs)
  15881. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  15882. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  15883. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  15884. lines = self.send(cmd, raw_response=raw_response)
  15885. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  15886. raise ELM327Error(self.ERRORS[line], code=line)
  15887. ELM327Error: Operation interrupted by a received RS232 character
  15888. 2020-08-04 12:21:29,408 [salt.utils.parsers:1050][WARNING ][441] Minion received a SIGTERM. Exiting.
  15889. 2020-08-04 12:21:29,949 [messaging :871 ][WARNING ][840] No reply message with tag 'obd/res/489e5e83-fa33-4a09-bd28-516e5e71f5e2' received within timeout of 30 secs
  15890. 2020-08-04 12:21:29,953 [salt.state :292 ][ERROR ][840] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  15891. 2020-08-04 12:21:46,931 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  15892. 2020-08-04 12:21:46,941 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  15893. 2020-08-04 12:21:46,946 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  15894. 2020-08-04 12:21:47,644 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  15895. Traceback (most recent call last):
  15896. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15897. self._serial.open()
  15898. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15899. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15900. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15901. 2020-08-04 12:21:48,656 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  15902. Traceback (most recent call last):
  15903. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15904. self._serial.open()
  15905. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15906. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15907. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15908. 2020-08-04 12:21:48,983 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  15909. 2020-08-04 12:21:49,488 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  15910. 2020-08-04 12:21:49,660 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  15911. Traceback (most recent call last):
  15912. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15913. self._serial.open()
  15914. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15915. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15916. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15917. 2020-08-04 12:21:49,993 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  15918. 2020-08-04 12:21:49,995 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  15919. 2020-08-04 12:21:50,214 [messaging :208 ][ERROR ][616] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  15920. Traceback (most recent call last):
  15921. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  15922. self._call_hook_for(message, "workflow", message)
  15923. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15924. return True, func(*args, **kwargs)
  15925. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  15926. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  15927. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15928. return True, func(*args, **kwargs)
  15929. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  15930. return func(*args, **kwargs)
  15931. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  15932. res = _exec("AT+CCLK?")
  15933. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  15934. conn.write_line(cmd)
  15935. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  15936. self.ensure_open()
  15937. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  15938. self.open()
  15939. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  15940. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  15941. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  15942. raise attempt.get()
  15943. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  15944. six.reraise(self.value[0], self.value[1], self.value[2])
  15945. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  15946. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  15947. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15948. self._serial.open()
  15949. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15950. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15951. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15952. 2020-08-04 12:21:50,505 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  15953. 2020-08-04 12:21:51,008 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  15954. 2020-08-04 12:21:51,510 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  15955. 2020-08-04 12:21:51,513 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  15956. 2020-08-04 12:21:52,017 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  15957. 2020-08-04 12:21:52,529 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  15958. 2020-08-04 12:21:53,033 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  15959. 2020-08-04 12:21:53,036 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  15960. 2020-08-04 12:21:53,039 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  15961. 2020-08-04 12:21:53,543 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  15962. 2020-08-04 12:21:54,046 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  15963. 2020-08-04 12:21:54,049 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  15964. 2020-08-04 12:21:54,386 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  15965. Traceback (most recent call last):
  15966. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15967. self._serial.open()
  15968. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15969. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15970. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15971. 2020-08-04 12:21:54,554 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  15972. 2020-08-04 12:21:55,057 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  15973. 2020-08-04 12:21:55,390 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  15974. Traceback (most recent call last):
  15975. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15976. self._serial.open()
  15977. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15978. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15979. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15980. 2020-08-04 12:21:55,560 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  15981. 2020-08-04 12:21:55,563 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  15982. 2020-08-04 12:21:56,067 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  15983. 2020-08-04 12:21:56,394 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  15984. Traceback (most recent call last):
  15985. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  15986. self._serial.open()
  15987. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  15988. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  15989. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  15990. 2020-08-04 12:21:56,397 [messaging :742 ][ERROR ][616] Exception while processing event: {'tag': 'ec2x/req/79fdbad8-6ebe-4e76-9d96-720670f73a81', 'data': {'_stamp': '2020-08-04T12:21:47.018377', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/79fdbad8-6ebe-4e76-9d96-720670f73a81', 'kwargs': {'cooldown_delay': None}}}
  15991. Traceback (most recent call last):
  15992. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  15993. res = self.process(message)
  15994. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  15995. result = func(message, **settings)
  15996. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  15997. found, result = self._call_hook_for(message, "workflow", message)
  15998. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  15999. return True, func(*args, **kwargs)
  16000. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  16001. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16002. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16003. return True, func(*args, **kwargs)
  16004. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16005. return func(*args, **kwargs)
  16006. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  16007. return _exec(cmd, **kwargs)
  16008. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  16009. conn.write_line(cmd)
  16010. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  16011. self.ensure_open()
  16012. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  16013. self.open()
  16014. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  16015. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  16016. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  16017. raise attempt.get()
  16018. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  16019. six.reraise(self.value[0], self.value[1], self.value[2])
  16020. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  16021. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  16022. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16023. self._serial.open()
  16024. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16025. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16026. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16027. 2020-08-04 12:21:56,570 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  16028. 2020-08-04 12:21:57,026 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  16029. Traceback (most recent call last):
  16030. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16031. self._serial.open()
  16032. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16033. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16034. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16035. 2020-08-04 12:21:57,074 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  16036. 2020-08-04 12:21:57,076 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  16037. 2020-08-04 12:21:57,079 [messaging :208 ][ERROR ][619] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  16038. Traceback (most recent call last):
  16039. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  16040. self._call_hook_for(message, "workflow", message)
  16041. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16042. return True, func(*args, **kwargs)
  16043. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  16044. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16045. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16046. return True, func(*args, **kwargs)
  16047. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16048. return func(*args, **kwargs)
  16049. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  16050. conn.heartbeat()
  16051. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  16052. self.noop()
  16053. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  16054. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  16055. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  16056. raise attempt.get()
  16057. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  16058. six.reraise(self.value[0], self.value[1], self.value[2])
  16059. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  16060. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  16061. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  16062. self._begin_message()
  16063. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  16064. self.recv(ack=ACK_MESSAGE_BEGIN)
  16065. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  16066. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  16067. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  16068. raise attempt.get()
  16069. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  16070. six.reraise(self.value[0], self.value[1], self.value[2])
  16071. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  16072. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  16073. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  16074. raise Exception(msg)
  16075. Exception: Expected ack '12' but got '255'
  16076. 2020-08-04 12:21:58,033 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  16077. Traceback (most recent call last):
  16078. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16079. self._serial.open()
  16080. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16081. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16082. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16083. 2020-08-04 12:21:58,700 [messaging :208 ][ERROR ][617] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  16084. Traceback (most recent call last):
  16085. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  16086. self._call_hook_for(message, "workflow", message)
  16087. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16088. return True, func(*args, **kwargs)
  16089. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  16090. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16091. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16092. return True, func(*args, **kwargs)
  16093. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16094. return func(*args, **kwargs)
  16095. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  16096. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  16097. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  16098. res = query("AT+QGPSLOC={:d}".format(mode))
  16099. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  16100. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  16101. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  16102. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  16103. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  16104. raise salt.exceptions.CommandExecutionError(message["error"])
  16105. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16106. 2020-08-04 12:21:59,049 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  16107. Traceback (most recent call last):
  16108. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16109. self._serial.open()
  16110. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16111. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16112. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16113. 2020-08-04 12:21:59,551 [messaging :206 ][ERROR ][616] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  16114. Traceback (most recent call last):
  16115. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  16116. self._call_hook_for(message, "workflow", message)
  16117. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16118. return True, func(*args, **kwargs)
  16119. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  16120. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16121. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16122. return True, func(*args, **kwargs)
  16123. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16124. return func(*args, **kwargs)
  16125. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  16126. res = _exec("AT+CCLK?")
  16127. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  16128. conn.write_line(cmd)
  16129. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  16130. self.ensure_open()
  16131. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  16132. self.open()
  16133. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  16134. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  16135. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  16136. raise attempt.get()
  16137. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  16138. six.reraise(self.value[0], self.value[1], self.value[2])
  16139. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  16140. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  16141. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16142. self._serial.open()
  16143. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16144. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16145. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16146. 2020-08-04 12:22:14,218 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][656] Timeout after 1.28205128205 second(s) waiting for interrupt
  16147. 2020-08-04 12:22:14,287 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  16148. Traceback (most recent call last):
  16149. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16150. self._serial.open()
  16151. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16152. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16153. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16154. 2020-08-04 12:22:15,292 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  16155. Traceback (most recent call last):
  16156. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16157. self._serial.open()
  16158. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16159. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16160. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16161. 2020-08-04 12:22:16,307 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  16162. Traceback (most recent call last):
  16163. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16164. self._serial.open()
  16165. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16166. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16167. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16168. 2020-08-04 12:22:16,311 [messaging :206 ][ERROR ][616] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  16169. Traceback (most recent call last):
  16170. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  16171. self._call_hook_for(message, "workflow", message)
  16172. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16173. return True, func(*args, **kwargs)
  16174. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  16175. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16176. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16177. return True, func(*args, **kwargs)
  16178. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16179. return func(*args, **kwargs)
  16180. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  16181. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  16182. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  16183. conn.write_line(cmd)
  16184. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  16185. self.ensure_open()
  16186. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  16187. self.open()
  16188. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  16189. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  16190. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  16191. raise attempt.get()
  16192. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  16193. six.reraise(self.value[0], self.value[1], self.value[2])
  16194. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  16195. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  16196. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16197. self._serial.open()
  16198. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16199. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16200. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16201. 2020-08-04 12:22:16,313 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  16202. Traceback (most recent call last):
  16203. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16204. self._serial.open()
  16205. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16206. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16207. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16208. 2020-08-04 12:22:17,322 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  16209. Traceback (most recent call last):
  16210. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16211. self._serial.open()
  16212. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16213. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16214. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16215. 2020-08-04 12:22:18,326 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  16216. Traceback (most recent call last):
  16217. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16218. self._serial.open()
  16219. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16220. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16221. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16222. 2020-08-04 12:22:18,330 [messaging :742 ][ERROR ][616] Exception while processing event: {'tag': 'ec2x/req/e0b2b8e7-d73a-4281-9c4c-ed8f54ead256', 'data': {'_stamp': '2020-08-04T12:22:14.224158', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/e0b2b8e7-d73a-4281-9c4c-ed8f54ead256', 'kwargs': {'cooldown_delay': None}}}
  16223. Traceback (most recent call last):
  16224. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  16225. res = self.process(message)
  16226. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  16227. result = func(message, **settings)
  16228. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  16229. found, result = self._call_hook_for(message, "workflow", message)
  16230. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16231. return True, func(*args, **kwargs)
  16232. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  16233. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16234. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16235. return True, func(*args, **kwargs)
  16236. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16237. return func(*args, **kwargs)
  16238. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  16239. return _exec(cmd, **kwargs)
  16240. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  16241. conn.write_line(cmd)
  16242. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  16243. self.ensure_open()
  16244. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  16245. self.open()
  16246. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  16247. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  16248. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  16249. raise attempt.get()
  16250. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  16251. six.reraise(self.value[0], self.value[1], self.value[2])
  16252. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  16253. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  16254. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16255. self._serial.open()
  16256. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16257. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16258. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16259. 2020-08-04 12:22:18,378 [messaging :206 ][ERROR ][617] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  16260. Traceback (most recent call last):
  16261. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  16262. self._call_hook_for(message, "workflow", message)
  16263. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16264. return True, func(*args, **kwargs)
  16265. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  16266. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16267. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16268. return True, func(*args, **kwargs)
  16269. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16270. return func(*args, **kwargs)
  16271. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  16272. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  16273. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  16274. res = query("AT+QGPSLOC={:d}".format(mode))
  16275. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  16276. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  16277. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  16278. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  16279. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  16280. raise salt.exceptions.CommandExecutionError(message["error"])
  16281. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16282. 2020-08-04 12:22:23,332 [obd.obd :107 ][ERROR ][655] Failed to use explicit port '/dev/serial0'
  16283. Traceback (most recent call last):
  16284. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  16285. self.interface.open(baudrate, protocol=protocol)
  16286. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  16287. self.set_protocol(prot.pop("id", None), **prot)
  16288. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  16289. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  16290. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  16291. self._protocol = self._auto_protocol(**kwargs)
  16292. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  16293. res_0100 = self._verify_protocol("auto", test=not verify)
  16294. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  16295. for line in self.query("0100", parse=False, read_timeout=10):
  16296. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  16297. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  16298. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  16299. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  16300. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  16301. data = self._port.read(self._port.in_waiting or 1)
  16302. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  16303. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  16304. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  16305. sys.exit(salt.defaults.exitcodes.EX_OK)
  16306. SystemExit: 0
  16307. 2020-08-04 12:22:23,390 [obd.obd :120 ][WARNING ][655] Cannot load commands - no connection to bus
  16308. 2020-08-04 12:22:23,419 [obd.interfaces.elm327:730 ][ERROR ][655] Failed to relay command 'STSLCS' to interface
  16309. Traceback (most recent call last):
  16310. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  16311. lines = self.send(cmd, raw_response=raw_response)
  16312. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  16313. raise ELM327Error(self.ERRORS[line], code=line)
  16314. ELM327Error: Operation interrupted by a received RS232 character
  16315. 2020-08-04 12:22:23,426 [messaging :742 ][ERROR ][655] Exception while processing event: {'tag': 'obd/req/bd66a30c-1930-4501-a6a1-118b6a9bb28c', 'data': {'_stamp': '2020-08-04T12:22:17.855825', 'handler': 'execute', '_event_tag': 'obd/req/bd66a30c-1930-4501-a6a1-118b6a9bb28c', 'args': ['STSLCS']}}
  16316. Traceback (most recent call last):
  16317. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  16318. res = self.process(message)
  16319. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  16320. result = func(message, **settings)
  16321. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  16322. found, result = self._call_hook_for(message, "workflow", message)
  16323. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16324. return True, func(*args, **kwargs)
  16325. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  16326. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16327. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16328. return True, func(*args, **kwargs)
  16329. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16330. return func(*args, **kwargs)
  16331. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  16332. res = conn.execute(cmd)
  16333. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  16334. return func(self, *args, **kwargs)
  16335. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  16336. return self._obd.execute(cmd, **kwargs)
  16337. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  16338. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  16339. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  16340. lines = self.send(cmd, raw_response=raw_response)
  16341. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  16342. raise ELM327Error(self.ERRORS[line], code=line)
  16343. ELM327Error: Operation interrupted by a received RS232 character
  16344. 2020-08-04 12:22:24,167 [salt.utils.parsers:1050][WARNING ][415] Minion received a SIGTERM. Exiting.
  16345. 2020-08-04 12:22:24,707 [messaging :871 ][WARNING ][830] No reply message with tag 'obd/res/bd66a30c-1930-4501-a6a1-118b6a9bb28c' received within timeout of 30 secs
  16346. 2020-08-04 12:22:24,711 [salt.state :292 ][ERROR ][830] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  16347. 2020-08-04 12:22:41,118 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  16348. 2020-08-04 12:22:41,127 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  16349. 2020-08-04 12:22:41,135 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  16350. 2020-08-04 12:22:41,793 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  16351. Traceback (most recent call last):
  16352. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16353. self._serial.open()
  16354. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16355. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16356. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16357. 2020-08-04 12:22:42,807 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  16358. Traceback (most recent call last):
  16359. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16360. self._serial.open()
  16361. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16362. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16363. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16364. 2020-08-04 12:22:43,170 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  16365. 2020-08-04 12:22:43,672 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  16366. 2020-08-04 12:22:43,811 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  16367. Traceback (most recent call last):
  16368. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16369. self._serial.open()
  16370. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16371. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16372. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16373. 2020-08-04 12:22:44,175 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  16374. 2020-08-04 12:22:44,178 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  16375. 2020-08-04 12:22:44,517 [messaging :208 ][ERROR ][618] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  16376. Traceback (most recent call last):
  16377. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  16378. self._call_hook_for(message, "workflow", message)
  16379. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16380. return True, func(*args, **kwargs)
  16381. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  16382. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16383. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16384. return True, func(*args, **kwargs)
  16385. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16386. return func(*args, **kwargs)
  16387. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  16388. res = _exec("AT+CCLK?")
  16389. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  16390. conn.write_line(cmd)
  16391. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  16392. self.ensure_open()
  16393. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  16394. self.open()
  16395. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  16396. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  16397. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  16398. raise attempt.get()
  16399. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  16400. six.reraise(self.value[0], self.value[1], self.value[2])
  16401. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  16402. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  16403. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16404. self._serial.open()
  16405. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16406. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16407. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16408. 2020-08-04 12:22:44,682 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  16409. 2020-08-04 12:22:59,787 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][673] Timeout after 1.28205128205 second(s) waiting for interrupt
  16410. 2020-08-04 12:22:59,867 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  16411. Traceback (most recent call last):
  16412. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16413. self._serial.open()
  16414. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16415. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16416. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16417. 2020-08-04 12:23:00,130 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  16418. 2020-08-04 12:23:00,633 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  16419. 2020-08-04 12:23:00,636 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  16420. 2020-08-04 12:23:00,882 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  16421. Traceback (most recent call last):
  16422. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16423. self._serial.open()
  16424. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16425. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16426. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16427. 2020-08-04 12:23:01,139 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  16428. 2020-08-04 12:23:01,643 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  16429. 2020-08-04 12:23:01,886 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  16430. Traceback (most recent call last):
  16431. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16432. self._serial.open()
  16433. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16434. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16435. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16436. 2020-08-04 12:23:01,900 [messaging :206 ][ERROR ][618] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  16437. Traceback (most recent call last):
  16438. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  16439. self._call_hook_for(message, "workflow", message)
  16440. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16441. return True, func(*args, **kwargs)
  16442. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  16443. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16444. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16445. return True, func(*args, **kwargs)
  16446. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16447. return func(*args, **kwargs)
  16448. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  16449. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  16450. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  16451. conn.write_line(cmd)
  16452. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  16453. self.ensure_open()
  16454. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  16455. self.open()
  16456. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  16457. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  16458. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  16459. raise attempt.get()
  16460. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  16461. six.reraise(self.value[0], self.value[1], self.value[2])
  16462. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  16463. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  16464. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16465. self._serial.open()
  16466. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16467. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16468. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16469. 2020-08-04 12:23:02,146 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  16470. 2020-08-04 12:23:02,148 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  16471. 2020-08-04 12:23:02,151 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  16472. 2020-08-04 12:23:02,654 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  16473. 2020-08-04 12:23:03,157 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  16474. 2020-08-04 12:23:03,159 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  16475. 2020-08-04 12:23:03,635 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  16476. Traceback (most recent call last):
  16477. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16478. self._serial.open()
  16479. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16480. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16481. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16482. 2020-08-04 12:23:03,663 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  16483. 2020-08-04 12:23:04,166 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  16484. 2020-08-04 12:23:04,655 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  16485. Traceback (most recent call last):
  16486. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16487. self._serial.open()
  16488. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16489. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16490. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16491. 2020-08-04 12:23:04,670 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  16492. 2020-08-04 12:23:04,672 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  16493. 2020-08-04 12:23:05,175 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  16494. 2020-08-04 12:23:05,659 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  16495. Traceback (most recent call last):
  16496. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16497. self._serial.open()
  16498. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16499. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16500. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16501. 2020-08-04 12:23:05,670 [messaging :742 ][ERROR ][618] Exception while processing event: {'tag': 'ec2x/req/58c4bee6-a232-41e3-886c-241b51cc1338', 'data': {'_stamp': '2020-08-04T12:22:41.186942', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/58c4bee6-a232-41e3-886c-241b51cc1338', 'kwargs': {'cooldown_delay': None}}}
  16502. Traceback (most recent call last):
  16503. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  16504. res = self.process(message)
  16505. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  16506. result = func(message, **settings)
  16507. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  16508. found, result = self._call_hook_for(message, "workflow", message)
  16509. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16510. return True, func(*args, **kwargs)
  16511. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  16512. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16513. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16514. return True, func(*args, **kwargs)
  16515. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16516. return func(*args, **kwargs)
  16517. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  16518. return _exec(cmd, **kwargs)
  16519. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  16520. conn.write_line(cmd)
  16521. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  16522. self.ensure_open()
  16523. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  16524. self.open()
  16525. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  16526. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  16527. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  16528. raise attempt.get()
  16529. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  16530. six.reraise(self.value[0], self.value[1], self.value[2])
  16531. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  16532. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  16533. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16534. self._serial.open()
  16535. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16536. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16537. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16538. 2020-08-04 12:23:05,678 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  16539. 2020-08-04 12:23:06,181 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  16540. 2020-08-04 12:23:06,183 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  16541. 2020-08-04 12:23:06,186 [messaging :208 ][ERROR ][621] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  16542. Traceback (most recent call last):
  16543. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  16544. self._call_hook_for(message, "workflow", message)
  16545. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16546. return True, func(*args, **kwargs)
  16547. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  16548. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16549. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16550. return True, func(*args, **kwargs)
  16551. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16552. return func(*args, **kwargs)
  16553. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  16554. conn.heartbeat()
  16555. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  16556. self.noop()
  16557. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  16558. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  16559. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  16560. raise attempt.get()
  16561. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  16562. six.reraise(self.value[0], self.value[1], self.value[2])
  16563. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  16564. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  16565. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  16566. self._begin_message()
  16567. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  16568. self.recv(ack=ACK_MESSAGE_BEGIN)
  16569. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  16570. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  16571. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  16572. raise attempt.get()
  16573. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  16574. six.reraise(self.value[0], self.value[1], self.value[2])
  16575. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  16576. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  16577. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  16578. raise Exception(msg)
  16579. Exception: Expected ack '12' but got '255'
  16580. 2020-08-04 12:23:07,950 [messaging :208 ][ERROR ][619] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  16581. Traceback (most recent call last):
  16582. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  16583. self._call_hook_for(message, "workflow", message)
  16584. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16585. return True, func(*args, **kwargs)
  16586. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  16587. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16588. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16589. return True, func(*args, **kwargs)
  16590. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16591. return func(*args, **kwargs)
  16592. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  16593. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  16594. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  16595. res = query("AT+QGPSLOC={:d}".format(mode))
  16596. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  16597. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  16598. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  16599. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  16600. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  16601. raise salt.exceptions.CommandExecutionError(message["error"])
  16602. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16603. 2020-08-04 12:23:12,994 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  16604. Traceback (most recent call last):
  16605. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16606. self._serial.open()
  16607. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16608. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16609. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16610. 2020-08-04 12:23:13,999 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  16611. Traceback (most recent call last):
  16612. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16613. self._serial.open()
  16614. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16615. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16616. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16617. 2020-08-04 12:23:15,003 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  16618. Traceback (most recent call last):
  16619. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16620. self._serial.open()
  16621. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16622. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16623. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16624. 2020-08-04 12:23:15,007 [messaging :742 ][ERROR ][618] Exception while processing event: {'tag': 'ec2x/req/a9f5618b-7049-4bb5-8d9a-16593db910f6', 'data': {'_stamp': '2020-08-04T12:23:12.987779', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/a9f5618b-7049-4bb5-8d9a-16593db910f6', 'kwargs': {'cooldown_delay': None}}}
  16625. Traceback (most recent call last):
  16626. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  16627. res = self.process(message)
  16628. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  16629. result = func(message, **settings)
  16630. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  16631. found, result = self._call_hook_for(message, "workflow", message)
  16632. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16633. return True, func(*args, **kwargs)
  16634. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  16635. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16636. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16637. return True, func(*args, **kwargs)
  16638. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16639. return func(*args, **kwargs)
  16640. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  16641. return _exec(cmd, **kwargs)
  16642. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  16643. conn.write_line(cmd)
  16644. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  16645. self.ensure_open()
  16646. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  16647. self.open()
  16648. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  16649. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  16650. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  16651. raise attempt.get()
  16652. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  16653. six.reraise(self.value[0], self.value[1], self.value[2])
  16654. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  16655. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  16656. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16657. self._serial.open()
  16658. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16659. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16660. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16661. 2020-08-04 12:23:15,036 [messaging :206 ][ERROR ][619] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  16662. Traceback (most recent call last):
  16663. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  16664. self._call_hook_for(message, "workflow", message)
  16665. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16666. return True, func(*args, **kwargs)
  16667. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  16668. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16669. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16670. return True, func(*args, **kwargs)
  16671. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16672. return func(*args, **kwargs)
  16673. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  16674. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  16675. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  16676. res = query("AT+QGPSLOC={:d}".format(mode))
  16677. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  16678. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  16679. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  16680. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  16681. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  16682. raise salt.exceptions.CommandExecutionError(message["error"])
  16683. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16684. 2020-08-04 12:23:18,289 [obd.obd :107 ][ERROR ][659] Failed to use explicit port '/dev/serial0'
  16685. Traceback (most recent call last):
  16686. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  16687. self.interface.open(baudrate, protocol=protocol)
  16688. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  16689. self.set_protocol(prot.pop("id", None), **prot)
  16690. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  16691. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  16692. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  16693. self._protocol = self._auto_protocol(**kwargs)
  16694. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  16695. res_0100 = self._verify_protocol("auto", test=not verify)
  16696. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  16697. for line in self.query("0100", parse=False, read_timeout=10):
  16698. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  16699. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  16700. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  16701. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  16702. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  16703. data = self._port.read(self._port.in_waiting or 1)
  16704. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  16705. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  16706. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  16707. sys.exit(salt.defaults.exitcodes.EX_OK)
  16708. SystemExit: 0
  16709. 2020-08-04 12:23:18,316 [obd.obd :120 ][WARNING ][659] Cannot load commands - no connection to bus
  16710. 2020-08-04 12:23:18,344 [obd.interfaces.elm327:730 ][ERROR ][659] Failed to relay command 'STSLCS' to interface
  16711. Traceback (most recent call last):
  16712. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  16713. lines = self.send(cmd, raw_response=raw_response)
  16714. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  16715. raise ELM327Error(self.ERRORS[line], code=line)
  16716. ELM327Error: Operation interrupted by a received RS232 character
  16717. 2020-08-04 12:23:18,353 [messaging :742 ][ERROR ][659] Exception while processing event: {'tag': 'obd/req/29154a7e-12ec-47c8-92e8-7f91bae4c14b', 'data': {'_stamp': '2020-08-04T12:23:12.757146', 'handler': 'execute', '_event_tag': 'obd/req/29154a7e-12ec-47c8-92e8-7f91bae4c14b', 'args': ['STSLCS']}}
  16718. Traceback (most recent call last):
  16719. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  16720. res = self.process(message)
  16721. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  16722. result = func(message, **settings)
  16723. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  16724. found, result = self._call_hook_for(message, "workflow", message)
  16725. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16726. return True, func(*args, **kwargs)
  16727. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  16728. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16729. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16730. return True, func(*args, **kwargs)
  16731. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16732. return func(*args, **kwargs)
  16733. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  16734. res = conn.execute(cmd)
  16735. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  16736. return func(self, *args, **kwargs)
  16737. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  16738. return self._obd.execute(cmd, **kwargs)
  16739. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  16740. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  16741. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  16742. lines = self.send(cmd, raw_response=raw_response)
  16743. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  16744. raise ELM327Error(self.ERRORS[line], code=line)
  16745. ELM327Error: Operation interrupted by a received RS232 character
  16746. 2020-08-04 12:23:19,114 [salt.utils.parsers:1050][WARNING ][418] Minion received a SIGTERM. Exiting.
  16747. 2020-08-04 12:23:19,654 [messaging :871 ][WARNING ][818] No reply message with tag 'obd/res/29154a7e-12ec-47c8-92e8-7f91bae4c14b' received within timeout of 30 secs
  16748. 2020-08-04 12:23:19,660 [salt.state :292 ][ERROR ][818] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  16749. 2020-08-04 12:23:35,945 [gpio_spi_conn :42 ][WARNING ][628] Unable to clear buffer - got unexpected value: 255
  16750. 2020-08-04 12:23:35,957 [gpio_spi_conn :42 ][WARNING ][628] Unable to clear buffer - got unexpected value: 255
  16751. 2020-08-04 12:23:35,962 [gpio_spi_conn :42 ][WARNING ][628] Unable to clear buffer - got unexpected value: 255
  16752. 2020-08-04 12:23:36,545 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  16753. Traceback (most recent call last):
  16754. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16755. self._serial.open()
  16756. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16757. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16758. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16759. 2020-08-04 12:23:37,558 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  16760. Traceback (most recent call last):
  16761. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16762. self._serial.open()
  16763. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16764. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16765. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16766. 2020-08-04 12:23:37,991 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  16767. 2020-08-04 12:23:38,494 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  16768. 2020-08-04 12:23:38,563 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  16769. Traceback (most recent call last):
  16770. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16771. self._serial.open()
  16772. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16773. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16774. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16775. 2020-08-04 12:23:38,997 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  16776. 2020-08-04 12:23:38,999 [spm_conn :139 ][WARNING ][628] Unable to get status: Expected ack '12' but got '255'
  16777. 2020-08-04 12:23:39,189 [messaging :208 ][ERROR ][625] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  16778. Traceback (most recent call last):
  16779. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  16780. self._call_hook_for(message, "workflow", message)
  16781. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16782. return True, func(*args, **kwargs)
  16783. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  16784. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16785. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16786. return True, func(*args, **kwargs)
  16787. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16788. return func(*args, **kwargs)
  16789. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  16790. res = _exec("AT+CCLK?")
  16791. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  16792. conn.write_line(cmd)
  16793. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  16794. self.ensure_open()
  16795. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  16796. self.open()
  16797. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  16798. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  16799. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  16800. raise attempt.get()
  16801. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  16802. six.reraise(self.value[0], self.value[1], self.value[2])
  16803. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  16804. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  16805. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16806. self._serial.open()
  16807. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16808. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16809. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16810. 2020-08-04 12:23:39,504 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  16811. 2020-08-04 12:23:40,008 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  16812. 2020-08-04 12:23:40,512 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  16813. 2020-08-04 12:23:40,514 [spm_conn :139 ][WARNING ][628] Unable to get status: Expected ack '12' but got '255'
  16814. 2020-08-04 12:23:41,017 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  16815. 2020-08-04 12:23:41,520 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  16816. 2020-08-04 12:23:42,024 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  16817. 2020-08-04 12:23:42,026 [spm_conn :139 ][WARNING ][628] Unable to get status: Expected ack '12' but got '255'
  16818. 2020-08-04 12:23:42,030 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  16819. 2020-08-04 12:23:42,533 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  16820. 2020-08-04 12:23:43,037 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  16821. 2020-08-04 12:23:43,040 [spm_conn :82 ][WARNING ][628] Unable to send noop: Expected ack '12' but got '255'
  16822. 2020-08-04 12:23:43,419 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  16823. Traceback (most recent call last):
  16824. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16825. self._serial.open()
  16826. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16827. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16828. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16829. 2020-08-04 12:23:43,549 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  16830. 2020-08-04 12:23:44,053 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  16831. 2020-08-04 12:23:44,441 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  16832. Traceback (most recent call last):
  16833. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16834. self._serial.open()
  16835. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16836. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16837. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16838. 2020-08-04 12:23:44,556 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  16839. 2020-08-04 12:23:44,559 [spm_conn :82 ][WARNING ][628] Unable to send noop: Expected ack '12' but got '255'
  16840. 2020-08-04 12:23:45,063 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  16841. 2020-08-04 12:23:45,455 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  16842. Traceback (most recent call last):
  16843. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16844. self._serial.open()
  16845. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16846. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16847. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16848. 2020-08-04 12:23:45,468 [messaging :742 ][ERROR ][625] Exception while processing event: {'tag': 'ec2x/req/0214c93e-e7ba-4ee2-bd46-b43317ee8642', 'data': {'_stamp': '2020-08-04T12:23:36.018561', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/0214c93e-e7ba-4ee2-bd46-b43317ee8642', 'kwargs': {'cooldown_delay': None}}}
  16849. Traceback (most recent call last):
  16850. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  16851. res = self.process(message)
  16852. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  16853. result = func(message, **settings)
  16854. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  16855. found, result = self._call_hook_for(message, "workflow", message)
  16856. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16857. return True, func(*args, **kwargs)
  16858. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  16859. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16860. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16861. return True, func(*args, **kwargs)
  16862. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16863. return func(*args, **kwargs)
  16864. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  16865. return _exec(cmd, **kwargs)
  16866. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  16867. conn.write_line(cmd)
  16868. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  16869. self.ensure_open()
  16870. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  16871. self.open()
  16872. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  16873. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  16874. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  16875. raise attempt.get()
  16876. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  16877. six.reraise(self.value[0], self.value[1], self.value[2])
  16878. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  16879. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  16880. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16881. self._serial.open()
  16882. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16883. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16884. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16885. 2020-08-04 12:23:45,567 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  16886. 2020-08-04 12:23:46,071 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  16887. 2020-08-04 12:23:46,073 [spm_conn :82 ][WARNING ][628] Unable to send noop: Expected ack '12' but got '255'
  16888. 2020-08-04 12:23:46,077 [messaging :208 ][ERROR ][628] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  16889. Traceback (most recent call last):
  16890. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  16891. self._call_hook_for(message, "workflow", message)
  16892. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16893. return True, func(*args, **kwargs)
  16894. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  16895. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16896. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16897. return True, func(*args, **kwargs)
  16898. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16899. return func(*args, **kwargs)
  16900. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  16901. conn.heartbeat()
  16902. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  16903. self.noop()
  16904. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  16905. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  16906. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  16907. raise attempt.get()
  16908. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  16909. six.reraise(self.value[0], self.value[1], self.value[2])
  16910. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  16911. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  16912. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  16913. self._begin_message()
  16914. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  16915. self.recv(ack=ACK_MESSAGE_BEGIN)
  16916. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  16917. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  16918. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  16919. raise attempt.get()
  16920. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  16921. six.reraise(self.value[0], self.value[1], self.value[2])
  16922. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  16923. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  16924. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  16925. raise Exception(msg)
  16926. Exception: Expected ack '12' but got '255'
  16927. 2020-08-04 12:23:46,140 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  16928. Traceback (most recent call last):
  16929. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16930. self._serial.open()
  16931. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16932. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16933. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16934. 2020-08-04 12:23:47,145 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  16935. Traceback (most recent call last):
  16936. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16937. self._serial.open()
  16938. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16939. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16940. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16941. 2020-08-04 12:23:47,735 [messaging :208 ][ERROR ][626] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  16942. Traceback (most recent call last):
  16943. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  16944. self._call_hook_for(message, "workflow", message)
  16945. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16946. return True, func(*args, **kwargs)
  16947. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  16948. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16949. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16950. return True, func(*args, **kwargs)
  16951. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16952. return func(*args, **kwargs)
  16953. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  16954. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  16955. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  16956. res = query("AT+QGPSLOC={:d}".format(mode))
  16957. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  16958. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  16959. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  16960. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  16961. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  16962. raise salt.exceptions.CommandExecutionError(message["error"])
  16963. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16964. 2020-08-04 12:23:48,149 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  16965. Traceback (most recent call last):
  16966. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  16967. self._serial.open()
  16968. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  16969. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  16970. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  16971. 2020-08-04 12:23:48,678 [messaging :206 ][ERROR ][625] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  16972. Traceback (most recent call last):
  16973. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  16974. self._call_hook_for(message, "workflow", message)
  16975. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16976. return True, func(*args, **kwargs)
  16977. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  16978. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  16979. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  16980. return True, func(*args, **kwargs)
  16981. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  16982. return func(*args, **kwargs)
  16983. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  16984. res = _exec("AT+CCLK?")
  16985. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  16986. conn.write_line(cmd)
  16987. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  16988. self.ensure_open()
  16989. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  16990. self.open()
  16991. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  16992. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  16993. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  16994. raise attempt.get()
  16995. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  16996. six.reraise(self.value[0], self.value[1], self.value[2])
  16997. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  16998. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  16999. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17000. self._serial.open()
  17001. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17002. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17003. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17004. 2020-08-04 12:24:03,981 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][665] Timeout after 1.28205128205 second(s) waiting for interrupt
  17005. 2020-08-04 12:24:04,723 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  17006. Traceback (most recent call last):
  17007. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17008. self._serial.open()
  17009. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17010. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17011. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17012. 2020-08-04 12:24:05,729 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  17013. Traceback (most recent call last):
  17014. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17015. self._serial.open()
  17016. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17017. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17018. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17019. 2020-08-04 12:24:06,733 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  17020. Traceback (most recent call last):
  17021. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17022. self._serial.open()
  17023. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17024. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17025. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17026. 2020-08-04 12:24:07,311 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  17027. Traceback (most recent call last):
  17028. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17029. self._serial.open()
  17030. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17031. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17032. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17033. 2020-08-04 12:24:07,314 [messaging :206 ][ERROR ][625] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  17034. Traceback (most recent call last):
  17035. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  17036. self._call_hook_for(message, "workflow", message)
  17037. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17038. return True, func(*args, **kwargs)
  17039. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  17040. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17041. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17042. return True, func(*args, **kwargs)
  17043. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17044. return func(*args, **kwargs)
  17045. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  17046. res = _exec("AT+CCLK?")
  17047. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  17048. conn.write_line(cmd)
  17049. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  17050. self.ensure_open()
  17051. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  17052. self.open()
  17053. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  17054. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  17055. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  17056. raise attempt.get()
  17057. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  17058. six.reraise(self.value[0], self.value[1], self.value[2])
  17059. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  17060. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  17061. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17062. self._serial.open()
  17063. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17064. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17065. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17066. 2020-08-04 12:24:08,315 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  17067. Traceback (most recent call last):
  17068. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17069. self._serial.open()
  17070. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17071. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17072. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17073. 2020-08-04 12:24:09,320 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  17074. Traceback (most recent call last):
  17075. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17076. self._serial.open()
  17077. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17078. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17079. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17080. 2020-08-04 12:24:09,323 [messaging :742 ][ERROR ][625] Exception while processing event: {'tag': 'ec2x/req/4d224acd-dc7a-4c2c-8e22-7ebcdf07ccf6', 'data': {'_stamp': '2020-08-04T12:24:03.974819', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/4d224acd-dc7a-4c2c-8e22-7ebcdf07ccf6', 'kwargs': {'cooldown_delay': None}}}
  17081. Traceback (most recent call last):
  17082. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  17083. res = self.process(message)
  17084. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  17085. result = func(message, **settings)
  17086. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  17087. found, result = self._call_hook_for(message, "workflow", message)
  17088. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17089. return True, func(*args, **kwargs)
  17090. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  17091. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17092. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17093. return True, func(*args, **kwargs)
  17094. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17095. return func(*args, **kwargs)
  17096. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  17097. return _exec(cmd, **kwargs)
  17098. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  17099. conn.write_line(cmd)
  17100. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  17101. self.ensure_open()
  17102. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  17103. self.open()
  17104. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  17105. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  17106. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  17107. raise attempt.get()
  17108. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  17109. six.reraise(self.value[0], self.value[1], self.value[2])
  17110. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  17111. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  17112. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17113. self._serial.open()
  17114. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17115. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17116. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17117. 2020-08-04 12:24:09,360 [messaging :206 ][ERROR ][626] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  17118. Traceback (most recent call last):
  17119. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  17120. self._call_hook_for(message, "workflow", message)
  17121. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17122. return True, func(*args, **kwargs)
  17123. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  17124. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17125. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17126. return True, func(*args, **kwargs)
  17127. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17128. return func(*args, **kwargs)
  17129. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  17130. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  17131. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  17132. res = query("AT+QGPSLOC={:d}".format(mode))
  17133. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  17134. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  17135. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  17136. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  17137. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  17138. raise salt.exceptions.CommandExecutionError(message["error"])
  17139. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17140. 2020-08-04 12:24:12,372 [salt.loaded.int.module.cmdmod:693 ][ERROR ][625] Command '['timedatectl', 'status']' failed with return code: 1
  17141. 2020-08-04 12:24:12,374 [salt.loaded.int.module.cmdmod:695 ][ERROR ][625] stdout: Failed to query server: Operation canceled
  17142. 2020-08-04 12:24:12,376 [salt.loaded.int.module.cmdmod:699 ][ERROR ][625] retcode: 1
  17143. 2020-08-04 12:24:12,379 [messaging :208 ][ERROR ][625] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  17144. Traceback (most recent call last):
  17145. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  17146. self._call_hook_for(message, "workflow", message)
  17147. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17148. return True, func(*args, **kwargs)
  17149. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  17150. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17151. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17152. return True, func(*args, **kwargs)
  17153. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17154. return func(*args, **kwargs)
  17155. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 215, in sync_time_handler
  17156. if not force and status["ntp_synchronized"] == "yes":
  17157. KeyError: 'ntp_synchronized'
  17158. 2020-08-04 12:24:13,386 [obd.obd :107 ][ERROR ][664] Failed to use explicit port '/dev/serial0'
  17159. Traceback (most recent call last):
  17160. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  17161. self.interface.open(baudrate, protocol=protocol)
  17162. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  17163. self.set_protocol(prot.pop("id", None), **prot)
  17164. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  17165. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  17166. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  17167. self._protocol = self._auto_protocol(**kwargs)
  17168. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  17169. res_0100 = self._verify_protocol("auto", test=not verify)
  17170. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  17171. for line in self.query("0100", parse=False, read_timeout=10):
  17172. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  17173. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  17174. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  17175. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  17176. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  17177. data = self._port.read(self._port.in_waiting or 1)
  17178. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  17179. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  17180. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  17181. sys.exit(salt.defaults.exitcodes.EX_OK)
  17182. SystemExit: 0
  17183. 2020-08-04 12:24:13,421 [obd.obd :120 ][WARNING ][664] Cannot load commands - no connection to bus
  17184. 2020-08-04 12:24:13,446 [obd.interfaces.elm327:730 ][ERROR ][664] Failed to relay command 'STSLCS' to interface
  17185. Traceback (most recent call last):
  17186. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  17187. lines = self.send(cmd, raw_response=raw_response)
  17188. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  17189. raise ELM327Error(self.ERRORS[line], code=line)
  17190. ELM327Error: Operation interrupted by a received RS232 character
  17191. 2020-08-04 12:24:13,450 [messaging :742 ][ERROR ][664] Exception while processing event: {'tag': 'obd/req/c04fa3b9-54b3-4762-890a-df46ced060f0', 'data': {'_stamp': '2020-08-04T12:24:07.874901', 'handler': 'execute', '_event_tag': 'obd/req/c04fa3b9-54b3-4762-890a-df46ced060f0', 'args': ['STSLCS']}}
  17192. Traceback (most recent call last):
  17193. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  17194. res = self.process(message)
  17195. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  17196. result = func(message, **settings)
  17197. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  17198. found, result = self._call_hook_for(message, "workflow", message)
  17199. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17200. return True, func(*args, **kwargs)
  17201. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  17202. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17203. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17204. return True, func(*args, **kwargs)
  17205. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17206. return func(*args, **kwargs)
  17207. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  17208. res = conn.execute(cmd)
  17209. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  17210. return func(self, *args, **kwargs)
  17211. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  17212. return self._obd.execute(cmd, **kwargs)
  17213. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  17214. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  17215. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  17216. lines = self.send(cmd, raw_response=raw_response)
  17217. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  17218. raise ELM327Error(self.ERRORS[line], code=line)
  17219. ELM327Error: Operation interrupted by a received RS232 character
  17220. 2020-08-04 12:24:14,201 [salt.utils.parsers:1050][WARNING ][424] Minion received a SIGTERM. Exiting.
  17221. 2020-08-04 12:24:14,739 [messaging :871 ][WARNING ][839] No reply message with tag 'obd/res/c04fa3b9-54b3-4762-890a-df46ced060f0' received within timeout of 30 secs
  17222. 2020-08-04 12:24:14,742 [salt.state :292 ][ERROR ][839] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  17223. 2020-08-04 12:24:30,937 [gpio_spi_conn :42 ][WARNING ][632] Unable to clear buffer - got unexpected value: 255
  17224. 2020-08-04 12:24:30,955 [gpio_spi_conn :42 ][WARNING ][632] Unable to clear buffer - got unexpected value: 255
  17225. 2020-08-04 12:24:30,963 [gpio_spi_conn :42 ][WARNING ][632] Unable to clear buffer - got unexpected value: 255
  17226. 2020-08-04 12:24:31,626 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17227. Traceback (most recent call last):
  17228. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17229. self._serial.open()
  17230. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17231. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17232. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17233. 2020-08-04 12:24:32,642 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17234. Traceback (most recent call last):
  17235. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17236. self._serial.open()
  17237. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17238. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17239. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17240. 2020-08-04 12:24:32,990 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  17241. 2020-08-04 12:24:33,493 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  17242. 2020-08-04 12:24:33,646 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17243. Traceback (most recent call last):
  17244. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17245. self._serial.open()
  17246. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17247. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17248. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17249. 2020-08-04 12:24:33,995 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  17250. 2020-08-04 12:24:33,998 [spm_conn :139 ][WARNING ][632] Unable to get status: Expected ack '12' but got '255'
  17251. 2020-08-04 12:24:34,222 [messaging :208 ][ERROR ][629] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  17252. Traceback (most recent call last):
  17253. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  17254. self._call_hook_for(message, "workflow", message)
  17255. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17256. return True, func(*args, **kwargs)
  17257. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  17258. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17259. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17260. return True, func(*args, **kwargs)
  17261. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17262. return func(*args, **kwargs)
  17263. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  17264. res = _exec("AT+CCLK?")
  17265. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  17266. conn.write_line(cmd)
  17267. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  17268. self.ensure_open()
  17269. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  17270. self.open()
  17271. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  17272. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  17273. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  17274. raise attempt.get()
  17275. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  17276. six.reraise(self.value[0], self.value[1], self.value[2])
  17277. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  17278. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  17279. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17280. self._serial.open()
  17281. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17282. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17283. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17284. 2020-08-04 12:24:34,502 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  17285. 2020-08-04 12:24:35,005 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  17286. 2020-08-04 12:24:35,508 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  17287. 2020-08-04 12:24:35,510 [spm_conn :139 ][WARNING ][632] Unable to get status: Expected ack '12' but got '255'
  17288. 2020-08-04 12:24:36,014 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  17289. 2020-08-04 12:24:36,517 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  17290. 2020-08-04 12:24:37,021 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  17291. 2020-08-04 12:24:37,023 [spm_conn :139 ][WARNING ][632] Unable to get status: Expected ack '12' but got '255'
  17292. 2020-08-04 12:24:37,027 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  17293. 2020-08-04 12:24:37,531 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  17294. 2020-08-04 12:24:38,008 [salt.utils :831 ][ERROR ][429] DNS lookup or connection check of 'hub' failed.
  17295. 2020-08-04 12:24:38,034 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  17296. 2020-08-04 12:24:38,037 [spm_conn :82 ][WARNING ][632] Unable to send noop: Expected ack '12' but got '255'
  17297. 2020-08-04 12:24:38,335 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17298. Traceback (most recent call last):
  17299. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17300. self._serial.open()
  17301. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17302. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17303. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17304. 2020-08-04 12:24:38,545 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  17305. 2020-08-04 12:24:39,051 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  17306. 2020-08-04 12:24:39,339 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17307. Traceback (most recent call last):
  17308. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17309. self._serial.open()
  17310. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17311. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17312. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17313. 2020-08-04 12:24:39,555 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  17314. 2020-08-04 12:24:39,557 [spm_conn :82 ][WARNING ][632] Unable to send noop: Expected ack '12' but got '255'
  17315. 2020-08-04 12:24:39,612 [cloud_cache :432 ][WARNING ][671] Temporarily unable to upload batch with 7 entries from queue 'pend': HTTPSConnectionPool(host='api.autopi.io', port=443): Max retries exceeded with url: /logbook/storage (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x735f3a30>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))
  17316. 2020-08-04 12:24:40,061 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  17317. 2020-08-04 12:24:40,343 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17318. Traceback (most recent call last):
  17319. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17320. self._serial.open()
  17321. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17322. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17323. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17324. 2020-08-04 12:24:40,347 [messaging :742 ][ERROR ][629] Exception while processing event: {'tag': 'ec2x/req/2f6826c0-b5ef-4c31-84d1-59c691065b68', 'data': {'_stamp': '2020-08-04T12:24:31.016885', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/2f6826c0-b5ef-4c31-84d1-59c691065b68', 'kwargs': {'cooldown_delay': None}}}
  17325. Traceback (most recent call last):
  17326. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  17327. res = self.process(message)
  17328. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  17329. result = func(message, **settings)
  17330. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  17331. found, result = self._call_hook_for(message, "workflow", message)
  17332. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17333. return True, func(*args, **kwargs)
  17334. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  17335. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17336. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17337. return True, func(*args, **kwargs)
  17338. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17339. return func(*args, **kwargs)
  17340. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  17341. return _exec(cmd, **kwargs)
  17342. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  17343. conn.write_line(cmd)
  17344. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  17345. self.ensure_open()
  17346. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  17347. self.open()
  17348. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  17349. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  17350. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  17351. raise attempt.get()
  17352. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  17353. six.reraise(self.value[0], self.value[1], self.value[2])
  17354. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  17355. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  17356. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17357. self._serial.open()
  17358. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17359. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17360. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17361. 2020-08-04 12:24:40,417 [messaging :208 ][ERROR ][630] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  17362. Traceback (most recent call last):
  17363. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  17364. self._call_hook_for(message, "workflow", message)
  17365. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17366. return True, func(*args, **kwargs)
  17367. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  17368. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17369. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17370. return True, func(*args, **kwargs)
  17371. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17372. return func(*args, **kwargs)
  17373. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  17374. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  17375. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  17376. res = query("AT+QGPSLOC={:d}".format(mode))
  17377. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  17378. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  17379. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  17380. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  17381. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  17382. raise salt.exceptions.CommandExecutionError(message["error"])
  17383. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17384. 2020-08-04 12:24:40,564 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  17385. 2020-08-04 12:24:41,023 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17386. Traceback (most recent call last):
  17387. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17388. self._serial.open()
  17389. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17390. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17391. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17392. 2020-08-04 12:24:41,067 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  17393. 2020-08-04 12:24:41,069 [spm_conn :82 ][WARNING ][632] Unable to send noop: Expected ack '12' but got '255'
  17394. 2020-08-04 12:24:41,071 [messaging :208 ][ERROR ][632] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  17395. Traceback (most recent call last):
  17396. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  17397. self._call_hook_for(message, "workflow", message)
  17398. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17399. return True, func(*args, **kwargs)
  17400. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  17401. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17402. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17403. return True, func(*args, **kwargs)
  17404. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17405. return func(*args, **kwargs)
  17406. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  17407. conn.heartbeat()
  17408. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  17409. self.noop()
  17410. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  17411. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  17412. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  17413. raise attempt.get()
  17414. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  17415. six.reraise(self.value[0], self.value[1], self.value[2])
  17416. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  17417. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  17418. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  17419. self._begin_message()
  17420. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  17421. self.recv(ack=ACK_MESSAGE_BEGIN)
  17422. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  17423. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  17424. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  17425. raise attempt.get()
  17426. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  17427. six.reraise(self.value[0], self.value[1], self.value[2])
  17428. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  17429. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  17430. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  17431. raise Exception(msg)
  17432. Exception: Expected ack '12' but got '255'
  17433. 2020-08-04 12:24:42,028 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17434. Traceback (most recent call last):
  17435. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17436. self._serial.open()
  17437. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17438. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17439. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17440. 2020-08-04 12:24:43,032 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17441. Traceback (most recent call last):
  17442. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17443. self._serial.open()
  17444. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17445. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17446. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17447. 2020-08-04 12:24:43,601 [messaging :206 ][ERROR ][629] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  17448. Traceback (most recent call last):
  17449. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  17450. self._call_hook_for(message, "workflow", message)
  17451. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17452. return True, func(*args, **kwargs)
  17453. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  17454. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17455. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17456. return True, func(*args, **kwargs)
  17457. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17458. return func(*args, **kwargs)
  17459. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  17460. res = _exec("AT+CCLK?")
  17461. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  17462. conn.write_line(cmd)
  17463. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  17464. self.ensure_open()
  17465. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  17466. self.open()
  17467. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  17468. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  17469. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  17470. raise attempt.get()
  17471. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  17472. six.reraise(self.value[0], self.value[1], self.value[2])
  17473. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  17474. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  17475. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17476. self._serial.open()
  17477. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17478. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17479. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17480. 2020-08-04 12:24:45,486 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17481. Traceback (most recent call last):
  17482. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17483. self._serial.open()
  17484. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17485. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17486. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17487. 2020-08-04 12:24:46,490 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17488. Traceback (most recent call last):
  17489. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17490. self._serial.open()
  17491. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17492. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17493. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17494. 2020-08-04 12:24:47,494 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17495. Traceback (most recent call last):
  17496. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17497. self._serial.open()
  17498. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17499. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17500. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17501. 2020-08-04 12:24:47,498 [messaging :742 ][ERROR ][629] Exception while processing event: {'tag': 'ec2x/req/8e90ed21-c27a-48e6-af16-9ee30b60fbcb', 'data': {'_stamp': '2020-08-04T12:24:45.466963', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/8e90ed21-c27a-48e6-af16-9ee30b60fbcb', 'kwargs': {'cooldown_delay': None}}}
  17502. Traceback (most recent call last):
  17503. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  17504. res = self.process(message)
  17505. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  17506. result = func(message, **settings)
  17507. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  17508. found, result = self._call_hook_for(message, "workflow", message)
  17509. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17510. return True, func(*args, **kwargs)
  17511. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  17512. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17513. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17514. return True, func(*args, **kwargs)
  17515. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17516. return func(*args, **kwargs)
  17517. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  17518. return _exec(cmd, **kwargs)
  17519. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  17520. conn.write_line(cmd)
  17521. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  17522. self.ensure_open()
  17523. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  17524. self.open()
  17525. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  17526. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  17527. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  17528. raise attempt.get()
  17529. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  17530. six.reraise(self.value[0], self.value[1], self.value[2])
  17531. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  17532. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  17533. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17534. self._serial.open()
  17535. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17536. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17537. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17538. 2020-08-04 12:24:47,530 [messaging :206 ][ERROR ][630] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  17539. Traceback (most recent call last):
  17540. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  17541. self._call_hook_for(message, "workflow", message)
  17542. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17543. return True, func(*args, **kwargs)
  17544. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  17545. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17546. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17547. return True, func(*args, **kwargs)
  17548. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17549. return func(*args, **kwargs)
  17550. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  17551. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  17552. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  17553. res = query("AT+QGPSLOC={:d}".format(mode))
  17554. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  17555. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  17556. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  17557. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  17558. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  17559. raise salt.exceptions.CommandExecutionError(message["error"])
  17560. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17561. 2020-08-04 12:24:49,137 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17562. Traceback (most recent call last):
  17563. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17564. self._serial.open()
  17565. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17566. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17567. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17568. 2020-08-04 12:24:50,142 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17569. Traceback (most recent call last):
  17570. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17571. self._serial.open()
  17572. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17573. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17574. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17575. 2020-08-04 12:24:51,146 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17576. Traceback (most recent call last):
  17577. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17578. self._serial.open()
  17579. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17580. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17581. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17582. 2020-08-04 12:24:51,668 [messaging :206 ][ERROR ][629] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  17583. Traceback (most recent call last):
  17584. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  17585. self._call_hook_for(message, "workflow", message)
  17586. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17587. return True, func(*args, **kwargs)
  17588. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  17589. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17590. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17591. return True, func(*args, **kwargs)
  17592. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17593. return func(*args, **kwargs)
  17594. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  17595. res = _exec("AT+CCLK?")
  17596. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  17597. conn.write_line(cmd)
  17598. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  17599. self.ensure_open()
  17600. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  17601. self.open()
  17602. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  17603. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  17604. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  17605. raise attempt.get()
  17606. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  17607. six.reraise(self.value[0], self.value[1], self.value[2])
  17608. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  17609. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  17610. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17611. self._serial.open()
  17612. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17613. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17614. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17615. 2020-08-04 12:24:52,563 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17616. Traceback (most recent call last):
  17617. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17618. self._serial.open()
  17619. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17620. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17621. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17622. 2020-08-04 12:24:53,577 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17623. Traceback (most recent call last):
  17624. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17625. self._serial.open()
  17626. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17627. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17628. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17629. 2020-08-04 12:24:54,580 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17630. Traceback (most recent call last):
  17631. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17632. self._serial.open()
  17633. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17634. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17635. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17636. 2020-08-04 12:24:54,584 [messaging :742 ][ERROR ][629] Exception while processing event: {'tag': 'ec2x/req/94f27a1b-a8b1-442d-bbea-c63cafcb6c52', 'data': {'_stamp': '2020-08-04T12:24:52.545793', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/94f27a1b-a8b1-442d-bbea-c63cafcb6c52', 'kwargs': {'cooldown_delay': None}}}
  17637. Traceback (most recent call last):
  17638. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  17639. res = self.process(message)
  17640. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  17641. result = func(message, **settings)
  17642. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  17643. found, result = self._call_hook_for(message, "workflow", message)
  17644. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17645. return True, func(*args, **kwargs)
  17646. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  17647. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17648. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17649. return True, func(*args, **kwargs)
  17650. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17651. return func(*args, **kwargs)
  17652. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  17653. return _exec(cmd, **kwargs)
  17654. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  17655. conn.write_line(cmd)
  17656. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  17657. self.ensure_open()
  17658. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  17659. self.open()
  17660. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  17661. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  17662. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  17663. raise attempt.get()
  17664. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  17665. six.reraise(self.value[0], self.value[1], self.value[2])
  17666. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  17667. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  17668. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17669. self._serial.open()
  17670. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17671. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17672. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17673. 2020-08-04 12:24:54,611 [messaging :206 ][ERROR ][630] Recurring exception (3 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  17674. Traceback (most recent call last):
  17675. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  17676. self._call_hook_for(message, "workflow", message)
  17677. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17678. return True, func(*args, **kwargs)
  17679. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  17680. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17681. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17682. return True, func(*args, **kwargs)
  17683. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17684. return func(*args, **kwargs)
  17685. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  17686. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  17687. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  17688. res = query("AT+QGPSLOC={:d}".format(mode))
  17689. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  17690. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  17691. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  17692. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  17693. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  17694. raise salt.exceptions.CommandExecutionError(message["error"])
  17695. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17696. 2020-08-04 12:24:57,340 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17697. Traceback (most recent call last):
  17698. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17699. self._serial.open()
  17700. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17701. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17702. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17703. 2020-08-04 12:24:58,345 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17704. Traceback (most recent call last):
  17705. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17706. self._serial.open()
  17707. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17708. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17709. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17710. 2020-08-04 12:24:59,349 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17711. Traceback (most recent call last):
  17712. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17713. self._serial.open()
  17714. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17715. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17716. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17717. 2020-08-04 12:24:59,928 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17718. Traceback (most recent call last):
  17719. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17720. self._serial.open()
  17721. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17722. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17723. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17724. 2020-08-04 12:25:15,369 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][669] Timeout after 1.28205128205 second(s) waiting for interrupt
  17725. 2020-08-04 12:25:15,995 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17726. Traceback (most recent call last):
  17727. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17728. self._serial.open()
  17729. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17730. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17731. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17732. 2020-08-04 12:25:16,999 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17733. Traceback (most recent call last):
  17734. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17735. self._serial.open()
  17736. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17737. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17738. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17739. 2020-08-04 12:25:17,002 [messaging :742 ][ERROR ][629] Exception while processing event: {'tag': 'ec2x/req/528a3751-a3c2-435c-a113-352628f9325e', 'data': {'_stamp': '2020-08-04T12:24:59.631310', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/528a3751-a3c2-435c-a113-352628f9325e', 'kwargs': {'cooldown_delay': None}}}
  17740. Traceback (most recent call last):
  17741. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  17742. res = self.process(message)
  17743. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  17744. result = func(message, **settings)
  17745. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  17746. found, result = self._call_hook_for(message, "workflow", message)
  17747. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17748. return True, func(*args, **kwargs)
  17749. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  17750. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17751. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17752. return True, func(*args, **kwargs)
  17753. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17754. return func(*args, **kwargs)
  17755. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  17756. return _exec(cmd, **kwargs)
  17757. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  17758. conn.write_line(cmd)
  17759. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  17760. self.ensure_open()
  17761. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  17762. self.open()
  17763. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  17764. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  17765. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  17766. raise attempt.get()
  17767. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  17768. six.reraise(self.value[0], self.value[1], self.value[2])
  17769. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  17770. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  17771. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17772. self._serial.open()
  17773. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17774. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17775. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17776. 2020-08-04 12:25:17,627 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17777. Traceback (most recent call last):
  17778. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17779. self._serial.open()
  17780. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17781. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17782. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17783. 2020-08-04 12:25:18,632 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17784. Traceback (most recent call last):
  17785. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17786. self._serial.open()
  17787. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17788. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17789. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17790. 2020-08-04 12:25:19,636 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17791. Traceback (most recent call last):
  17792. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17793. self._serial.open()
  17794. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17795. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17796. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17797. 2020-08-04 12:25:22,104 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17798. Traceback (most recent call last):
  17799. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17800. self._serial.open()
  17801. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17802. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17803. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17804. 2020-08-04 12:25:23,110 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17805. Traceback (most recent call last):
  17806. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17807. self._serial.open()
  17808. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17809. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17810. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17811. 2020-08-04 12:25:24,115 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  17812. Traceback (most recent call last):
  17813. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17814. self._serial.open()
  17815. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17816. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17817. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17818. 2020-08-04 12:25:24,118 [messaging :742 ][ERROR ][629] Exception while processing event: {'tag': 'ec2x/req/18f2c58c-14ff-4673-849e-33381fb3ba8d', 'data': {'_stamp': '2020-08-04T12:25:22.079177', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/18f2c58c-14ff-4673-849e-33381fb3ba8d', 'kwargs': {'cooldown_delay': None}}}
  17819. Traceback (most recent call last):
  17820. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  17821. res = self.process(message)
  17822. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  17823. result = func(message, **settings)
  17824. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  17825. found, result = self._call_hook_for(message, "workflow", message)
  17826. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17827. return True, func(*args, **kwargs)
  17828. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  17829. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17830. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17831. return True, func(*args, **kwargs)
  17832. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17833. return func(*args, **kwargs)
  17834. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  17835. return _exec(cmd, **kwargs)
  17836. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  17837. conn.write_line(cmd)
  17838. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  17839. self.ensure_open()
  17840. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  17841. self.open()
  17842. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  17843. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  17844. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  17845. raise attempt.get()
  17846. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  17847. six.reraise(self.value[0], self.value[1], self.value[2])
  17848. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  17849. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  17850. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17851. self._serial.open()
  17852. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17853. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17854. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17855. 2020-08-04 12:25:24,906 [obd.obd :107 ][ERROR ][668] Failed to use explicit port '/dev/serial0'
  17856. Traceback (most recent call last):
  17857. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  17858. self.interface.open(baudrate, protocol=protocol)
  17859. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  17860. self.set_protocol(prot.pop("id", None), **prot)
  17861. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  17862. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  17863. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  17864. self._protocol = self._auto_protocol(**kwargs)
  17865. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  17866. res_0100 = self._verify_protocol("auto", test=not verify)
  17867. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  17868. for line in self.query("0100", parse=False, read_timeout=10):
  17869. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  17870. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  17871. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  17872. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  17873. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  17874. data = self._port.read(self._port.in_waiting or 1)
  17875. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  17876. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  17877. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 697, in _handle_signals
  17878. def _handle_signals(self, signum, sigframe):
  17879. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  17880. sys.exit(salt.defaults.exitcodes.EX_OK)
  17881. SystemExit: 0
  17882. 2020-08-04 12:25:24,943 [obd.obd :120 ][WARNING ][668] Cannot load commands - no connection to bus
  17883. 2020-08-04 12:25:24,973 [obd.interfaces.elm327:730 ][ERROR ][668] Failed to relay command 'STSLCS' to interface
  17884. Traceback (most recent call last):
  17885. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  17886. lines = self.send(cmd, raw_response=raw_response)
  17887. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  17888. raise ELM327Error(self.ERRORS[line], code=line)
  17889. ELM327Error: Operation interrupted by a received RS232 character
  17890. 2020-08-04 12:25:24,977 [messaging :742 ][ERROR ][668] Exception while processing event: {'tag': 'obd/req/c0c56126-dc9a-409a-8134-95d81d3d5958', 'data': {'_stamp': '2020-08-04T12:25:19.321782', 'handler': 'execute', '_event_tag': 'obd/req/c0c56126-dc9a-409a-8134-95d81d3d5958', 'args': ['STSLCS']}}
  17891. Traceback (most recent call last):
  17892. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  17893. res = self.process(message)
  17894. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  17895. result = func(message, **settings)
  17896. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  17897. found, result = self._call_hook_for(message, "workflow", message)
  17898. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17899. return True, func(*args, **kwargs)
  17900. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  17901. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17902. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17903. return True, func(*args, **kwargs)
  17904. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17905. return func(*args, **kwargs)
  17906. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  17907. res = conn.execute(cmd)
  17908. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  17909. return func(self, *args, **kwargs)
  17910. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  17911. return self._obd.execute(cmd, **kwargs)
  17912. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  17913. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  17914. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  17915. lines = self.send(cmd, raw_response=raw_response)
  17916. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  17917. raise ELM327Error(self.ERRORS[line], code=line)
  17918. ELM327Error: Operation interrupted by a received RS232 character
  17919. 2020-08-04 12:25:25,690 [salt.utils.parsers:1050][WARNING ][429] Minion received a SIGTERM. Exiting.
  17920. 2020-08-04 12:25:26,230 [messaging :871 ][WARNING ][900] No reply message with tag 'obd/res/c0c56126-dc9a-409a-8134-95d81d3d5958' received within timeout of 30 secs
  17921. 2020-08-04 12:25:26,233 [salt.state :292 ][ERROR ][900] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  17922. 2020-08-04 12:25:43,002 [gpio_spi_conn :42 ][WARNING ][618] Unable to clear buffer - got unexpected value: 255
  17923. 2020-08-04 12:25:43,010 [gpio_spi_conn :42 ][WARNING ][618] Unable to clear buffer - got unexpected value: 255
  17924. 2020-08-04 12:25:43,015 [gpio_spi_conn :42 ][WARNING ][618] Unable to clear buffer - got unexpected value: 255
  17925. 2020-08-04 12:25:43,661 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  17926. Traceback (most recent call last):
  17927. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17928. self._serial.open()
  17929. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17930. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17931. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17932. 2020-08-04 12:25:44,673 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  17933. Traceback (most recent call last):
  17934. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17935. self._serial.open()
  17936. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17937. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17938. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17939. 2020-08-04 12:25:45,052 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  17940. 2020-08-04 12:25:45,555 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  17941. 2020-08-04 12:25:45,678 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  17942. Traceback (most recent call last):
  17943. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17944. self._serial.open()
  17945. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17946. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17947. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17948. 2020-08-04 12:25:46,059 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  17949. 2020-08-04 12:25:46,061 [spm_conn :139 ][WARNING ][618] Unable to get status: Expected ack '12' but got '255'
  17950. 2020-08-04 12:25:46,207 [messaging :208 ][ERROR ][615] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  17951. Traceback (most recent call last):
  17952. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  17953. self._call_hook_for(message, "workflow", message)
  17954. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17955. return True, func(*args, **kwargs)
  17956. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  17957. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  17958. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  17959. return True, func(*args, **kwargs)
  17960. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  17961. return func(*args, **kwargs)
  17962. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  17963. res = _exec("AT+CCLK?")
  17964. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  17965. conn.write_line(cmd)
  17966. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  17967. self.ensure_open()
  17968. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  17969. self.open()
  17970. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  17971. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  17972. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  17973. raise attempt.get()
  17974. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  17975. six.reraise(self.value[0], self.value[1], self.value[2])
  17976. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  17977. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  17978. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17979. self._serial.open()
  17980. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17981. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17982. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17983. 2020-08-04 12:26:01,119 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  17984. 2020-08-04 12:26:01,200 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  17985. Traceback (most recent call last):
  17986. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17987. self._serial.open()
  17988. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17989. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  17990. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  17991. 2020-08-04 12:26:01,625 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  17992. 2020-08-04 12:26:02,130 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  17993. 2020-08-04 12:26:02,134 [spm_conn :139 ][WARNING ][618] Unable to get status: Expected ack '12' but got '255'
  17994. 2020-08-04 12:26:02,205 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  17995. Traceback (most recent call last):
  17996. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  17997. self._serial.open()
  17998. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  17999. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18000. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18001. 2020-08-04 12:26:02,640 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  18002. 2020-08-04 12:26:03,146 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  18003. 2020-08-04 12:26:03,210 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  18004. Traceback (most recent call last):
  18005. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18006. self._serial.open()
  18007. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18008. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18009. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18010. 2020-08-04 12:26:03,223 [messaging :206 ][ERROR ][615] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  18011. Traceback (most recent call last):
  18012. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  18013. self._call_hook_for(message, "workflow", message)
  18014. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18015. return True, func(*args, **kwargs)
  18016. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  18017. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18018. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18019. return True, func(*args, **kwargs)
  18020. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18021. return func(*args, **kwargs)
  18022. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  18023. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  18024. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  18025. conn.write_line(cmd)
  18026. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  18027. self.ensure_open()
  18028. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  18029. self.open()
  18030. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  18031. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  18032. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  18033. raise attempt.get()
  18034. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  18035. six.reraise(self.value[0], self.value[1], self.value[2])
  18036. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  18037. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  18038. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18039. self._serial.open()
  18040. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18041. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18042. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18043. 2020-08-04 12:26:03,650 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  18044. 2020-08-04 12:26:03,652 [spm_conn :139 ][WARNING ][618] Unable to get status: Expected ack '12' but got '255'
  18045. 2020-08-04 12:26:03,656 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  18046. 2020-08-04 12:26:04,159 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  18047. 2020-08-04 12:26:04,662 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  18048. 2020-08-04 12:26:04,664 [spm_conn :82 ][WARNING ][618] Unable to send noop: Expected ack '12' but got '255'
  18049. 2020-08-04 12:26:05,125 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  18050. Traceback (most recent call last):
  18051. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18052. self._serial.open()
  18053. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18054. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18055. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18056. 2020-08-04 12:26:05,171 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  18057. 2020-08-04 12:26:05,674 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  18058. 2020-08-04 12:26:06,129 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  18059. Traceback (most recent call last):
  18060. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18061. self._serial.open()
  18062. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18063. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18064. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18065. 2020-08-04 12:26:06,177 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  18066. 2020-08-04 12:26:06,179 [spm_conn :82 ][WARNING ][618] Unable to send noop: Expected ack '12' but got '255'
  18067. 2020-08-04 12:26:06,683 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  18068. 2020-08-04 12:26:07,134 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  18069. Traceback (most recent call last):
  18070. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18071. self._serial.open()
  18072. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18073. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18074. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18075. 2020-08-04 12:26:07,138 [messaging :742 ][ERROR ][615] Exception while processing event: {'tag': 'ec2x/req/560e9989-1438-4c26-aa39-8c5ad29e1e44', 'data': {'_stamp': '2020-08-04T12:25:43.081214', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/560e9989-1438-4c26-aa39-8c5ad29e1e44', 'kwargs': {'cooldown_delay': None}}}
  18076. Traceback (most recent call last):
  18077. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  18078. res = self.process(message)
  18079. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  18080. result = func(message, **settings)
  18081. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  18082. found, result = self._call_hook_for(message, "workflow", message)
  18083. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18084. return True, func(*args, **kwargs)
  18085. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  18086. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18087. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18088. return True, func(*args, **kwargs)
  18089. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18090. return func(*args, **kwargs)
  18091. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  18092. return _exec(cmd, **kwargs)
  18093. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  18094. conn.write_line(cmd)
  18095. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  18096. self.ensure_open()
  18097. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  18098. self.open()
  18099. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  18100. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  18101. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  18102. raise attempt.get()
  18103. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  18104. six.reraise(self.value[0], self.value[1], self.value[2])
  18105. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  18106. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  18107. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18108. self._serial.open()
  18109. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18110. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18111. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18112. 2020-08-04 12:26:07,186 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  18113. 2020-08-04 12:26:07,174 [messaging :208 ][ERROR ][616] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  18114. Traceback (most recent call last):
  18115. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  18116. self._call_hook_for(message, "workflow", message)
  18117. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18118. return True, func(*args, **kwargs)
  18119. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  18120. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18121. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18122. return True, func(*args, **kwargs)
  18123. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18124. return func(*args, **kwargs)
  18125. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  18126. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  18127. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  18128. res = query("AT+QGPSLOC={:d}".format(mode))
  18129. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  18130. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  18131. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  18132. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  18133. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  18134. raise salt.exceptions.CommandExecutionError(message["error"])
  18135. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18136. 2020-08-04 12:26:07,689 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  18137. 2020-08-04 12:26:07,691 [spm_conn :82 ][WARNING ][618] Unable to send noop: Expected ack '12' but got '255'
  18138. 2020-08-04 12:26:07,693 [messaging :208 ][ERROR ][618] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  18139. Traceback (most recent call last):
  18140. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  18141. self._call_hook_for(message, "workflow", message)
  18142. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18143. return True, func(*args, **kwargs)
  18144. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  18145. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18146. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18147. return True, func(*args, **kwargs)
  18148. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18149. return func(*args, **kwargs)
  18150. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  18151. conn.heartbeat()
  18152. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  18153. self.noop()
  18154. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  18155. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  18156. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  18157. raise attempt.get()
  18158. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  18159. six.reraise(self.value[0], self.value[1], self.value[2])
  18160. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  18161. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  18162. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  18163. self._begin_message()
  18164. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  18165. self.recv(ack=ACK_MESSAGE_BEGIN)
  18166. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  18167. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  18168. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  18169. raise attempt.get()
  18170. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  18171. six.reraise(self.value[0], self.value[1], self.value[2])
  18172. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  18173. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  18174. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  18175. raise Exception(msg)
  18176. Exception: Expected ack '12' but got '255'
  18177. 2020-08-04 12:26:12,220 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  18178. Traceback (most recent call last):
  18179. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18180. self._serial.open()
  18181. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18182. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18183. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18184. 2020-08-04 12:26:13,237 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  18185. Traceback (most recent call last):
  18186. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18187. self._serial.open()
  18188. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18189. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18190. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18191. 2020-08-04 12:26:14,241 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  18192. Traceback (most recent call last):
  18193. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18194. self._serial.open()
  18195. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18196. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18197. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18198. 2020-08-04 12:26:14,244 [messaging :742 ][ERROR ][615] Exception while processing event: {'tag': 'ec2x/req/1ee75051-b8ad-4434-a638-3b5575a07439', 'data': {'_stamp': '2020-08-04T12:26:12.213748', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/1ee75051-b8ad-4434-a638-3b5575a07439', 'kwargs': {'cooldown_delay': None}}}
  18199. Traceback (most recent call last):
  18200. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  18201. res = self.process(message)
  18202. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  18203. result = func(message, **settings)
  18204. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  18205. found, result = self._call_hook_for(message, "workflow", message)
  18206. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18207. return True, func(*args, **kwargs)
  18208. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  18209. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18210. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18211. return True, func(*args, **kwargs)
  18212. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18213. return func(*args, **kwargs)
  18214. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  18215. return _exec(cmd, **kwargs)
  18216. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  18217. conn.write_line(cmd)
  18218. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  18219. self.ensure_open()
  18220. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  18221. self.open()
  18222. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  18223. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  18224. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  18225. raise attempt.get()
  18226. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  18227. six.reraise(self.value[0], self.value[1], self.value[2])
  18228. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  18229. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  18230. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18231. self._serial.open()
  18232. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18233. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18234. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18235. 2020-08-04 12:26:14,276 [messaging :206 ][ERROR ][616] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  18236. Traceback (most recent call last):
  18237. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  18238. self._call_hook_for(message, "workflow", message)
  18239. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18240. return True, func(*args, **kwargs)
  18241. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  18242. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18243. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18244. return True, func(*args, **kwargs)
  18245. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18246. return func(*args, **kwargs)
  18247. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  18248. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  18249. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  18250. res = query("AT+QGPSLOC={:d}".format(mode))
  18251. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  18252. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  18253. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  18254. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  18255. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  18256. raise salt.exceptions.CommandExecutionError(message["error"])
  18257. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18258. 2020-08-04 12:26:19,297 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  18259. Traceback (most recent call last):
  18260. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18261. self._serial.open()
  18262. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18263. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18264. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18265. 2020-08-04 12:26:20,301 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  18266. Traceback (most recent call last):
  18267. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18268. self._serial.open()
  18269. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18270. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18271. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18272. 2020-08-04 12:26:21,306 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  18273. Traceback (most recent call last):
  18274. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18275. self._serial.open()
  18276. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18277. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18278. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18279. 2020-08-04 12:26:21,309 [messaging :742 ][ERROR ][615] Exception while processing event: {'tag': 'ec2x/req/433e805c-1cf9-4caf-b0db-ea3ff0bebc25', 'data': {'_stamp': '2020-08-04T12:26:19.289158', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/433e805c-1cf9-4caf-b0db-ea3ff0bebc25', 'kwargs': {'cooldown_delay': None}}}
  18280. Traceback (most recent call last):
  18281. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  18282. res = self.process(message)
  18283. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  18284. result = func(message, **settings)
  18285. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  18286. found, result = self._call_hook_for(message, "workflow", message)
  18287. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18288. return True, func(*args, **kwargs)
  18289. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  18290. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18291. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18292. return True, func(*args, **kwargs)
  18293. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18294. return func(*args, **kwargs)
  18295. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  18296. return _exec(cmd, **kwargs)
  18297. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  18298. conn.write_line(cmd)
  18299. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  18300. self.ensure_open()
  18301. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  18302. self.open()
  18303. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  18304. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  18305. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  18306. raise attempt.get()
  18307. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  18308. six.reraise(self.value[0], self.value[1], self.value[2])
  18309. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  18310. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  18311. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18312. self._serial.open()
  18313. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18314. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18315. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18316. 2020-08-04 12:26:21,327 [messaging :206 ][ERROR ][616] Recurring exception (3 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  18317. Traceback (most recent call last):
  18318. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  18319. self._call_hook_for(message, "workflow", message)
  18320. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18321. return True, func(*args, **kwargs)
  18322. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  18323. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18324. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18325. return True, func(*args, **kwargs)
  18326. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18327. return func(*args, **kwargs)
  18328. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  18329. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  18330. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  18331. res = query("AT+QGPSLOC={:d}".format(mode))
  18332. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  18333. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  18334. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  18335. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  18336. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  18337. raise salt.exceptions.CommandExecutionError(message["error"])
  18338. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18339. 2020-08-04 12:26:21,859 [obd.obd :107 ][ERROR ][705] Failed to use explicit port '/dev/serial0'
  18340. Traceback (most recent call last):
  18341. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  18342. self.interface.open(baudrate, protocol=protocol)
  18343. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  18344. self.set_protocol(prot.pop("id", None), **prot)
  18345. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  18346. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  18347. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  18348. self._protocol = self._auto_protocol(**kwargs)
  18349. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  18350. res_0100 = self._verify_protocol("auto", test=not verify)
  18351. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  18352. for line in self.query("0100", parse=False, read_timeout=10):
  18353. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  18354. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  18355. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  18356. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  18357. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  18358. data = self._port.read(self._port.in_waiting or 1)
  18359. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  18360. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  18361. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  18362. sys.exit(salt.defaults.exitcodes.EX_OK)
  18363. SystemExit: 0
  18364. 2020-08-04 12:26:21,886 [obd.obd :120 ][WARNING ][705] Cannot load commands - no connection to bus
  18365. 2020-08-04 12:26:21,919 [obd.interfaces.elm327:730 ][ERROR ][705] Failed to relay command 'STSLCS' to interface
  18366. Traceback (most recent call last):
  18367. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  18368. lines = self.send(cmd, raw_response=raw_response)
  18369. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  18370. raise ELM327Error(self.ERRORS[line], code=line)
  18371. ELM327Error: Operation interrupted by a received RS232 character
  18372. 2020-08-04 12:26:21,922 [messaging :742 ][ERROR ][705] Exception while processing event: {'tag': 'obd/req/6ccf6b4c-82a7-47bd-94fd-800b6abfb117', 'data': {'_stamp': '2020-08-04T12:26:16.320596', 'handler': 'execute', '_event_tag': 'obd/req/6ccf6b4c-82a7-47bd-94fd-800b6abfb117', 'args': ['STSLCS']}}
  18373. Traceback (most recent call last):
  18374. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  18375. res = self.process(message)
  18376. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  18377. result = func(message, **settings)
  18378. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  18379. found, result = self._call_hook_for(message, "workflow", message)
  18380. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18381. return True, func(*args, **kwargs)
  18382. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  18383. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18384. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18385. return True, func(*args, **kwargs)
  18386. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18387. return func(*args, **kwargs)
  18388. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  18389. res = conn.execute(cmd)
  18390. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  18391. return func(self, *args, **kwargs)
  18392. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  18393. return self._obd.execute(cmd, **kwargs)
  18394. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  18395. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  18396. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  18397. lines = self.send(cmd, raw_response=raw_response)
  18398. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  18399. raise ELM327Error(self.ERRORS[line], code=line)
  18400. ELM327Error: Operation interrupted by a received RS232 character
  18401. 2020-08-04 12:26:22,710 [salt.utils.parsers:1050][WARNING ][414] Minion received a SIGTERM. Exiting.
  18402. 2020-08-04 12:26:23,250 [messaging :871 ][WARNING ][815] No reply message with tag 'obd/res/6ccf6b4c-82a7-47bd-94fd-800b6abfb117' received within timeout of 30 secs
  18403. 2020-08-04 12:26:23,253 [salt.state :292 ][ERROR ][815] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  18404. 2020-08-04 12:26:40,037 [gpio_spi_conn :42 ][WARNING ][634] Unable to clear buffer - got unexpected value: 255
  18405. 2020-08-04 12:26:40,054 [gpio_spi_conn :42 ][WARNING ][634] Unable to clear buffer - got unexpected value: 255
  18406. 2020-08-04 12:26:40,065 [gpio_spi_conn :42 ][WARNING ][634] Unable to clear buffer - got unexpected value: 255
  18407. 2020-08-04 12:26:40,696 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  18408. Traceback (most recent call last):
  18409. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18410. self._serial.open()
  18411. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18412. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18413. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18414. 2020-08-04 12:26:41,708 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  18415. Traceback (most recent call last):
  18416. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18417. self._serial.open()
  18418. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18419. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18420. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18421. 2020-08-04 12:26:42,097 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  18422. 2020-08-04 12:26:42,600 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  18423. 2020-08-04 12:26:42,712 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  18424. Traceback (most recent call last):
  18425. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18426. self._serial.open()
  18427. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18428. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18429. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18430. 2020-08-04 12:26:43,103 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  18431. 2020-08-04 12:26:43,105 [spm_conn :139 ][WARNING ][634] Unable to get status: Expected ack '12' but got '255'
  18432. 2020-08-04 12:26:43,267 [messaging :208 ][ERROR ][631] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  18433. Traceback (most recent call last):
  18434. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  18435. self._call_hook_for(message, "workflow", message)
  18436. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18437. return True, func(*args, **kwargs)
  18438. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  18439. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18440. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18441. return True, func(*args, **kwargs)
  18442. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18443. return func(*args, **kwargs)
  18444. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  18445. res = _exec("AT+CCLK?")
  18446. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  18447. conn.write_line(cmd)
  18448. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  18449. self.ensure_open()
  18450. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  18451. self.open()
  18452. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  18453. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  18454. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  18455. raise attempt.get()
  18456. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  18457. six.reraise(self.value[0], self.value[1], self.value[2])
  18458. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  18459. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  18460. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18461. self._serial.open()
  18462. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18463. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18464. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18465. 2020-08-04 12:26:43,609 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  18466. 2020-08-04 12:26:58,231 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  18467. Traceback (most recent call last):
  18468. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18469. self._serial.open()
  18470. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18471. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18472. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18473. 2020-08-04 12:26:58,609 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  18474. 2020-08-04 12:26:59,113 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  18475. 2020-08-04 12:26:59,115 [spm_conn :139 ][WARNING ][634] Unable to get status: Expected ack '12' but got '255'
  18476. 2020-08-04 12:26:59,236 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  18477. Traceback (most recent call last):
  18478. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18479. self._serial.open()
  18480. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18481. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18482. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18483. 2020-08-04 12:26:59,619 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  18484. 2020-08-04 12:27:00,123 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  18485. 2020-08-04 12:27:00,239 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  18486. Traceback (most recent call last):
  18487. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18488. self._serial.open()
  18489. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18490. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18491. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18492. 2020-08-04 12:27:00,242 [messaging :206 ][ERROR ][631] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  18493. Traceback (most recent call last):
  18494. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  18495. self._call_hook_for(message, "workflow", message)
  18496. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18497. return True, func(*args, **kwargs)
  18498. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  18499. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18500. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18501. return True, func(*args, **kwargs)
  18502. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18503. return func(*args, **kwargs)
  18504. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  18505. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  18506. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  18507. conn.write_line(cmd)
  18508. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  18509. self.ensure_open()
  18510. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  18511. self.open()
  18512. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  18513. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  18514. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  18515. raise attempt.get()
  18516. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  18517. six.reraise(self.value[0], self.value[1], self.value[2])
  18518. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  18519. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  18520. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18521. self._serial.open()
  18522. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18523. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18524. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18525. 2020-08-04 12:27:00,627 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  18526. 2020-08-04 12:27:00,629 [spm_conn :139 ][WARNING ][634] Unable to get status: Expected ack '12' but got '255'
  18527. 2020-08-04 12:27:00,635 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  18528. 2020-08-04 12:27:01,138 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  18529. 2020-08-04 12:27:01,643 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  18530. 2020-08-04 12:27:01,646 [spm_conn :82 ][WARNING ][634] Unable to send noop: Expected ack '12' but got '255'
  18531. 2020-08-04 12:27:02,128 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  18532. Traceback (most recent call last):
  18533. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18534. self._serial.open()
  18535. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18536. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18537. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18538. 2020-08-04 12:27:02,151 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  18539. 2020-08-04 12:27:02,657 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  18540. 2020-08-04 12:27:03,132 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  18541. Traceback (most recent call last):
  18542. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18543. self._serial.open()
  18544. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18545. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18546. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18547. 2020-08-04 12:27:03,161 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  18548. 2020-08-04 12:27:03,163 [spm_conn :82 ][WARNING ][634] Unable to send noop: Expected ack '12' but got '255'
  18549. 2020-08-04 12:27:03,667 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  18550. 2020-08-04 12:27:04,137 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  18551. Traceback (most recent call last):
  18552. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18553. self._serial.open()
  18554. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18555. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18556. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18557. 2020-08-04 12:27:04,141 [messaging :742 ][ERROR ][631] Exception while processing event: {'tag': 'ec2x/req/4a14ddc7-c438-4176-9042-a16af2da51e1', 'data': {'_stamp': '2020-08-04T12:26:40.129419', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/4a14ddc7-c438-4176-9042-a16af2da51e1', 'kwargs': {'cooldown_delay': None}}}
  18558. Traceback (most recent call last):
  18559. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  18560. res = self.process(message)
  18561. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  18562. result = func(message, **settings)
  18563. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  18564. found, result = self._call_hook_for(message, "workflow", message)
  18565. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18566. return True, func(*args, **kwargs)
  18567. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  18568. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18569. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18570. return True, func(*args, **kwargs)
  18571. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18572. return func(*args, **kwargs)
  18573. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  18574. return _exec(cmd, **kwargs)
  18575. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  18576. conn.write_line(cmd)
  18577. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  18578. self.ensure_open()
  18579. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  18580. self.open()
  18581. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  18582. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  18583. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  18584. raise attempt.get()
  18585. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  18586. six.reraise(self.value[0], self.value[1], self.value[2])
  18587. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  18588. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  18589. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18590. self._serial.open()
  18591. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18592. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18593. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18594. 2020-08-04 12:27:04,171 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  18595. 2020-08-04 12:27:04,674 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  18596. 2020-08-04 12:27:04,677 [spm_conn :82 ][WARNING ][634] Unable to send noop: Expected ack '12' but got '255'
  18597. 2020-08-04 12:27:04,680 [messaging :208 ][ERROR ][634] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  18598. Traceback (most recent call last):
  18599. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  18600. self._call_hook_for(message, "workflow", message)
  18601. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18602. return True, func(*args, **kwargs)
  18603. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  18604. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18605. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18606. return True, func(*args, **kwargs)
  18607. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18608. return func(*args, **kwargs)
  18609. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  18610. conn.heartbeat()
  18611. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  18612. self.noop()
  18613. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  18614. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  18615. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  18616. raise attempt.get()
  18617. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  18618. six.reraise(self.value[0], self.value[1], self.value[2])
  18619. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  18620. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  18621. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  18622. self._begin_message()
  18623. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  18624. self.recv(ack=ACK_MESSAGE_BEGIN)
  18625. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  18626. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  18627. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  18628. raise attempt.get()
  18629. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  18630. six.reraise(self.value[0], self.value[1], self.value[2])
  18631. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  18632. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  18633. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  18634. raise Exception(msg)
  18635. Exception: Expected ack '12' but got '255'
  18636. 2020-08-04 12:27:06,321 [messaging :208 ][ERROR ][632] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  18637. Traceback (most recent call last):
  18638. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  18639. self._call_hook_for(message, "workflow", message)
  18640. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18641. return True, func(*args, **kwargs)
  18642. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  18643. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18644. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18645. return True, func(*args, **kwargs)
  18646. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18647. return func(*args, **kwargs)
  18648. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  18649. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  18650. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  18651. res = query("AT+QGPSLOC={:d}".format(mode))
  18652. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  18653. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  18654. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  18655. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  18656. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  18657. raise salt.exceptions.CommandExecutionError(message["error"])
  18658. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18659. 2020-08-04 12:27:11,356 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  18660. Traceback (most recent call last):
  18661. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18662. self._serial.open()
  18663. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18664. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18665. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18666. 2020-08-04 12:27:12,373 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  18667. Traceback (most recent call last):
  18668. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18669. self._serial.open()
  18670. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18671. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18672. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18673. 2020-08-04 12:27:13,379 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  18674. Traceback (most recent call last):
  18675. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18676. self._serial.open()
  18677. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18678. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18679. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18680. 2020-08-04 12:27:13,382 [messaging :742 ][ERROR ][631] Exception while processing event: {'tag': 'ec2x/req/fad0d5a9-8cce-4f83-ad38-23845ac23793', 'data': {'_stamp': '2020-08-04T12:27:11.349334', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/fad0d5a9-8cce-4f83-ad38-23845ac23793', 'kwargs': {'cooldown_delay': None}}}
  18681. Traceback (most recent call last):
  18682. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  18683. res = self.process(message)
  18684. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  18685. result = func(message, **settings)
  18686. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  18687. found, result = self._call_hook_for(message, "workflow", message)
  18688. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18689. return True, func(*args, **kwargs)
  18690. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  18691. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18692. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18693. return True, func(*args, **kwargs)
  18694. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18695. return func(*args, **kwargs)
  18696. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  18697. return _exec(cmd, **kwargs)
  18698. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  18699. conn.write_line(cmd)
  18700. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  18701. self.ensure_open()
  18702. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  18703. self.open()
  18704. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  18705. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  18706. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  18707. raise attempt.get()
  18708. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  18709. six.reraise(self.value[0], self.value[1], self.value[2])
  18710. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  18711. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  18712. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18713. self._serial.open()
  18714. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18715. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18716. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18717. 2020-08-04 12:27:13,408 [messaging :206 ][ERROR ][632] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  18718. Traceback (most recent call last):
  18719. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  18720. self._call_hook_for(message, "workflow", message)
  18721. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18722. return True, func(*args, **kwargs)
  18723. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  18724. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18725. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18726. return True, func(*args, **kwargs)
  18727. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18728. return func(*args, **kwargs)
  18729. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  18730. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  18731. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  18732. res = query("AT+QGPSLOC={:d}".format(mode))
  18733. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  18734. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  18735. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  18736. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  18737. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  18738. raise salt.exceptions.CommandExecutionError(message["error"])
  18739. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18740. 2020-08-04 12:27:16,888 [obd.obd :107 ][ERROR ][673] Failed to use explicit port '/dev/serial0'
  18741. Traceback (most recent call last):
  18742. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  18743. self.interface.open(baudrate, protocol=protocol)
  18744. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  18745. self.set_protocol(prot.pop("id", None), **prot)
  18746. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  18747. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  18748. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  18749. self._protocol = self._auto_protocol(**kwargs)
  18750. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  18751. res_0100 = self._verify_protocol("auto", test=not verify)
  18752. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  18753. for line in self.query("0100", parse=False, read_timeout=10):
  18754. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  18755. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  18756. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  18757. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  18758. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  18759. data = self._port.read(self._port.in_waiting or 1)
  18760. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  18761. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  18762. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  18763. sys.exit(salt.defaults.exitcodes.EX_OK)
  18764. SystemExit: 0
  18765. 2020-08-04 12:27:16,912 [obd.obd :120 ][WARNING ][673] Cannot load commands - no connection to bus
  18766. 2020-08-04 12:27:16,936 [obd.interfaces.elm327:730 ][ERROR ][673] Failed to relay command 'STSLCS' to interface
  18767. Traceback (most recent call last):
  18768. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  18769. lines = self.send(cmd, raw_response=raw_response)
  18770. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  18771. raise ELM327Error(self.ERRORS[line], code=line)
  18772. ELM327Error: Operation interrupted by a received RS232 character
  18773. 2020-08-04 12:27:16,939 [messaging :742 ][ERROR ][673] Exception while processing event: {'tag': 'obd/req/a4830b28-e1ee-43d5-ba5e-11789359ee5d', 'data': {'_stamp': '2020-08-04T12:27:11.391857', 'handler': 'execute', '_event_tag': 'obd/req/a4830b28-e1ee-43d5-ba5e-11789359ee5d', 'args': ['STSLCS']}}
  18774. Traceback (most recent call last):
  18775. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  18776. res = self.process(message)
  18777. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  18778. result = func(message, **settings)
  18779. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  18780. found, result = self._call_hook_for(message, "workflow", message)
  18781. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18782. return True, func(*args, **kwargs)
  18783. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  18784. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18785. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18786. return True, func(*args, **kwargs)
  18787. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18788. return func(*args, **kwargs)
  18789. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  18790. res = conn.execute(cmd)
  18791. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  18792. return func(self, *args, **kwargs)
  18793. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  18794. return self._obd.execute(cmd, **kwargs)
  18795. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  18796. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  18797. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  18798. lines = self.send(cmd, raw_response=raw_response)
  18799. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  18800. raise ELM327Error(self.ERRORS[line], code=line)
  18801. ELM327Error: Operation interrupted by a received RS232 character
  18802. 2020-08-04 12:27:17,757 [salt.utils.parsers:1050][WARNING ][430] Minion received a SIGTERM. Exiting.
  18803. 2020-08-04 12:27:18,297 [messaging :871 ][WARNING ][831] No reply message with tag 'obd/res/a4830b28-e1ee-43d5-ba5e-11789359ee5d' received within timeout of 30 secs
  18804. 2020-08-04 12:27:18,301 [salt.state :292 ][ERROR ][831] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  18805. 2020-08-04 12:27:35,127 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  18806. 2020-08-04 12:27:35,138 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  18807. 2020-08-04 12:27:35,144 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  18808. 2020-08-04 12:27:35,844 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  18809. Traceback (most recent call last):
  18810. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18811. self._serial.open()
  18812. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18813. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18814. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18815. 2020-08-04 12:27:36,857 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  18816. Traceback (most recent call last):
  18817. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18818. self._serial.open()
  18819. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18820. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18821. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18822. 2020-08-04 12:27:37,177 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  18823. 2020-08-04 12:27:37,680 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  18824. 2020-08-04 12:27:37,861 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  18825. Traceback (most recent call last):
  18826. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18827. self._serial.open()
  18828. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18829. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18830. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18831. 2020-08-04 12:27:38,183 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  18832. 2020-08-04 12:27:38,185 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  18833. 2020-08-04 12:27:38,492 [messaging :208 ][ERROR ][617] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  18834. Traceback (most recent call last):
  18835. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  18836. self._call_hook_for(message, "workflow", message)
  18837. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18838. return True, func(*args, **kwargs)
  18839. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  18840. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18841. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18842. return True, func(*args, **kwargs)
  18843. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18844. return func(*args, **kwargs)
  18845. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  18846. res = _exec("AT+CCLK?")
  18847. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  18848. conn.write_line(cmd)
  18849. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  18850. self.ensure_open()
  18851. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  18852. self.open()
  18853. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  18854. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  18855. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  18856. raise attempt.get()
  18857. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  18858. six.reraise(self.value[0], self.value[1], self.value[2])
  18859. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  18860. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  18861. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18862. self._serial.open()
  18863. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18864. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18865. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18866. 2020-08-04 12:27:38,689 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  18867. 2020-08-04 12:27:53,506 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][657] Timeout after 1.28205128205 second(s) waiting for interrupt
  18868. 2020-08-04 12:27:53,571 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  18869. Traceback (most recent call last):
  18870. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18871. self._serial.open()
  18872. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18873. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18874. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18875. 2020-08-04 12:27:53,736 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  18876. 2020-08-04 12:27:54,239 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  18877. 2020-08-04 12:27:54,241 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  18878. 2020-08-04 12:27:54,576 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  18879. Traceback (most recent call last):
  18880. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18881. self._serial.open()
  18882. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18883. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18884. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18885. 2020-08-04 12:27:54,745 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  18886. 2020-08-04 12:27:55,248 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  18887. 2020-08-04 12:27:55,580 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  18888. Traceback (most recent call last):
  18889. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18890. self._serial.open()
  18891. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18892. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18893. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18894. 2020-08-04 12:27:55,584 [messaging :206 ][ERROR ][617] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  18895. Traceback (most recent call last):
  18896. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  18897. self._call_hook_for(message, "workflow", message)
  18898. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18899. return True, func(*args, **kwargs)
  18900. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  18901. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18902. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18903. return True, func(*args, **kwargs)
  18904. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18905. return func(*args, **kwargs)
  18906. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  18907. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  18908. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  18909. conn.write_line(cmd)
  18910. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  18911. self.ensure_open()
  18912. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  18913. self.open()
  18914. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  18915. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  18916. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  18917. raise attempt.get()
  18918. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  18919. six.reraise(self.value[0], self.value[1], self.value[2])
  18920. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  18921. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  18922. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18923. self._serial.open()
  18924. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18925. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18926. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18927. 2020-08-04 12:27:55,751 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  18928. 2020-08-04 12:27:55,753 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  18929. 2020-08-04 12:27:55,757 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  18930. 2020-08-04 12:27:56,260 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  18931. 2020-08-04 12:27:56,763 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  18932. 2020-08-04 12:27:56,765 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  18933. 2020-08-04 12:27:57,221 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  18934. Traceback (most recent call last):
  18935. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18936. self._serial.open()
  18937. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18938. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18939. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18940. 2020-08-04 12:27:57,270 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  18941. 2020-08-04 12:27:57,779 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  18942. 2020-08-04 12:27:58,225 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  18943. Traceback (most recent call last):
  18944. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18945. self._serial.open()
  18946. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18947. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18948. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18949. 2020-08-04 12:27:58,283 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  18950. 2020-08-04 12:27:58,285 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  18951. 2020-08-04 12:27:58,789 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  18952. 2020-08-04 12:27:59,229 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  18953. Traceback (most recent call last):
  18954. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18955. self._serial.open()
  18956. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18957. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18958. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18959. 2020-08-04 12:27:59,233 [messaging :742 ][ERROR ][617] Exception while processing event: {'tag': 'ec2x/req/babb557d-1fc1-491d-a492-d15fe52bd328', 'data': {'_stamp': '2020-08-04T12:27:35.204200', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/babb557d-1fc1-491d-a492-d15fe52bd328', 'kwargs': {'cooldown_delay': None}}}
  18960. Traceback (most recent call last):
  18961. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  18962. res = self.process(message)
  18963. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  18964. result = func(message, **settings)
  18965. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  18966. found, result = self._call_hook_for(message, "workflow", message)
  18967. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18968. return True, func(*args, **kwargs)
  18969. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  18970. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  18971. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  18972. return True, func(*args, **kwargs)
  18973. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  18974. return func(*args, **kwargs)
  18975. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  18976. return _exec(cmd, **kwargs)
  18977. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  18978. conn.write_line(cmd)
  18979. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  18980. self.ensure_open()
  18981. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  18982. self.open()
  18983. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  18984. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  18985. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  18986. raise attempt.get()
  18987. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  18988. six.reraise(self.value[0], self.value[1], self.value[2])
  18989. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  18990. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  18991. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  18992. self._serial.open()
  18993. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  18994. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  18995. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  18996. 2020-08-04 12:27:59,292 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  18997. 2020-08-04 12:27:59,795 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  18998. 2020-08-04 12:27:59,798 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  18999. 2020-08-04 12:27:59,800 [messaging :208 ][ERROR ][620] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  19000. Traceback (most recent call last):
  19001. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  19002. self._call_hook_for(message, "workflow", message)
  19003. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19004. return True, func(*args, **kwargs)
  19005. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  19006. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19007. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19008. return True, func(*args, **kwargs)
  19009. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19010. return func(*args, **kwargs)
  19011. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  19012. conn.heartbeat()
  19013. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  19014. self.noop()
  19015. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  19016. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  19017. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  19018. raise attempt.get()
  19019. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  19020. six.reraise(self.value[0], self.value[1], self.value[2])
  19021. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  19022. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  19023. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  19024. self._begin_message()
  19025. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  19026. self.recv(ack=ACK_MESSAGE_BEGIN)
  19027. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  19028. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  19029. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  19030. raise attempt.get()
  19031. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  19032. six.reraise(self.value[0], self.value[1], self.value[2])
  19033. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  19034. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  19035. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  19036. raise Exception(msg)
  19037. Exception: Expected ack '12' but got '255'
  19038. 2020-08-04 12:28:01,361 [messaging :208 ][ERROR ][618] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  19039. Traceback (most recent call last):
  19040. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  19041. self._call_hook_for(message, "workflow", message)
  19042. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19043. return True, func(*args, **kwargs)
  19044. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  19045. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19046. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19047. return True, func(*args, **kwargs)
  19048. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19049. return func(*args, **kwargs)
  19050. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  19051. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  19052. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  19053. res = query("AT+QGPSLOC={:d}".format(mode))
  19054. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  19055. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  19056. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  19057. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  19058. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  19059. raise salt.exceptions.CommandExecutionError(message["error"])
  19060. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19061. 2020-08-04 12:28:06,419 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  19062. Traceback (most recent call last):
  19063. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19064. self._serial.open()
  19065. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19066. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19067. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19068. 2020-08-04 12:28:07,424 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  19069. Traceback (most recent call last):
  19070. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19071. self._serial.open()
  19072. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19073. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19074. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19075. 2020-08-04 12:28:08,428 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  19076. Traceback (most recent call last):
  19077. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19078. self._serial.open()
  19079. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19080. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19081. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19082. 2020-08-04 12:28:08,431 [messaging :742 ][ERROR ][617] Exception while processing event: {'tag': 'ec2x/req/9d655880-61d0-422b-a13d-1bcedfd1eecc', 'data': {'_stamp': '2020-08-04T12:28:06.407041', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/9d655880-61d0-422b-a13d-1bcedfd1eecc', 'kwargs': {'cooldown_delay': None}}}
  19083. Traceback (most recent call last):
  19084. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  19085. res = self.process(message)
  19086. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  19087. result = func(message, **settings)
  19088. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  19089. found, result = self._call_hook_for(message, "workflow", message)
  19090. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19091. return True, func(*args, **kwargs)
  19092. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  19093. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19094. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19095. return True, func(*args, **kwargs)
  19096. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19097. return func(*args, **kwargs)
  19098. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  19099. return _exec(cmd, **kwargs)
  19100. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  19101. conn.write_line(cmd)
  19102. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  19103. self.ensure_open()
  19104. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  19105. self.open()
  19106. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  19107. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  19108. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  19109. raise attempt.get()
  19110. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  19111. six.reraise(self.value[0], self.value[1], self.value[2])
  19112. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  19113. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  19114. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19115. self._serial.open()
  19116. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19117. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19118. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19119. 2020-08-04 12:28:08,478 [messaging :206 ][ERROR ][618] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  19120. Traceback (most recent call last):
  19121. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  19122. self._call_hook_for(message, "workflow", message)
  19123. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19124. return True, func(*args, **kwargs)
  19125. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  19126. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19127. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19128. return True, func(*args, **kwargs)
  19129. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19130. return func(*args, **kwargs)
  19131. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  19132. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  19133. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  19134. res = query("AT+QGPSLOC={:d}".format(mode))
  19135. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  19136. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  19137. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  19138. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  19139. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  19140. raise salt.exceptions.CommandExecutionError(message["error"])
  19141. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19142. 2020-08-04 12:28:11,734 [obd.obd :107 ][ERROR ][656] Failed to use explicit port '/dev/serial0'
  19143. Traceback (most recent call last):
  19144. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  19145. self.interface.open(baudrate, protocol=protocol)
  19146. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  19147. self.set_protocol(prot.pop("id", None), **prot)
  19148. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  19149. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  19150. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  19151. self._protocol = self._auto_protocol(**kwargs)
  19152. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  19153. res_0100 = self._verify_protocol("auto", test=not verify)
  19154. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  19155. for line in self.query("0100", parse=False, read_timeout=10):
  19156. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  19157. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  19158. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  19159. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  19160. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  19161. data = self._port.read(self._port.in_waiting or 1)
  19162. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  19163. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  19164. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  19165. sys.exit(salt.defaults.exitcodes.EX_OK)
  19166. SystemExit: 0
  19167. 2020-08-04 12:28:11,789 [obd.obd :120 ][WARNING ][656] Cannot load commands - no connection to bus
  19168. 2020-08-04 12:28:11,828 [obd.interfaces.elm327:730 ][ERROR ][656] Failed to relay command 'STSLCS' to interface
  19169. Traceback (most recent call last):
  19170. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  19171. lines = self.send(cmd, raw_response=raw_response)
  19172. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  19173. raise ELM327Error(self.ERRORS[line], code=line)
  19174. ELM327Error: Operation interrupted by a received RS232 character
  19175. 2020-08-04 12:28:11,845 [messaging :742 ][ERROR ][656] Exception while processing event: {'tag': 'obd/req/f4058348-9550-4f9c-847d-41d8a977748f', 'data': {'_stamp': '2020-08-04T12:28:06.240313', 'handler': 'execute', '_event_tag': 'obd/req/f4058348-9550-4f9c-847d-41d8a977748f', 'args': ['STSLCS']}}
  19176. Traceback (most recent call last):
  19177. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  19178. res = self.process(message)
  19179. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  19180. result = func(message, **settings)
  19181. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  19182. found, result = self._call_hook_for(message, "workflow", message)
  19183. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19184. return True, func(*args, **kwargs)
  19185. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  19186. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19187. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19188. return True, func(*args, **kwargs)
  19189. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19190. return func(*args, **kwargs)
  19191. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  19192. res = conn.execute(cmd)
  19193. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  19194. return func(self, *args, **kwargs)
  19195. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  19196. return self._obd.execute(cmd, **kwargs)
  19197. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  19198. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  19199. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  19200. lines = self.send(cmd, raw_response=raw_response)
  19201. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  19202. raise ELM327Error(self.ERRORS[line], code=line)
  19203. ELM327Error: Operation interrupted by a received RS232 character
  19204. 2020-08-04 12:28:12,591 [salt.utils.parsers:1050][WARNING ][415] Minion received a SIGTERM. Exiting.
  19205. 2020-08-04 12:28:13,131 [messaging :871 ][WARNING ][817] No reply message with tag 'obd/res/f4058348-9550-4f9c-847d-41d8a977748f' received within timeout of 30 secs
  19206. 2020-08-04 12:28:13,135 [salt.state :292 ][ERROR ][817] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  19207. 2020-08-04 12:28:30,344 [gpio_spi_conn :42 ][WARNING ][634] Unable to clear buffer - got unexpected value: 255
  19208. 2020-08-04 12:28:30,358 [gpio_spi_conn :42 ][WARNING ][634] Unable to clear buffer - got unexpected value: 255
  19209. 2020-08-04 12:28:30,362 [gpio_spi_conn :42 ][WARNING ][634] Unable to clear buffer - got unexpected value: 255
  19210. 2020-08-04 12:28:31,032 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  19211. Traceback (most recent call last):
  19212. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19213. self._serial.open()
  19214. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19215. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19216. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19217. 2020-08-04 12:28:32,044 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  19218. Traceback (most recent call last):
  19219. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19220. self._serial.open()
  19221. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19222. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19223. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19224. 2020-08-04 12:28:32,396 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  19225. 2020-08-04 12:28:32,901 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  19226. 2020-08-04 12:28:33,049 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  19227. Traceback (most recent call last):
  19228. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19229. self._serial.open()
  19230. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19231. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19232. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19233. 2020-08-04 12:28:33,406 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  19234. 2020-08-04 12:28:33,408 [spm_conn :139 ][WARNING ][634] Unable to get status: Expected ack '12' but got '255'
  19235. 2020-08-04 12:28:33,645 [messaging :208 ][ERROR ][631] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  19236. Traceback (most recent call last):
  19237. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  19238. self._call_hook_for(message, "workflow", message)
  19239. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19240. return True, func(*args, **kwargs)
  19241. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  19242. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19243. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19244. return True, func(*args, **kwargs)
  19245. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19246. return func(*args, **kwargs)
  19247. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  19248. res = _exec("AT+CCLK?")
  19249. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  19250. conn.write_line(cmd)
  19251. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  19252. self.ensure_open()
  19253. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  19254. self.open()
  19255. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  19256. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  19257. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  19258. raise attempt.get()
  19259. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  19260. six.reraise(self.value[0], self.value[1], self.value[2])
  19261. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  19262. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  19263. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19264. self._serial.open()
  19265. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19266. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19267. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19268. 2020-08-04 12:28:33,912 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  19269. 2020-08-04 12:28:48,635 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][722] Timeout after 1.28205128205 second(s) waiting for interrupt
  19270. 2020-08-04 12:28:48,699 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  19271. Traceback (most recent call last):
  19272. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19273. self._serial.open()
  19274. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19275. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19276. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19277. 2020-08-04 12:28:48,971 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  19278. 2020-08-04 12:28:49,473 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  19279. 2020-08-04 12:28:49,478 [spm_conn :139 ][WARNING ][634] Unable to get status: Expected ack '12' but got '255'
  19280. 2020-08-04 12:28:49,704 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  19281. Traceback (most recent call last):
  19282. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19283. self._serial.open()
  19284. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19285. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19286. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19287. 2020-08-04 12:28:49,995 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  19288. 2020-08-04 12:28:50,498 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  19289. 2020-08-04 12:28:50,708 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  19290. Traceback (most recent call last):
  19291. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19292. self._serial.open()
  19293. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19294. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19295. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19296. 2020-08-04 12:28:50,711 [messaging :206 ][ERROR ][631] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  19297. Traceback (most recent call last):
  19298. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  19299. self._call_hook_for(message, "workflow", message)
  19300. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19301. return True, func(*args, **kwargs)
  19302. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  19303. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19304. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19305. return True, func(*args, **kwargs)
  19306. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19307. return func(*args, **kwargs)
  19308. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  19309. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  19310. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  19311. conn.write_line(cmd)
  19312. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  19313. self.ensure_open()
  19314. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  19315. self.open()
  19316. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  19317. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  19318. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  19319. raise attempt.get()
  19320. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  19321. six.reraise(self.value[0], self.value[1], self.value[2])
  19322. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  19323. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  19324. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19325. self._serial.open()
  19326. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19327. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19328. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19329. 2020-08-04 12:28:51,001 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  19330. 2020-08-04 12:28:51,003 [spm_conn :139 ][WARNING ][634] Unable to get status: Expected ack '12' but got '255'
  19331. 2020-08-04 12:28:51,007 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  19332. 2020-08-04 12:28:51,510 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  19333. 2020-08-04 12:28:52,013 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  19334. 2020-08-04 12:28:52,016 [spm_conn :82 ][WARNING ][634] Unable to send noop: Expected ack '12' but got '255'
  19335. 2020-08-04 12:28:52,465 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  19336. Traceback (most recent call last):
  19337. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19338. self._serial.open()
  19339. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19340. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19341. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19342. 2020-08-04 12:28:52,520 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  19343. 2020-08-04 12:28:53,024 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  19344. 2020-08-04 12:28:53,469 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  19345. Traceback (most recent call last):
  19346. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19347. self._serial.open()
  19348. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19349. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19350. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19351. 2020-08-04 12:28:53,527 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  19352. 2020-08-04 12:28:53,529 [spm_conn :82 ][WARNING ][634] Unable to send noop: Expected ack '12' but got '255'
  19353. 2020-08-04 12:28:54,033 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  19354. 2020-08-04 12:28:54,473 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  19355. Traceback (most recent call last):
  19356. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19357. self._serial.open()
  19358. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19359. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19360. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19361. 2020-08-04 12:28:54,485 [messaging :742 ][ERROR ][631] Exception while processing event: {'tag': 'ec2x/req/6a228017-fbf0-436d-8203-3fcf5d3f1559', 'data': {'_stamp': '2020-08-04T12:28:30.427988', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/6a228017-fbf0-436d-8203-3fcf5d3f1559', 'kwargs': {'cooldown_delay': None}}}
  19362. Traceback (most recent call last):
  19363. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  19364. res = self.process(message)
  19365. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  19366. result = func(message, **settings)
  19367. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  19368. found, result = self._call_hook_for(message, "workflow", message)
  19369. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19370. return True, func(*args, **kwargs)
  19371. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  19372. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19373. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19374. return True, func(*args, **kwargs)
  19375. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19376. return func(*args, **kwargs)
  19377. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  19378. return _exec(cmd, **kwargs)
  19379. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  19380. conn.write_line(cmd)
  19381. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  19382. self.ensure_open()
  19383. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  19384. self.open()
  19385. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  19386. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  19387. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  19388. raise attempt.get()
  19389. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  19390. six.reraise(self.value[0], self.value[1], self.value[2])
  19391. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  19392. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  19393. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19394. self._serial.open()
  19395. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19396. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19397. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19398. 2020-08-04 12:28:54,536 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  19399. 2020-08-04 12:28:55,040 [gpio_spi_conn :109 ][WARNING ][634] Expected ack '12' but got '255'
  19400. 2020-08-04 12:28:55,042 [spm_conn :82 ][WARNING ][634] Unable to send noop: Expected ack '12' but got '255'
  19401. 2020-08-04 12:28:55,045 [messaging :208 ][ERROR ][634] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  19402. Traceback (most recent call last):
  19403. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  19404. self._call_hook_for(message, "workflow", message)
  19405. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19406. return True, func(*args, **kwargs)
  19407. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  19408. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19409. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19410. return True, func(*args, **kwargs)
  19411. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19412. return func(*args, **kwargs)
  19413. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  19414. conn.heartbeat()
  19415. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  19416. self.noop()
  19417. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  19418. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  19419. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  19420. raise attempt.get()
  19421. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  19422. six.reraise(self.value[0], self.value[1], self.value[2])
  19423. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  19424. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  19425. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  19426. self._begin_message()
  19427. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  19428. self.recv(ack=ACK_MESSAGE_BEGIN)
  19429. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  19430. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  19431. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  19432. raise attempt.get()
  19433. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  19434. six.reraise(self.value[0], self.value[1], self.value[2])
  19435. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  19436. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  19437. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  19438. raise Exception(msg)
  19439. Exception: Expected ack '12' but got '255'
  19440. 2020-08-04 12:28:56,697 [messaging :208 ][ERROR ][632] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  19441. Traceback (most recent call last):
  19442. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  19443. self._call_hook_for(message, "workflow", message)
  19444. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19445. return True, func(*args, **kwargs)
  19446. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  19447. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19448. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19449. return True, func(*args, **kwargs)
  19450. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19451. return func(*args, **kwargs)
  19452. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  19453. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  19454. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  19455. res = query("AT+QGPSLOC={:d}".format(mode))
  19456. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  19457. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  19458. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  19459. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  19460. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  19461. raise salt.exceptions.CommandExecutionError(message["error"])
  19462. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19463. 2020-08-04 12:29:01,788 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  19464. Traceback (most recent call last):
  19465. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19466. self._serial.open()
  19467. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19468. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19469. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19470. 2020-08-04 12:29:02,792 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  19471. Traceback (most recent call last):
  19472. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19473. self._serial.open()
  19474. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19475. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19476. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19477. 2020-08-04 12:29:03,796 [serial_conn :79 ][ERROR ][631] Failed to open serial connection
  19478. Traceback (most recent call last):
  19479. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19480. self._serial.open()
  19481. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19482. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19483. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19484. 2020-08-04 12:29:03,799 [messaging :742 ][ERROR ][631] Exception while processing event: {'tag': 'ec2x/req/be272f41-c408-4a10-b2c3-9d6ffef0175f', 'data': {'_stamp': '2020-08-04T12:29:01.780108', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/be272f41-c408-4a10-b2c3-9d6ffef0175f', 'kwargs': {'cooldown_delay': None}}}
  19485. Traceback (most recent call last):
  19486. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  19487. res = self.process(message)
  19488. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  19489. result = func(message, **settings)
  19490. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  19491. found, result = self._call_hook_for(message, "workflow", message)
  19492. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19493. return True, func(*args, **kwargs)
  19494. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  19495. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19496. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19497. return True, func(*args, **kwargs)
  19498. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19499. return func(*args, **kwargs)
  19500. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  19501. return _exec(cmd, **kwargs)
  19502. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  19503. conn.write_line(cmd)
  19504. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  19505. self.ensure_open()
  19506. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  19507. self.open()
  19508. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  19509. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  19510. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  19511. raise attempt.get()
  19512. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  19513. six.reraise(self.value[0], self.value[1], self.value[2])
  19514. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  19515. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  19516. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19517. self._serial.open()
  19518. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19519. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19520. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19521. 2020-08-04 12:29:03,833 [messaging :206 ][ERROR ][632] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  19522. Traceback (most recent call last):
  19523. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  19524. self._call_hook_for(message, "workflow", message)
  19525. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19526. return True, func(*args, **kwargs)
  19527. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  19528. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19529. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19530. return True, func(*args, **kwargs)
  19531. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19532. return func(*args, **kwargs)
  19533. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  19534. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  19535. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  19536. res = query("AT+QGPSLOC={:d}".format(mode))
  19537. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  19538. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  19539. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  19540. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  19541. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  19542. raise salt.exceptions.CommandExecutionError(message["error"])
  19543. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19544. 2020-08-04 12:29:07,033 [obd.obd :107 ][ERROR ][720] Failed to use explicit port '/dev/serial0'
  19545. Traceback (most recent call last):
  19546. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  19547. self.interface.open(baudrate, protocol=protocol)
  19548. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  19549. self.set_protocol(prot.pop("id", None), **prot)
  19550. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  19551. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  19552. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  19553. self._protocol = self._auto_protocol(**kwargs)
  19554. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  19555. res_0100 = self._verify_protocol("auto", test=not verify)
  19556. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  19557. for line in self.query("0100", parse=False, read_timeout=10):
  19558. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  19559. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  19560. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  19561. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  19562. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  19563. data = self._port.read(self._port.in_waiting or 1)
  19564. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  19565. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  19566. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  19567. sys.exit(salt.defaults.exitcodes.EX_OK)
  19568. SystemExit: 0
  19569. 2020-08-04 12:29:07,070 [obd.obd :120 ][WARNING ][720] Cannot load commands - no connection to bus
  19570. 2020-08-04 12:29:07,095 [obd.interfaces.elm327:730 ][ERROR ][720] Failed to relay command 'STSLCS' to interface
  19571. Traceback (most recent call last):
  19572. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  19573. lines = self.send(cmd, raw_response=raw_response)
  19574. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  19575. raise ELM327Error(self.ERRORS[line], code=line)
  19576. ELM327Error: Operation interrupted by a received RS232 character
  19577. 2020-08-04 12:29:07,098 [messaging :742 ][ERROR ][720] Exception while processing event: {'tag': 'obd/req/758cb3f9-61f7-4cec-8a68-3d5c3f7c33b2', 'data': {'_stamp': '2020-08-04T12:29:01.576803', 'handler': 'execute', '_event_tag': 'obd/req/758cb3f9-61f7-4cec-8a68-3d5c3f7c33b2', 'args': ['STSLCS']}}
  19578. Traceback (most recent call last):
  19579. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  19580. res = self.process(message)
  19581. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  19582. result = func(message, **settings)
  19583. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  19584. found, result = self._call_hook_for(message, "workflow", message)
  19585. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19586. return True, func(*args, **kwargs)
  19587. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  19588. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19589. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19590. return True, func(*args, **kwargs)
  19591. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19592. return func(*args, **kwargs)
  19593. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  19594. res = conn.execute(cmd)
  19595. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  19596. return func(self, *args, **kwargs)
  19597. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  19598. return self._obd.execute(cmd, **kwargs)
  19599. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  19600. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  19601. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  19602. lines = self.send(cmd, raw_response=raw_response)
  19603. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  19604. raise ELM327Error(self.ERRORS[line], code=line)
  19605. ELM327Error: Operation interrupted by a received RS232 character
  19606. 2020-08-04 12:29:07,864 [salt.utils.parsers:1050][WARNING ][435] Minion received a SIGTERM. Exiting.
  19607. 2020-08-04 12:29:08,401 [messaging :871 ][WARNING ][831] No reply message with tag 'obd/res/758cb3f9-61f7-4cec-8a68-3d5c3f7c33b2' received within timeout of 30 secs
  19608. 2020-08-04 12:29:08,405 [salt.state :292 ][ERROR ][831] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  19609. 2020-08-04 12:29:25,199 [gpio_spi_conn :42 ][WARNING ][618] Unable to clear buffer - got unexpected value: 255
  19610. 2020-08-04 12:29:25,211 [gpio_spi_conn :42 ][WARNING ][618] Unable to clear buffer - got unexpected value: 255
  19611. 2020-08-04 12:29:25,219 [gpio_spi_conn :42 ][WARNING ][618] Unable to clear buffer - got unexpected value: 255
  19612. 2020-08-04 12:29:25,877 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  19613. Traceback (most recent call last):
  19614. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19615. self._serial.open()
  19616. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19617. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19618. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19619. 2020-08-04 12:29:26,892 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  19620. Traceback (most recent call last):
  19621. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19622. self._serial.open()
  19623. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19624. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19625. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19626. 2020-08-04 12:29:27,259 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  19627. 2020-08-04 12:29:27,764 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  19628. 2020-08-04 12:29:27,896 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  19629. Traceback (most recent call last):
  19630. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19631. self._serial.open()
  19632. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19633. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19634. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19635. 2020-08-04 12:29:28,270 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  19636. 2020-08-04 12:29:28,272 [spm_conn :139 ][WARNING ][618] Unable to get status: Expected ack '12' but got '255'
  19637. 2020-08-04 12:29:28,516 [messaging :208 ][ERROR ][615] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  19638. Traceback (most recent call last):
  19639. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  19640. self._call_hook_for(message, "workflow", message)
  19641. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19642. return True, func(*args, **kwargs)
  19643. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  19644. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19645. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19646. return True, func(*args, **kwargs)
  19647. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19648. return func(*args, **kwargs)
  19649. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  19650. res = _exec("AT+CCLK?")
  19651. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  19652. conn.write_line(cmd)
  19653. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  19654. self.ensure_open()
  19655. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  19656. self.open()
  19657. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  19658. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  19659. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  19660. raise attempt.get()
  19661. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  19662. six.reraise(self.value[0], self.value[1], self.value[2])
  19663. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  19664. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  19665. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19666. self._serial.open()
  19667. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19668. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19669. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19670. 2020-08-04 12:29:28,779 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  19671. 2020-08-04 12:29:43,592 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][705] Timeout after 1.28205128205 second(s) waiting for interrupt
  19672. 2020-08-04 12:29:43,653 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  19673. Traceback (most recent call last):
  19674. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19675. self._serial.open()
  19676. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19677. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19678. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19679. 2020-08-04 12:29:43,955 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  19680. 2020-08-04 12:29:44,458 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  19681. 2020-08-04 12:29:44,460 [spm_conn :139 ][WARNING ][618] Unable to get status: Expected ack '12' but got '255'
  19682. 2020-08-04 12:29:44,658 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  19683. Traceback (most recent call last):
  19684. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19685. self._serial.open()
  19686. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19687. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19688. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19689. 2020-08-04 12:29:44,964 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  19690. 2020-08-04 12:29:45,468 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  19691. 2020-08-04 12:29:45,663 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  19692. Traceback (most recent call last):
  19693. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19694. self._serial.open()
  19695. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19696. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19697. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19698. 2020-08-04 12:29:45,666 [messaging :206 ][ERROR ][615] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  19699. Traceback (most recent call last):
  19700. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  19701. self._call_hook_for(message, "workflow", message)
  19702. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19703. return True, func(*args, **kwargs)
  19704. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  19705. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19706. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19707. return True, func(*args, **kwargs)
  19708. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19709. return func(*args, **kwargs)
  19710. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  19711. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  19712. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  19713. conn.write_line(cmd)
  19714. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  19715. self.ensure_open()
  19716. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  19717. self.open()
  19718. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  19719. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  19720. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  19721. raise attempt.get()
  19722. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  19723. six.reraise(self.value[0], self.value[1], self.value[2])
  19724. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  19725. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  19726. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19727. self._serial.open()
  19728. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19729. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19730. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19731. 2020-08-04 12:29:45,973 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  19732. 2020-08-04 12:29:45,975 [spm_conn :139 ][WARNING ][618] Unable to get status: Expected ack '12' but got '255'
  19733. 2020-08-04 12:29:45,980 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  19734. 2020-08-04 12:29:46,483 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  19735. 2020-08-04 12:29:46,986 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  19736. 2020-08-04 12:29:46,993 [spm_conn :82 ][WARNING ][618] Unable to send noop: Expected ack '12' but got '255'
  19737. 2020-08-04 12:29:47,320 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  19738. Traceback (most recent call last):
  19739. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19740. self._serial.open()
  19741. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19742. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19743. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19744. 2020-08-04 12:29:47,502 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  19745. 2020-08-04 12:29:48,006 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  19746. 2020-08-04 12:29:48,325 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  19747. Traceback (most recent call last):
  19748. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19749. self._serial.open()
  19750. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19751. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19752. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19753. 2020-08-04 12:29:48,509 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  19754. 2020-08-04 12:29:48,512 [spm_conn :82 ][WARNING ][618] Unable to send noop: Expected ack '12' but got '255'
  19755. 2020-08-04 12:29:49,015 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  19756. 2020-08-04 12:29:49,329 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  19757. Traceback (most recent call last):
  19758. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19759. self._serial.open()
  19760. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19761. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19762. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19763. 2020-08-04 12:29:49,332 [messaging :742 ][ERROR ][615] Exception while processing event: {'tag': 'ec2x/req/c0f19a09-0854-47dd-8538-f20b567f498d', 'data': {'_stamp': '2020-08-04T12:29:25.278041', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/c0f19a09-0854-47dd-8538-f20b567f498d', 'kwargs': {'cooldown_delay': None}}}
  19764. Traceback (most recent call last):
  19765. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  19766. res = self.process(message)
  19767. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  19768. result = func(message, **settings)
  19769. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  19770. found, result = self._call_hook_for(message, "workflow", message)
  19771. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19772. return True, func(*args, **kwargs)
  19773. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  19774. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19775. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19776. return True, func(*args, **kwargs)
  19777. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19778. return func(*args, **kwargs)
  19779. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  19780. return _exec(cmd, **kwargs)
  19781. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  19782. conn.write_line(cmd)
  19783. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  19784. self.ensure_open()
  19785. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  19786. self.open()
  19787. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  19788. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  19789. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  19790. raise attempt.get()
  19791. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  19792. six.reraise(self.value[0], self.value[1], self.value[2])
  19793. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  19794. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  19795. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19796. self._serial.open()
  19797. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19798. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19799. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19800. 2020-08-04 12:29:49,519 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  19801. 2020-08-04 12:29:50,022 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  19802. 2020-08-04 12:29:50,025 [spm_conn :82 ][WARNING ][618] Unable to send noop: Expected ack '12' but got '255'
  19803. 2020-08-04 12:29:50,029 [messaging :208 ][ERROR ][618] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  19804. Traceback (most recent call last):
  19805. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  19806. self._call_hook_for(message, "workflow", message)
  19807. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19808. return True, func(*args, **kwargs)
  19809. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  19810. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19811. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19812. return True, func(*args, **kwargs)
  19813. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19814. return func(*args, **kwargs)
  19815. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  19816. conn.heartbeat()
  19817. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  19818. self.noop()
  19819. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  19820. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  19821. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  19822. raise attempt.get()
  19823. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  19824. six.reraise(self.value[0], self.value[1], self.value[2])
  19825. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  19826. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  19827. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  19828. self._begin_message()
  19829. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  19830. self.recv(ack=ACK_MESSAGE_BEGIN)
  19831. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  19832. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  19833. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  19834. raise attempt.get()
  19835. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  19836. six.reraise(self.value[0], self.value[1], self.value[2])
  19837. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  19838. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  19839. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  19840. raise Exception(msg)
  19841. Exception: Expected ack '12' but got '255'
  19842. 2020-08-04 12:29:51,614 [messaging :208 ][ERROR ][616] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  19843. Traceback (most recent call last):
  19844. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  19845. self._call_hook_for(message, "workflow", message)
  19846. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19847. return True, func(*args, **kwargs)
  19848. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  19849. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19850. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19851. return True, func(*args, **kwargs)
  19852. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19853. return func(*args, **kwargs)
  19854. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  19855. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  19856. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  19857. res = query("AT+QGPSLOC={:d}".format(mode))
  19858. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  19859. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  19860. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  19861. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  19862. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  19863. raise salt.exceptions.CommandExecutionError(message["error"])
  19864. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19865. 2020-08-04 12:29:56,666 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  19866. Traceback (most recent call last):
  19867. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19868. self._serial.open()
  19869. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19870. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19871. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19872. 2020-08-04 12:29:57,671 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  19873. Traceback (most recent call last):
  19874. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19875. self._serial.open()
  19876. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19877. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19878. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19879. 2020-08-04 12:29:58,675 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  19880. Traceback (most recent call last):
  19881. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19882. self._serial.open()
  19883. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19884. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19885. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19886. 2020-08-04 12:29:58,677 [messaging :742 ][ERROR ][615] Exception while processing event: {'tag': 'ec2x/req/2a57d709-5c23-4410-8ea3-a6184b6ac00f', 'data': {'_stamp': '2020-08-04T12:29:56.658598', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/2a57d709-5c23-4410-8ea3-a6184b6ac00f', 'kwargs': {'cooldown_delay': None}}}
  19887. Traceback (most recent call last):
  19888. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  19889. res = self.process(message)
  19890. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  19891. result = func(message, **settings)
  19892. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  19893. found, result = self._call_hook_for(message, "workflow", message)
  19894. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19895. return True, func(*args, **kwargs)
  19896. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  19897. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19898. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19899. return True, func(*args, **kwargs)
  19900. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19901. return func(*args, **kwargs)
  19902. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  19903. return _exec(cmd, **kwargs)
  19904. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  19905. conn.write_line(cmd)
  19906. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  19907. self.ensure_open()
  19908. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  19909. self.open()
  19910. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  19911. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  19912. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  19913. raise attempt.get()
  19914. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  19915. six.reraise(self.value[0], self.value[1], self.value[2])
  19916. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  19917. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  19918. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  19919. self._serial.open()
  19920. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  19921. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  19922. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19923. 2020-08-04 12:29:58,707 [messaging :206 ][ERROR ][616] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  19924. Traceback (most recent call last):
  19925. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  19926. self._call_hook_for(message, "workflow", message)
  19927. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19928. return True, func(*args, **kwargs)
  19929. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  19930. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19931. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19932. return True, func(*args, **kwargs)
  19933. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19934. return func(*args, **kwargs)
  19935. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  19936. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  19937. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  19938. res = query("AT+QGPSLOC={:d}".format(mode))
  19939. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  19940. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  19941. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  19942. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  19943. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  19944. raise salt.exceptions.CommandExecutionError(message["error"])
  19945. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  19946. 2020-08-04 12:30:02,338 [obd.obd :107 ][ERROR ][696] Failed to use explicit port '/dev/serial0'
  19947. Traceback (most recent call last):
  19948. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  19949. self.interface.open(baudrate, protocol=protocol)
  19950. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  19951. self.set_protocol(prot.pop("id", None), **prot)
  19952. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  19953. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  19954. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  19955. self._protocol = self._auto_protocol(**kwargs)
  19956. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  19957. res_0100 = self._verify_protocol("auto", test=not verify)
  19958. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  19959. for line in self.query("0100", parse=False, read_timeout=10):
  19960. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  19961. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  19962. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  19963. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  19964. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  19965. data = self._port.read(self._port.in_waiting or 1)
  19966. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  19967. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  19968. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  19969. sys.exit(salt.defaults.exitcodes.EX_OK)
  19970. SystemExit: 0
  19971. 2020-08-04 12:30:02,388 [obd.obd :120 ][WARNING ][696] Cannot load commands - no connection to bus
  19972. 2020-08-04 12:30:02,417 [obd.interfaces.elm327:730 ][ERROR ][696] Failed to relay command 'STSLCS' to interface
  19973. Traceback (most recent call last):
  19974. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  19975. lines = self.send(cmd, raw_response=raw_response)
  19976. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  19977. raise ELM327Error(self.ERRORS[line], code=line)
  19978. ELM327Error: Operation interrupted by a received RS232 character
  19979. 2020-08-04 12:30:02,427 [messaging :742 ][ERROR ][696] Exception while processing event: {'tag': 'obd/req/7cfbc3dd-c765-4dbb-bd46-65d07e9e5a2d', 'data': {'_stamp': '2020-08-04T12:29:56.831405', 'handler': 'execute', '_event_tag': 'obd/req/7cfbc3dd-c765-4dbb-bd46-65d07e9e5a2d', 'args': ['STSLCS']}}
  19980. Traceback (most recent call last):
  19981. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  19982. res = self.process(message)
  19983. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  19984. result = func(message, **settings)
  19985. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  19986. found, result = self._call_hook_for(message, "workflow", message)
  19987. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19988. return True, func(*args, **kwargs)
  19989. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  19990. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  19991. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  19992. return True, func(*args, **kwargs)
  19993. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  19994. return func(*args, **kwargs)
  19995. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  19996. res = conn.execute(cmd)
  19997. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  19998. return func(self, *args, **kwargs)
  19999. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  20000. return self._obd.execute(cmd, **kwargs)
  20001. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  20002. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  20003. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  20004. lines = self.send(cmd, raw_response=raw_response)
  20005. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  20006. raise ELM327Error(self.ERRORS[line], code=line)
  20007. ELM327Error: Operation interrupted by a received RS232 character
  20008. 2020-08-04 12:30:03,160 [salt.utils.parsers:1050][WARNING ][414] Minion received a SIGTERM. Exiting.
  20009. 2020-08-04 12:30:03,699 [messaging :871 ][WARNING ][815] No reply message with tag 'obd/res/7cfbc3dd-c765-4dbb-bd46-65d07e9e5a2d' received within timeout of 30 secs
  20010. 2020-08-04 12:30:03,703 [salt.state :292 ][ERROR ][815] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  20011. 2020-08-04 12:30:20,437 [gpio_spi_conn :42 ][WARNING ][639] Unable to clear buffer - got unexpected value: 255
  20012. 2020-08-04 12:30:20,456 [gpio_spi_conn :42 ][WARNING ][639] Unable to clear buffer - got unexpected value: 255
  20013. 2020-08-04 12:30:20,467 [gpio_spi_conn :42 ][WARNING ][639] Unable to clear buffer - got unexpected value: 255
  20014. 2020-08-04 12:30:21,067 [serial_conn :79 ][ERROR ][636] Failed to open serial connection
  20015. Traceback (most recent call last):
  20016. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20017. self._serial.open()
  20018. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20019. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20020. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20021. 2020-08-04 12:30:22,089 [serial_conn :79 ][ERROR ][636] Failed to open serial connection
  20022. Traceback (most recent call last):
  20023. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20024. self._serial.open()
  20025. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20026. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20027. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20028. 2020-08-04 12:30:22,495 [gpio_spi_conn :109 ][WARNING ][639] Expected ack '12' but got '255'
  20029. 2020-08-04 12:30:22,998 [gpio_spi_conn :109 ][WARNING ][639] Expected ack '12' but got '255'
  20030. 2020-08-04 12:30:23,093 [serial_conn :79 ][ERROR ][636] Failed to open serial connection
  20031. Traceback (most recent call last):
  20032. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20033. self._serial.open()
  20034. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20035. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20036. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20037. 2020-08-04 12:30:23,501 [gpio_spi_conn :109 ][WARNING ][639] Expected ack '12' but got '255'
  20038. 2020-08-04 12:30:23,503 [spm_conn :139 ][WARNING ][639] Unable to get status: Expected ack '12' but got '255'
  20039. 2020-08-04 12:30:23,671 [messaging :208 ][ERROR ][636] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  20040. Traceback (most recent call last):
  20041. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  20042. self._call_hook_for(message, "workflow", message)
  20043. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20044. return True, func(*args, **kwargs)
  20045. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  20046. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20047. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20048. return True, func(*args, **kwargs)
  20049. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20050. return func(*args, **kwargs)
  20051. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  20052. res = _exec("AT+CCLK?")
  20053. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  20054. conn.write_line(cmd)
  20055. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  20056. self.ensure_open()
  20057. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  20058. self.open()
  20059. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  20060. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  20061. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  20062. raise attempt.get()
  20063. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  20064. six.reraise(self.value[0], self.value[1], self.value[2])
  20065. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  20066. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  20067. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20068. self._serial.open()
  20069. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20070. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20071. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20072. 2020-08-04 12:30:24,014 [gpio_spi_conn :109 ][WARNING ][639] Expected ack '12' but got '255'
  20073. 2020-08-04 12:30:39,058 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][676] Timeout after 1.28205128205 second(s) waiting for interrupt
  20074. 2020-08-04 12:30:39,129 [serial_conn :79 ][ERROR ][636] Failed to open serial connection
  20075. Traceback (most recent call last):
  20076. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20077. self._serial.open()
  20078. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20079. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20080. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20081. 2020-08-04 12:30:39,477 [gpio_spi_conn :109 ][WARNING ][639] Expected ack '12' but got '255'
  20082. 2020-08-04 12:30:39,980 [gpio_spi_conn :109 ][WARNING ][639] Expected ack '12' but got '255'
  20083. 2020-08-04 12:30:39,982 [spm_conn :139 ][WARNING ][639] Unable to get status: Expected ack '12' but got '255'
  20084. 2020-08-04 12:30:40,134 [serial_conn :79 ][ERROR ][636] Failed to open serial connection
  20085. Traceback (most recent call last):
  20086. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20087. self._serial.open()
  20088. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20089. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20090. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20091. 2020-08-04 12:30:40,486 [gpio_spi_conn :109 ][WARNING ][639] Expected ack '12' but got '255'
  20092. 2020-08-04 12:30:40,989 [gpio_spi_conn :109 ][WARNING ][639] Expected ack '12' but got '255'
  20093. 2020-08-04 12:30:41,138 [serial_conn :79 ][ERROR ][636] Failed to open serial connection
  20094. Traceback (most recent call last):
  20095. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20096. self._serial.open()
  20097. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20098. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20099. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20100. 2020-08-04 12:30:41,142 [messaging :206 ][ERROR ][636] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  20101. Traceback (most recent call last):
  20102. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  20103. self._call_hook_for(message, "workflow", message)
  20104. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20105. return True, func(*args, **kwargs)
  20106. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  20107. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20108. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20109. return True, func(*args, **kwargs)
  20110. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20111. return func(*args, **kwargs)
  20112. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  20113. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  20114. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  20115. conn.write_line(cmd)
  20116. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  20117. self.ensure_open()
  20118. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  20119. self.open()
  20120. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  20121. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  20122. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  20123. raise attempt.get()
  20124. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  20125. six.reraise(self.value[0], self.value[1], self.value[2])
  20126. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  20127. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  20128. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20129. self._serial.open()
  20130. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20131. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20132. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20133. 2020-08-04 12:30:41,493 [gpio_spi_conn :109 ][WARNING ][639] Expected ack '12' but got '255'
  20134. 2020-08-04 12:30:41,495 [spm_conn :139 ][WARNING ][639] Unable to get status: Expected ack '12' but got '255'
  20135. 2020-08-04 12:30:41,499 [gpio_spi_conn :109 ][WARNING ][639] Expected ack '12' but got '255'
  20136. 2020-08-04 12:30:42,002 [gpio_spi_conn :109 ][WARNING ][639] Expected ack '12' but got '255'
  20137. 2020-08-04 12:30:42,505 [gpio_spi_conn :109 ][WARNING ][639] Expected ack '12' but got '255'
  20138. 2020-08-04 12:30:42,507 [spm_conn :82 ][WARNING ][639] Unable to send noop: Expected ack '12' but got '255'
  20139. 2020-08-04 12:30:42,933 [serial_conn :79 ][ERROR ][636] Failed to open serial connection
  20140. Traceback (most recent call last):
  20141. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20142. self._serial.open()
  20143. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20144. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20145. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20146. 2020-08-04 12:30:43,011 [gpio_spi_conn :109 ][WARNING ][639] Expected ack '12' but got '255'
  20147. 2020-08-04 12:30:43,516 [gpio_spi_conn :109 ][WARNING ][639] Expected ack '12' but got '255'
  20148. 2020-08-04 12:30:43,940 [serial_conn :79 ][ERROR ][636] Failed to open serial connection
  20149. Traceback (most recent call last):
  20150. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20151. self._serial.open()
  20152. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20153. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20154. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20155. 2020-08-04 12:30:44,019 [gpio_spi_conn :109 ][WARNING ][639] Expected ack '12' but got '255'
  20156. 2020-08-04 12:30:44,021 [spm_conn :82 ][WARNING ][639] Unable to send noop: Expected ack '12' but got '255'
  20157. 2020-08-04 12:30:44,525 [gpio_spi_conn :109 ][WARNING ][639] Expected ack '12' but got '255'
  20158. 2020-08-04 12:30:44,944 [serial_conn :79 ][ERROR ][636] Failed to open serial connection
  20159. Traceback (most recent call last):
  20160. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20161. self._serial.open()
  20162. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20163. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20164. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20165. 2020-08-04 12:30:44,948 [messaging :742 ][ERROR ][636] Exception while processing event: {'tag': 'ec2x/req/68b09e24-1f69-499d-b9a2-fb1ca17179c1', 'data': {'_stamp': '2020-08-04T12:30:20.486871', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/68b09e24-1f69-499d-b9a2-fb1ca17179c1', 'kwargs': {'cooldown_delay': None}}}
  20166. Traceback (most recent call last):
  20167. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  20168. res = self.process(message)
  20169. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  20170. result = func(message, **settings)
  20171. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  20172. found, result = self._call_hook_for(message, "workflow", message)
  20173. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20174. return True, func(*args, **kwargs)
  20175. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  20176. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20177. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20178. return True, func(*args, **kwargs)
  20179. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20180. return func(*args, **kwargs)
  20181. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  20182. return _exec(cmd, **kwargs)
  20183. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  20184. conn.write_line(cmd)
  20185. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  20186. self.ensure_open()
  20187. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  20188. self.open()
  20189. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  20190. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  20191. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  20192. raise attempt.get()
  20193. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  20194. six.reraise(self.value[0], self.value[1], self.value[2])
  20195. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  20196. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  20197. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20198. self._serial.open()
  20199. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20200. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20201. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20202. 2020-08-04 12:30:45,028 [gpio_spi_conn :109 ][WARNING ][639] Expected ack '12' but got '255'
  20203. 2020-08-04 12:30:45,532 [gpio_spi_conn :109 ][WARNING ][639] Expected ack '12' but got '255'
  20204. 2020-08-04 12:30:45,537 [spm_conn :82 ][WARNING ][639] Unable to send noop: Expected ack '12' but got '255'
  20205. 2020-08-04 12:30:45,541 [messaging :208 ][ERROR ][639] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  20206. Traceback (most recent call last):
  20207. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  20208. self._call_hook_for(message, "workflow", message)
  20209. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20210. return True, func(*args, **kwargs)
  20211. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  20212. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20213. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20214. return True, func(*args, **kwargs)
  20215. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20216. return func(*args, **kwargs)
  20217. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  20218. conn.heartbeat()
  20219. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  20220. self.noop()
  20221. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  20222. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  20223. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  20224. raise attempt.get()
  20225. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  20226. six.reraise(self.value[0], self.value[1], self.value[2])
  20227. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  20228. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  20229. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  20230. self._begin_message()
  20231. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  20232. self.recv(ack=ACK_MESSAGE_BEGIN)
  20233. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  20234. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  20235. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  20236. raise attempt.get()
  20237. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  20238. six.reraise(self.value[0], self.value[1], self.value[2])
  20239. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  20240. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  20241. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  20242. raise Exception(msg)
  20243. Exception: Expected ack '12' but got '255'
  20244. 2020-08-04 12:30:47,069 [messaging :208 ][ERROR ][637] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  20245. Traceback (most recent call last):
  20246. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  20247. self._call_hook_for(message, "workflow", message)
  20248. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20249. return True, func(*args, **kwargs)
  20250. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  20251. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20252. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20253. return True, func(*args, **kwargs)
  20254. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20255. return func(*args, **kwargs)
  20256. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  20257. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  20258. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  20259. res = query("AT+QGPSLOC={:d}".format(mode))
  20260. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  20261. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  20262. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  20263. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  20264. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  20265. raise salt.exceptions.CommandExecutionError(message["error"])
  20266. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20267. 2020-08-04 12:30:52,141 [serial_conn :79 ][ERROR ][636] Failed to open serial connection
  20268. Traceback (most recent call last):
  20269. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20270. self._serial.open()
  20271. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20272. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20273. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20274. 2020-08-04 12:30:53,145 [serial_conn :79 ][ERROR ][636] Failed to open serial connection
  20275. Traceback (most recent call last):
  20276. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20277. self._serial.open()
  20278. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20279. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20280. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20281. 2020-08-04 12:30:54,149 [serial_conn :79 ][ERROR ][636] Failed to open serial connection
  20282. Traceback (most recent call last):
  20283. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20284. self._serial.open()
  20285. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20286. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20287. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20288. 2020-08-04 12:30:54,153 [messaging :742 ][ERROR ][636] Exception while processing event: {'tag': 'ec2x/req/70e301ec-2607-4606-b1c8-53f5c73a703f', 'data': {'_stamp': '2020-08-04T12:30:52.133649', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/70e301ec-2607-4606-b1c8-53f5c73a703f', 'kwargs': {'cooldown_delay': None}}}
  20289. Traceback (most recent call last):
  20290. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  20291. res = self.process(message)
  20292. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  20293. result = func(message, **settings)
  20294. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  20295. found, result = self._call_hook_for(message, "workflow", message)
  20296. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20297. return True, func(*args, **kwargs)
  20298. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  20299. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20300. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20301. return True, func(*args, **kwargs)
  20302. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20303. return func(*args, **kwargs)
  20304. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  20305. return _exec(cmd, **kwargs)
  20306. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  20307. conn.write_line(cmd)
  20308. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  20309. self.ensure_open()
  20310. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  20311. self.open()
  20312. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  20313. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  20314. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  20315. raise attempt.get()
  20316. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  20317. six.reraise(self.value[0], self.value[1], self.value[2])
  20318. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  20319. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  20320. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20321. self._serial.open()
  20322. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20323. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20324. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20325. 2020-08-04 12:30:54,187 [messaging :206 ][ERROR ][637] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  20326. Traceback (most recent call last):
  20327. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  20328. self._call_hook_for(message, "workflow", message)
  20329. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20330. return True, func(*args, **kwargs)
  20331. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  20332. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20333. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20334. return True, func(*args, **kwargs)
  20335. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20336. return func(*args, **kwargs)
  20337. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  20338. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  20339. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  20340. res = query("AT+QGPSLOC={:d}".format(mode))
  20341. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  20342. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  20343. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  20344. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  20345. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  20346. raise salt.exceptions.CommandExecutionError(message["error"])
  20347. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20348. 2020-08-04 12:30:57,281 [obd.obd :107 ][ERROR ][675] Failed to use explicit port '/dev/serial0'
  20349. Traceback (most recent call last):
  20350. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  20351. self.interface.open(baudrate, protocol=protocol)
  20352. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  20353. self.set_protocol(prot.pop("id", None), **prot)
  20354. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  20355. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  20356. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  20357. self._protocol = self._auto_protocol(**kwargs)
  20358. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  20359. res_0100 = self._verify_protocol("auto", test=not verify)
  20360. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  20361. for line in self.query("0100", parse=False, read_timeout=10):
  20362. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  20363. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  20364. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  20365. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  20366. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  20367. data = self._port.read(self._port.in_waiting or 1)
  20368. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  20369. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  20370. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  20371. sys.exit(salt.defaults.exitcodes.EX_OK)
  20372. SystemExit: 0
  20373. 2020-08-04 12:30:57,315 [obd.obd :120 ][WARNING ][675] Cannot load commands - no connection to bus
  20374. 2020-08-04 12:30:57,344 [obd.interfaces.elm327:730 ][ERROR ][675] Failed to relay command 'STSLCS' to interface
  20375. Traceback (most recent call last):
  20376. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  20377. lines = self.send(cmd, raw_response=raw_response)
  20378. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  20379. raise ELM327Error(self.ERRORS[line], code=line)
  20380. ELM327Error: Operation interrupted by a received RS232 character
  20381. 2020-08-04 12:30:57,348 [messaging :742 ][ERROR ][675] Exception while processing event: {'tag': 'obd/req/f6e4a150-7f76-4dca-9a3f-89f03e658912', 'data': {'_stamp': '2020-08-04T12:30:52.101205', 'handler': 'execute', '_event_tag': 'obd/req/f6e4a150-7f76-4dca-9a3f-89f03e658912', 'args': ['STSLCS']}}
  20382. Traceback (most recent call last):
  20383. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  20384. res = self.process(message)
  20385. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  20386. result = func(message, **settings)
  20387. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  20388. found, result = self._call_hook_for(message, "workflow", message)
  20389. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20390. return True, func(*args, **kwargs)
  20391. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  20392. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20393. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20394. return True, func(*args, **kwargs)
  20395. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20396. return func(*args, **kwargs)
  20397. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  20398. res = conn.execute(cmd)
  20399. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  20400. return func(self, *args, **kwargs)
  20401. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  20402. return self._obd.execute(cmd, **kwargs)
  20403. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  20404. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  20405. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  20406. lines = self.send(cmd, raw_response=raw_response)
  20407. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  20408. raise ELM327Error(self.ERRORS[line], code=line)
  20409. ELM327Error: Operation interrupted by a received RS232 character
  20410. 2020-08-04 12:30:58,045 [salt.utils.parsers:1050][WARNING ][437] Minion received a SIGTERM. Exiting.
  20411. 2020-08-04 12:30:58,594 [messaging :871 ][WARNING ][836] No reply message with tag 'obd/res/f6e4a150-7f76-4dca-9a3f-89f03e658912' received within timeout of 30 secs
  20412. 2020-08-04 12:30:58,598 [salt.state :292 ][ERROR ][836] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  20413. 2020-08-04 12:31:14,978 [gpio_spi_conn :42 ][WARNING ][626] Unable to clear buffer - got unexpected value: 255
  20414. 2020-08-04 12:31:14,999 [gpio_spi_conn :42 ][WARNING ][626] Unable to clear buffer - got unexpected value: 255
  20415. 2020-08-04 12:31:15,005 [gpio_spi_conn :42 ][WARNING ][626] Unable to clear buffer - got unexpected value: 255
  20416. 2020-08-04 12:31:15,620 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  20417. Traceback (most recent call last):
  20418. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20419. self._serial.open()
  20420. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20421. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20422. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20423. 2020-08-04 12:31:16,635 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  20424. Traceback (most recent call last):
  20425. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20426. self._serial.open()
  20427. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20428. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20429. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20430. 2020-08-04 12:31:17,034 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  20431. 2020-08-04 12:31:17,537 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  20432. 2020-08-04 12:31:17,638 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  20433. Traceback (most recent call last):
  20434. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20435. self._serial.open()
  20436. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20437. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20438. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20439. 2020-08-04 12:31:18,040 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  20440. 2020-08-04 12:31:18,043 [spm_conn :139 ][WARNING ][626] Unable to get status: Expected ack '12' but got '255'
  20441. 2020-08-04 12:31:18,210 [messaging :208 ][ERROR ][623] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  20442. Traceback (most recent call last):
  20443. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  20444. self._call_hook_for(message, "workflow", message)
  20445. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20446. return True, func(*args, **kwargs)
  20447. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  20448. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20449. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20450. return True, func(*args, **kwargs)
  20451. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20452. return func(*args, **kwargs)
  20453. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  20454. res = _exec("AT+CCLK?")
  20455. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  20456. conn.write_line(cmd)
  20457. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  20458. self.ensure_open()
  20459. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  20460. self.open()
  20461. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  20462. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  20463. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  20464. raise attempt.get()
  20465. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  20466. six.reraise(self.value[0], self.value[1], self.value[2])
  20467. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  20468. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  20469. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20470. self._serial.open()
  20471. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20472. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20473. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20474. 2020-08-04 12:31:18,549 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  20475. 2020-08-04 12:31:19,053 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  20476. 2020-08-04 12:31:19,556 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  20477. 2020-08-04 12:31:19,558 [spm_conn :139 ][WARNING ][626] Unable to get status: Expected ack '12' but got '255'
  20478. 2020-08-04 12:31:20,062 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  20479. 2020-08-04 12:31:20,565 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  20480. 2020-08-04 12:31:21,068 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  20481. 2020-08-04 12:31:21,070 [spm_conn :139 ][WARNING ][626] Unable to get status: Expected ack '12' but got '255'
  20482. 2020-08-04 12:31:21,073 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  20483. 2020-08-04 12:31:21,576 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  20484. 2020-08-04 12:31:22,079 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  20485. 2020-08-04 12:31:22,081 [spm_conn :82 ][WARNING ][626] Unable to send noop: Expected ack '12' but got '255'
  20486. 2020-08-04 12:31:22,392 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  20487. Traceback (most recent call last):
  20488. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20489. self._serial.open()
  20490. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20491. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20492. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20493. 2020-08-04 12:31:22,586 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  20494. 2020-08-04 12:31:23,089 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  20495. 2020-08-04 12:31:23,396 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  20496. Traceback (most recent call last):
  20497. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20498. self._serial.open()
  20499. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20500. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20501. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20502. 2020-08-04 12:31:23,592 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  20503. 2020-08-04 12:31:23,594 [spm_conn :82 ][WARNING ][626] Unable to send noop: Expected ack '12' but got '255'
  20504. 2020-08-04 12:31:24,097 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  20505. 2020-08-04 12:31:24,400 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  20506. Traceback (most recent call last):
  20507. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20508. self._serial.open()
  20509. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20510. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20511. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20512. 2020-08-04 12:31:24,415 [messaging :742 ][ERROR ][623] Exception while processing event: {'tag': 'ec2x/req/2e941ed8-e1dd-4f1a-8d96-caa12b5a337d', 'data': {'_stamp': '2020-08-04T12:31:15.049895', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/2e941ed8-e1dd-4f1a-8d96-caa12b5a337d', 'kwargs': {'cooldown_delay': None}}}
  20513. Traceback (most recent call last):
  20514. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  20515. res = self.process(message)
  20516. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  20517. result = func(message, **settings)
  20518. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  20519. found, result = self._call_hook_for(message, "workflow", message)
  20520. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20521. return True, func(*args, **kwargs)
  20522. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  20523. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20524. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20525. return True, func(*args, **kwargs)
  20526. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20527. return func(*args, **kwargs)
  20528. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  20529. return _exec(cmd, **kwargs)
  20530. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  20531. conn.write_line(cmd)
  20532. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  20533. self.ensure_open()
  20534. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  20535. self.open()
  20536. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  20537. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  20538. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  20539. raise attempt.get()
  20540. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  20541. six.reraise(self.value[0], self.value[1], self.value[2])
  20542. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  20543. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  20544. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20545. self._serial.open()
  20546. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20547. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20548. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20549. 2020-08-04 12:31:24,600 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  20550. 2020-08-04 12:31:25,041 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  20551. Traceback (most recent call last):
  20552. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20553. self._serial.open()
  20554. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20555. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20556. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20557. 2020-08-04 12:31:25,103 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  20558. 2020-08-04 12:31:25,106 [spm_conn :82 ][WARNING ][626] Unable to send noop: Expected ack '12' but got '255'
  20559. 2020-08-04 12:31:25,108 [messaging :208 ][ERROR ][626] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  20560. Traceback (most recent call last):
  20561. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  20562. self._call_hook_for(message, "workflow", message)
  20563. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20564. return True, func(*args, **kwargs)
  20565. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  20566. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20567. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20568. return True, func(*args, **kwargs)
  20569. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20570. return func(*args, **kwargs)
  20571. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  20572. conn.heartbeat()
  20573. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  20574. self.noop()
  20575. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  20576. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  20577. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  20578. raise attempt.get()
  20579. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  20580. six.reraise(self.value[0], self.value[1], self.value[2])
  20581. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  20582. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  20583. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  20584. self._begin_message()
  20585. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  20586. self.recv(ack=ACK_MESSAGE_BEGIN)
  20587. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  20588. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  20589. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  20590. raise attempt.get()
  20591. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  20592. six.reraise(self.value[0], self.value[1], self.value[2])
  20593. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  20594. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  20595. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  20596. raise Exception(msg)
  20597. Exception: Expected ack '12' but got '255'
  20598. 2020-08-04 12:31:26,048 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  20599. Traceback (most recent call last):
  20600. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20601. self._serial.open()
  20602. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20603. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20604. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20605. 2020-08-04 12:31:26,742 [messaging :208 ][ERROR ][624] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  20606. Traceback (most recent call last):
  20607. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  20608. self._call_hook_for(message, "workflow", message)
  20609. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20610. return True, func(*args, **kwargs)
  20611. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  20612. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20613. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20614. return True, func(*args, **kwargs)
  20615. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20616. return func(*args, **kwargs)
  20617. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  20618. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  20619. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  20620. res = query("AT+QGPSLOC={:d}".format(mode))
  20621. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  20622. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  20623. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  20624. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  20625. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  20626. raise salt.exceptions.CommandExecutionError(message["error"])
  20627. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20628. 2020-08-04 12:31:27,052 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  20629. Traceback (most recent call last):
  20630. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20631. self._serial.open()
  20632. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20633. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20634. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20635. 2020-08-04 12:31:27,579 [messaging :206 ][ERROR ][623] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  20636. Traceback (most recent call last):
  20637. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  20638. self._call_hook_for(message, "workflow", message)
  20639. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20640. return True, func(*args, **kwargs)
  20641. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  20642. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20643. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20644. return True, func(*args, **kwargs)
  20645. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20646. return func(*args, **kwargs)
  20647. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  20648. res = _exec("AT+CCLK?")
  20649. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  20650. conn.write_line(cmd)
  20651. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  20652. self.ensure_open()
  20653. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  20654. self.open()
  20655. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  20656. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  20657. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  20658. raise attempt.get()
  20659. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  20660. six.reraise(self.value[0], self.value[1], self.value[2])
  20661. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  20662. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  20663. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20664. self._serial.open()
  20665. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20666. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20667. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20668. 2020-08-04 12:31:42,897 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][664] Timeout after 1.28205128205 second(s) waiting for interrupt
  20669. 2020-08-04 12:31:42,917 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  20670. Traceback (most recent call last):
  20671. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20672. self._serial.open()
  20673. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20674. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20675. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20676. 2020-08-04 12:31:43,935 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  20677. Traceback (most recent call last):
  20678. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20679. self._serial.open()
  20680. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20681. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20682. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20683. 2020-08-04 12:31:44,939 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  20684. Traceback (most recent call last):
  20685. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20686. self._serial.open()
  20687. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20688. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20689. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20690. 2020-08-04 12:31:44,942 [messaging :206 ][ERROR ][623] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  20691. Traceback (most recent call last):
  20692. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  20693. self._call_hook_for(message, "workflow", message)
  20694. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20695. return True, func(*args, **kwargs)
  20696. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  20697. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20698. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20699. return True, func(*args, **kwargs)
  20700. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20701. return func(*args, **kwargs)
  20702. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  20703. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  20704. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  20705. conn.write_line(cmd)
  20706. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  20707. self.ensure_open()
  20708. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  20709. self.open()
  20710. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  20711. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  20712. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  20713. raise attempt.get()
  20714. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  20715. six.reraise(self.value[0], self.value[1], self.value[2])
  20716. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  20717. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  20718. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20719. self._serial.open()
  20720. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20721. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20722. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20723. 2020-08-04 12:31:44,948 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  20724. Traceback (most recent call last):
  20725. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20726. self._serial.open()
  20727. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20728. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20729. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20730. 2020-08-04 12:31:45,957 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  20731. Traceback (most recent call last):
  20732. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20733. self._serial.open()
  20734. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20735. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20736. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20737. 2020-08-04 12:31:46,970 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  20738. Traceback (most recent call last):
  20739. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20740. self._serial.open()
  20741. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20742. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20743. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20744. 2020-08-04 12:31:46,979 [messaging :742 ][ERROR ][623] Exception while processing event: {'tag': 'ec2x/req/723f9277-bcb3-4a51-b667-bc607d9025a4', 'data': {'_stamp': '2020-08-04T12:31:42.897537', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/723f9277-bcb3-4a51-b667-bc607d9025a4', 'kwargs': {'cooldown_delay': None}}}
  20745. Traceback (most recent call last):
  20746. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  20747. res = self.process(message)
  20748. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  20749. result = func(message, **settings)
  20750. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  20751. found, result = self._call_hook_for(message, "workflow", message)
  20752. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20753. return True, func(*args, **kwargs)
  20754. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  20755. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20756. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20757. return True, func(*args, **kwargs)
  20758. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20759. return func(*args, **kwargs)
  20760. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  20761. return _exec(cmd, **kwargs)
  20762. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  20763. conn.write_line(cmd)
  20764. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  20765. self.ensure_open()
  20766. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  20767. self.open()
  20768. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  20769. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  20770. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  20771. raise attempt.get()
  20772. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  20773. six.reraise(self.value[0], self.value[1], self.value[2])
  20774. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  20775. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  20776. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20777. self._serial.open()
  20778. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20779. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20780. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20781. 2020-08-04 12:31:47,001 [messaging :206 ][ERROR ][624] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  20782. Traceback (most recent call last):
  20783. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  20784. self._call_hook_for(message, "workflow", message)
  20785. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20786. return True, func(*args, **kwargs)
  20787. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  20788. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20789. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20790. return True, func(*args, **kwargs)
  20791. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20792. return func(*args, **kwargs)
  20793. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  20794. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  20795. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  20796. res = query("AT+QGPSLOC={:d}".format(mode))
  20797. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  20798. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  20799. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  20800. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  20801. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  20802. raise salt.exceptions.CommandExecutionError(message["error"])
  20803. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20804. 2020-08-04 12:31:52,190 [obd.obd :107 ][ERROR ][660] Failed to use explicit port '/dev/serial0'
  20805. Traceback (most recent call last):
  20806. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  20807. self.interface.open(baudrate, protocol=protocol)
  20808. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  20809. self.set_protocol(prot.pop("id", None), **prot)
  20810. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  20811. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  20812. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  20813. self._protocol = self._auto_protocol(**kwargs)
  20814. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  20815. res_0100 = self._verify_protocol("auto", test=not verify)
  20816. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  20817. for line in self.query("0100", parse=False, read_timeout=10):
  20818. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  20819. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  20820. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  20821. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  20822. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  20823. data = self._port.read(self._port.in_waiting or 1)
  20824. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  20825. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  20826. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  20827. sys.exit(salt.defaults.exitcodes.EX_OK)
  20828. SystemExit: 0
  20829. 2020-08-04 12:31:52,225 [obd.obd :120 ][WARNING ][660] Cannot load commands - no connection to bus
  20830. 2020-08-04 12:31:52,243 [obd.interfaces.elm327:730 ][ERROR ][660] Failed to relay command 'STSLCS' to interface
  20831. Traceback (most recent call last):
  20832. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  20833. lines = self.send(cmd, raw_response=raw_response)
  20834. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  20835. raise ELM327Error(self.ERRORS[line], code=line)
  20836. ELM327Error: Operation interrupted by a received RS232 character
  20837. 2020-08-04 12:31:52,246 [messaging :742 ][ERROR ][660] Exception while processing event: {'tag': 'obd/req/87ab9aa1-0fb8-4e52-af22-579bb20fc815', 'data': {'_stamp': '2020-08-04T12:31:46.715474', 'handler': 'execute', '_event_tag': 'obd/req/87ab9aa1-0fb8-4e52-af22-579bb20fc815', 'args': ['STSLCS']}}
  20838. Traceback (most recent call last):
  20839. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  20840. res = self.process(message)
  20841. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  20842. result = func(message, **settings)
  20843. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  20844. found, result = self._call_hook_for(message, "workflow", message)
  20845. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20846. return True, func(*args, **kwargs)
  20847. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  20848. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20849. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20850. return True, func(*args, **kwargs)
  20851. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20852. return func(*args, **kwargs)
  20853. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  20854. res = conn.execute(cmd)
  20855. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  20856. return func(self, *args, **kwargs)
  20857. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  20858. return self._obd.execute(cmd, **kwargs)
  20859. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  20860. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  20861. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  20862. lines = self.send(cmd, raw_response=raw_response)
  20863. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  20864. raise ELM327Error(self.ERRORS[line], code=line)
  20865. ELM327Error: Operation interrupted by a received RS232 character
  20866. 2020-08-04 12:31:53,015 [salt.utils.parsers:1050][WARNING ][422] Minion received a SIGTERM. Exiting.
  20867. 2020-08-04 12:31:53,552 [messaging :871 ][WARNING ][837] No reply message with tag 'obd/res/87ab9aa1-0fb8-4e52-af22-579bb20fc815' received within timeout of 30 secs
  20868. 2020-08-04 12:31:53,557 [salt.state :292 ][ERROR ][837] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  20869. 2020-08-04 12:32:10,191 [gpio_spi_conn :42 ][WARNING ][636] Unable to clear buffer - got unexpected value: 255
  20870. 2020-08-04 12:32:10,205 [gpio_spi_conn :42 ][WARNING ][636] Unable to clear buffer - got unexpected value: 255
  20871. 2020-08-04 12:32:10,211 [gpio_spi_conn :42 ][WARNING ][636] Unable to clear buffer - got unexpected value: 255
  20872. 2020-08-04 12:32:10,874 [serial_conn :79 ][ERROR ][633] Failed to open serial connection
  20873. Traceback (most recent call last):
  20874. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20875. self._serial.open()
  20876. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20877. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20878. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20879. 2020-08-04 12:32:11,893 [serial_conn :79 ][ERROR ][633] Failed to open serial connection
  20880. Traceback (most recent call last):
  20881. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20882. self._serial.open()
  20883. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20884. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20885. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20886. 2020-08-04 12:32:12,241 [gpio_spi_conn :109 ][WARNING ][636] Expected ack '12' but got '255'
  20887. 2020-08-04 12:32:12,744 [gpio_spi_conn :109 ][WARNING ][636] Expected ack '12' but got '255'
  20888. 2020-08-04 12:32:12,898 [serial_conn :79 ][ERROR ][633] Failed to open serial connection
  20889. Traceback (most recent call last):
  20890. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20891. self._serial.open()
  20892. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20893. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20894. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20895. 2020-08-04 12:32:13,247 [gpio_spi_conn :109 ][WARNING ][636] Expected ack '12' but got '255'
  20896. 2020-08-04 12:32:13,250 [spm_conn :139 ][WARNING ][636] Unable to get status: Expected ack '12' but got '255'
  20897. 2020-08-04 12:32:13,498 [messaging :208 ][ERROR ][633] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  20898. Traceback (most recent call last):
  20899. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  20900. self._call_hook_for(message, "workflow", message)
  20901. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20902. return True, func(*args, **kwargs)
  20903. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  20904. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20905. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20906. return True, func(*args, **kwargs)
  20907. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20908. return func(*args, **kwargs)
  20909. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  20910. res = _exec("AT+CCLK?")
  20911. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  20912. conn.write_line(cmd)
  20913. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  20914. self.ensure_open()
  20915. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  20916. self.open()
  20917. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  20918. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  20919. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  20920. raise attempt.get()
  20921. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  20922. six.reraise(self.value[0], self.value[1], self.value[2])
  20923. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  20924. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  20925. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20926. self._serial.open()
  20927. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20928. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20929. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20930. 2020-08-04 12:32:13,754 [gpio_spi_conn :109 ][WARNING ][636] Expected ack '12' but got '255'
  20931. 2020-08-04 12:32:28,768 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][723] Timeout after 1.28205128205 second(s) waiting for interrupt
  20932. 2020-08-04 12:32:28,853 [serial_conn :79 ][ERROR ][633] Failed to open serial connection
  20933. Traceback (most recent call last):
  20934. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20935. self._serial.open()
  20936. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20937. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20938. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20939. 2020-08-04 12:32:29,114 [gpio_spi_conn :109 ][WARNING ][636] Expected ack '12' but got '255'
  20940. 2020-08-04 12:32:29,618 [gpio_spi_conn :109 ][WARNING ][636] Expected ack '12' but got '255'
  20941. 2020-08-04 12:32:29,620 [spm_conn :139 ][WARNING ][636] Unable to get status: Expected ack '12' but got '255'
  20942. 2020-08-04 12:32:29,857 [serial_conn :79 ][ERROR ][633] Failed to open serial connection
  20943. Traceback (most recent call last):
  20944. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20945. self._serial.open()
  20946. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20947. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20948. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20949. 2020-08-04 12:32:30,124 [gpio_spi_conn :109 ][WARNING ][636] Expected ack '12' but got '255'
  20950. 2020-08-04 12:32:30,628 [gpio_spi_conn :109 ][WARNING ][636] Expected ack '12' but got '255'
  20951. 2020-08-04 12:32:30,862 [serial_conn :79 ][ERROR ][633] Failed to open serial connection
  20952. Traceback (most recent call last):
  20953. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20954. self._serial.open()
  20955. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20956. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20957. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20958. 2020-08-04 12:32:30,866 [messaging :206 ][ERROR ][633] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  20959. Traceback (most recent call last):
  20960. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  20961. self._call_hook_for(message, "workflow", message)
  20962. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20963. return True, func(*args, **kwargs)
  20964. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  20965. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  20966. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  20967. return True, func(*args, **kwargs)
  20968. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  20969. return func(*args, **kwargs)
  20970. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  20971. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  20972. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  20973. conn.write_line(cmd)
  20974. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  20975. self.ensure_open()
  20976. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  20977. self.open()
  20978. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  20979. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  20980. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  20981. raise attempt.get()
  20982. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  20983. six.reraise(self.value[0], self.value[1], self.value[2])
  20984. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  20985. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  20986. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  20987. self._serial.open()
  20988. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  20989. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  20990. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  20991. 2020-08-04 12:32:31,132 [gpio_spi_conn :109 ][WARNING ][636] Expected ack '12' but got '255'
  20992. 2020-08-04 12:32:31,135 [spm_conn :139 ][WARNING ][636] Unable to get status: Expected ack '12' but got '255'
  20993. 2020-08-04 12:32:31,139 [gpio_spi_conn :109 ][WARNING ][636] Expected ack '12' but got '255'
  20994. 2020-08-04 12:32:31,642 [gpio_spi_conn :109 ][WARNING ][636] Expected ack '12' but got '255'
  20995. 2020-08-04 12:32:32,145 [gpio_spi_conn :109 ][WARNING ][636] Expected ack '12' but got '255'
  20996. 2020-08-04 12:32:32,148 [spm_conn :82 ][WARNING ][636] Unable to send noop: Expected ack '12' but got '255'
  20997. 2020-08-04 12:32:32,542 [serial_conn :79 ][ERROR ][633] Failed to open serial connection
  20998. Traceback (most recent call last):
  20999. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21000. self._serial.open()
  21001. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21002. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21003. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21004. 2020-08-04 12:32:32,653 [gpio_spi_conn :109 ][WARNING ][636] Expected ack '12' but got '255'
  21005. 2020-08-04 12:32:33,156 [gpio_spi_conn :109 ][WARNING ][636] Expected ack '12' but got '255'
  21006. 2020-08-04 12:32:33,546 [serial_conn :79 ][ERROR ][633] Failed to open serial connection
  21007. Traceback (most recent call last):
  21008. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21009. self._serial.open()
  21010. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21011. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21012. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21013. 2020-08-04 12:32:33,659 [gpio_spi_conn :109 ][WARNING ][636] Expected ack '12' but got '255'
  21014. 2020-08-04 12:32:33,664 [spm_conn :82 ][WARNING ][636] Unable to send noop: Expected ack '12' but got '255'
  21015. 2020-08-04 12:32:34,169 [gpio_spi_conn :109 ][WARNING ][636] Expected ack '12' but got '255'
  21016. 2020-08-04 12:32:34,550 [serial_conn :79 ][ERROR ][633] Failed to open serial connection
  21017. Traceback (most recent call last):
  21018. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21019. self._serial.open()
  21020. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21021. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21022. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21023. 2020-08-04 12:32:34,553 [messaging :742 ][ERROR ][633] Exception while processing event: {'tag': 'ec2x/req/4473bbd8-a118-4aff-b30d-437d361b7ed9', 'data': {'_stamp': '2020-08-04T12:32:10.249545', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/4473bbd8-a118-4aff-b30d-437d361b7ed9', 'kwargs': {'cooldown_delay': None}}}
  21024. Traceback (most recent call last):
  21025. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  21026. res = self.process(message)
  21027. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  21028. result = func(message, **settings)
  21029. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  21030. found, result = self._call_hook_for(message, "workflow", message)
  21031. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21032. return True, func(*args, **kwargs)
  21033. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  21034. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21035. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21036. return True, func(*args, **kwargs)
  21037. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21038. return func(*args, **kwargs)
  21039. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  21040. return _exec(cmd, **kwargs)
  21041. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  21042. conn.write_line(cmd)
  21043. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  21044. self.ensure_open()
  21045. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  21046. self.open()
  21047. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  21048. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  21049. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  21050. raise attempt.get()
  21051. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  21052. six.reraise(self.value[0], self.value[1], self.value[2])
  21053. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  21054. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  21055. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21056. self._serial.open()
  21057. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21058. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21059. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21060. 2020-08-04 12:32:34,675 [gpio_spi_conn :109 ][WARNING ][636] Expected ack '12' but got '255'
  21061. 2020-08-04 12:32:35,178 [gpio_spi_conn :109 ][WARNING ][636] Expected ack '12' but got '255'
  21062. 2020-08-04 12:32:35,182 [spm_conn :82 ][WARNING ][636] Unable to send noop: Expected ack '12' but got '255'
  21063. 2020-08-04 12:32:35,188 [messaging :208 ][ERROR ][636] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  21064. Traceback (most recent call last):
  21065. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  21066. self._call_hook_for(message, "workflow", message)
  21067. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21068. return True, func(*args, **kwargs)
  21069. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  21070. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21071. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21072. return True, func(*args, **kwargs)
  21073. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21074. return func(*args, **kwargs)
  21075. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  21076. conn.heartbeat()
  21077. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  21078. self.noop()
  21079. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  21080. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  21081. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  21082. raise attempt.get()
  21083. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  21084. six.reraise(self.value[0], self.value[1], self.value[2])
  21085. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  21086. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  21087. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  21088. self._begin_message()
  21089. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  21090. self.recv(ack=ACK_MESSAGE_BEGIN)
  21091. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  21092. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  21093. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  21094. raise attempt.get()
  21095. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  21096. six.reraise(self.value[0], self.value[1], self.value[2])
  21097. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  21098. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  21099. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  21100. raise Exception(msg)
  21101. Exception: Expected ack '12' but got '255'
  21102. 2020-08-04 12:32:36,764 [messaging :208 ][ERROR ][634] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  21103. Traceback (most recent call last):
  21104. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  21105. self._call_hook_for(message, "workflow", message)
  21106. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21107. return True, func(*args, **kwargs)
  21108. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  21109. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21110. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21111. return True, func(*args, **kwargs)
  21112. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21113. return func(*args, **kwargs)
  21114. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  21115. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  21116. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  21117. res = query("AT+QGPSLOC={:d}".format(mode))
  21118. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  21119. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  21120. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  21121. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  21122. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  21123. raise salt.exceptions.CommandExecutionError(message["error"])
  21124. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21125. 2020-08-04 12:32:41,812 [serial_conn :79 ][ERROR ][633] Failed to open serial connection
  21126. Traceback (most recent call last):
  21127. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21128. self._serial.open()
  21129. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21130. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21131. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21132. 2020-08-04 12:32:42,816 [serial_conn :79 ][ERROR ][633] Failed to open serial connection
  21133. Traceback (most recent call last):
  21134. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21135. self._serial.open()
  21136. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21137. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21138. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21139. 2020-08-04 12:32:43,820 [serial_conn :79 ][ERROR ][633] Failed to open serial connection
  21140. Traceback (most recent call last):
  21141. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21142. self._serial.open()
  21143. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21144. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21145. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21146. 2020-08-04 12:32:43,824 [messaging :742 ][ERROR ][633] Exception while processing event: {'tag': 'ec2x/req/3997ae35-fc33-4e64-8741-93352f3d5d8e', 'data': {'_stamp': '2020-08-04T12:32:41.801490', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/3997ae35-fc33-4e64-8741-93352f3d5d8e', 'kwargs': {'cooldown_delay': None}}}
  21147. Traceback (most recent call last):
  21148. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  21149. res = self.process(message)
  21150. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  21151. result = func(message, **settings)
  21152. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  21153. found, result = self._call_hook_for(message, "workflow", message)
  21154. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21155. return True, func(*args, **kwargs)
  21156. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  21157. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21158. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21159. return True, func(*args, **kwargs)
  21160. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21161. return func(*args, **kwargs)
  21162. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  21163. return _exec(cmd, **kwargs)
  21164. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  21165. conn.write_line(cmd)
  21166. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  21167. self.ensure_open()
  21168. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  21169. self.open()
  21170. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  21171. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  21172. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  21173. raise attempt.get()
  21174. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  21175. six.reraise(self.value[0], self.value[1], self.value[2])
  21176. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  21177. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  21178. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21179. self._serial.open()
  21180. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21181. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21182. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21183. 2020-08-04 12:32:43,863 [messaging :206 ][ERROR ][634] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  21184. Traceback (most recent call last):
  21185. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  21186. self._call_hook_for(message, "workflow", message)
  21187. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21188. return True, func(*args, **kwargs)
  21189. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  21190. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21191. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21192. return True, func(*args, **kwargs)
  21193. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21194. return func(*args, **kwargs)
  21195. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  21196. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  21197. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  21198. res = query("AT+QGPSLOC={:d}".format(mode))
  21199. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  21200. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  21201. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  21202. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  21203. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  21204. raise salt.exceptions.CommandExecutionError(message["error"])
  21205. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21206. 2020-08-04 12:32:47,129 [obd.obd :107 ][ERROR ][722] Failed to use explicit port '/dev/serial0'
  21207. Traceback (most recent call last):
  21208. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  21209. self.interface.open(baudrate, protocol=protocol)
  21210. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  21211. self.set_protocol(prot.pop("id", None), **prot)
  21212. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  21213. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  21214. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  21215. self._protocol = self._auto_protocol(**kwargs)
  21216. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  21217. res_0100 = self._verify_protocol("auto", test=not verify)
  21218. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  21219. for line in self.query("0100", parse=False, read_timeout=10):
  21220. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  21221. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  21222. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  21223. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  21224. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  21225. data = self._port.read(self._port.in_waiting or 1)
  21226. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  21227. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  21228. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  21229. sys.exit(salt.defaults.exitcodes.EX_OK)
  21230. SystemExit: 0
  21231. 2020-08-04 12:32:47,162 [obd.obd :120 ][WARNING ][722] Cannot load commands - no connection to bus
  21232. 2020-08-04 12:32:47,199 [obd.interfaces.elm327:730 ][ERROR ][722] Failed to relay command 'STSLCS' to interface
  21233. Traceback (most recent call last):
  21234. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  21235. lines = self.send(cmd, raw_response=raw_response)
  21236. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  21237. raise ELM327Error(self.ERRORS[line], code=line)
  21238. ELM327Error: Operation interrupted by a received RS232 character
  21239. 2020-08-04 12:32:47,203 [messaging :742 ][ERROR ][722] Exception while processing event: {'tag': 'obd/req/f7665d72-ade9-49c8-a5cf-56a4af4777fa', 'data': {'_stamp': '2020-08-04T12:32:41.648950', 'handler': 'execute', '_event_tag': 'obd/req/f7665d72-ade9-49c8-a5cf-56a4af4777fa', 'args': ['STSLCS']}}
  21240. Traceback (most recent call last):
  21241. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  21242. res = self.process(message)
  21243. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  21244. result = func(message, **settings)
  21245. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  21246. found, result = self._call_hook_for(message, "workflow", message)
  21247. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21248. return True, func(*args, **kwargs)
  21249. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  21250. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21251. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21252. return True, func(*args, **kwargs)
  21253. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21254. return func(*args, **kwargs)
  21255. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  21256. res = conn.execute(cmd)
  21257. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  21258. return func(self, *args, **kwargs)
  21259. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  21260. return self._obd.execute(cmd, **kwargs)
  21261. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  21262. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  21263. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  21264. lines = self.send(cmd, raw_response=raw_response)
  21265. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  21266. raise ELM327Error(self.ERRORS[line], code=line)
  21267. ELM327Error: Operation interrupted by a received RS232 character
  21268. 2020-08-04 12:32:47,980 [salt.utils.parsers:1050][WARNING ][433] Minion received a SIGTERM. Exiting.
  21269. 2020-08-04 12:32:48,518 [messaging :871 ][WARNING ][833] No reply message with tag 'obd/res/f7665d72-ade9-49c8-a5cf-56a4af4777fa' received within timeout of 30 secs
  21270. 2020-08-04 12:32:48,521 [salt.state :292 ][ERROR ][833] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  21271. 2020-08-04 12:33:04,959 [gpio_spi_conn :42 ][WARNING ][622] Unable to clear buffer - got unexpected value: 255
  21272. 2020-08-04 12:33:04,969 [gpio_spi_conn :42 ][WARNING ][622] Unable to clear buffer - got unexpected value: 255
  21273. 2020-08-04 12:33:04,977 [gpio_spi_conn :42 ][WARNING ][622] Unable to clear buffer - got unexpected value: 255
  21274. 2020-08-04 12:33:05,649 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  21275. Traceback (most recent call last):
  21276. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21277. self._serial.open()
  21278. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21279. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21280. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21281. 2020-08-04 12:33:06,661 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  21282. Traceback (most recent call last):
  21283. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21284. self._serial.open()
  21285. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21286. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21287. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21288. 2020-08-04 12:33:07,014 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  21289. 2020-08-04 12:33:07,517 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  21290. 2020-08-04 12:33:07,665 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  21291. Traceback (most recent call last):
  21292. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21293. self._serial.open()
  21294. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21295. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21296. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21297. 2020-08-04 12:33:08,020 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  21298. 2020-08-04 12:33:08,025 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  21299. 2020-08-04 12:33:08,355 [messaging :208 ][ERROR ][619] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  21300. Traceback (most recent call last):
  21301. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  21302. self._call_hook_for(message, "workflow", message)
  21303. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21304. return True, func(*args, **kwargs)
  21305. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  21306. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21307. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21308. return True, func(*args, **kwargs)
  21309. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21310. return func(*args, **kwargs)
  21311. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  21312. res = _exec("AT+CCLK?")
  21313. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  21314. conn.write_line(cmd)
  21315. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  21316. self.ensure_open()
  21317. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  21318. self.open()
  21319. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  21320. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  21321. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  21322. raise attempt.get()
  21323. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  21324. six.reraise(self.value[0], self.value[1], self.value[2])
  21325. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  21326. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  21327. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21328. self._serial.open()
  21329. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21330. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21331. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21332. 2020-08-04 12:33:08,531 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  21333. 2020-08-04 12:33:23,547 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][709] Timeout after 1.28205128205 second(s) waiting for interrupt
  21334. 2020-08-04 12:33:23,621 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  21335. Traceback (most recent call last):
  21336. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21337. self._serial.open()
  21338. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21339. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21340. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21341. 2020-08-04 12:33:23,843 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  21342. 2020-08-04 12:33:24,346 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  21343. 2020-08-04 12:33:24,349 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  21344. 2020-08-04 12:33:24,625 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  21345. Traceback (most recent call last):
  21346. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21347. self._serial.open()
  21348. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21349. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21350. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21351. 2020-08-04 12:33:24,853 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  21352. 2020-08-04 12:33:25,356 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  21353. 2020-08-04 12:33:25,630 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  21354. Traceback (most recent call last):
  21355. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21356. self._serial.open()
  21357. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21358. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21359. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21360. 2020-08-04 12:33:25,633 [messaging :206 ][ERROR ][619] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  21361. Traceback (most recent call last):
  21362. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  21363. self._call_hook_for(message, "workflow", message)
  21364. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21365. return True, func(*args, **kwargs)
  21366. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  21367. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21368. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21369. return True, func(*args, **kwargs)
  21370. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21371. return func(*args, **kwargs)
  21372. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  21373. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  21374. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  21375. conn.write_line(cmd)
  21376. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  21377. self.ensure_open()
  21378. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  21379. self.open()
  21380. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  21381. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  21382. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  21383. raise attempt.get()
  21384. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  21385. six.reraise(self.value[0], self.value[1], self.value[2])
  21386. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  21387. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  21388. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21389. self._serial.open()
  21390. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21391. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21392. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21393. 2020-08-04 12:33:25,860 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  21394. 2020-08-04 12:33:25,862 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  21395. 2020-08-04 12:33:25,865 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  21396. 2020-08-04 12:33:26,368 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  21397. 2020-08-04 12:33:26,871 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  21398. 2020-08-04 12:33:26,874 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  21399. 2020-08-04 12:33:27,223 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  21400. Traceback (most recent call last):
  21401. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21402. self._serial.open()
  21403. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21404. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21405. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21406. 2020-08-04 12:33:27,377 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  21407. 2020-08-04 12:33:27,880 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  21408. 2020-08-04 12:33:28,228 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  21409. Traceback (most recent call last):
  21410. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21411. self._serial.open()
  21412. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21413. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21414. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21415. 2020-08-04 12:33:28,383 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  21416. 2020-08-04 12:33:28,385 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  21417. 2020-08-04 12:33:28,889 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  21418. 2020-08-04 12:33:29,232 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  21419. Traceback (most recent call last):
  21420. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21421. self._serial.open()
  21422. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21423. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21424. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21425. 2020-08-04 12:33:29,235 [messaging :742 ][ERROR ][619] Exception while processing event: {'tag': 'ec2x/req/8aaa7951-6ab3-4bdf-ab32-a19b7b152547', 'data': {'_stamp': '2020-08-04T12:33:05.020569', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/8aaa7951-6ab3-4bdf-ab32-a19b7b152547', 'kwargs': {'cooldown_delay': None}}}
  21426. Traceback (most recent call last):
  21427. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  21428. res = self.process(message)
  21429. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  21430. result = func(message, **settings)
  21431. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  21432. found, result = self._call_hook_for(message, "workflow", message)
  21433. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21434. return True, func(*args, **kwargs)
  21435. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  21436. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21437. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21438. return True, func(*args, **kwargs)
  21439. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21440. return func(*args, **kwargs)
  21441. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  21442. return _exec(cmd, **kwargs)
  21443. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  21444. conn.write_line(cmd)
  21445. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  21446. self.ensure_open()
  21447. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  21448. self.open()
  21449. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  21450. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  21451. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  21452. raise attempt.get()
  21453. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  21454. six.reraise(self.value[0], self.value[1], self.value[2])
  21455. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  21456. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  21457. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21458. self._serial.open()
  21459. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21460. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21461. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21462. 2020-08-04 12:33:29,392 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  21463. 2020-08-04 12:33:29,895 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  21464. 2020-08-04 12:33:29,897 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  21465. 2020-08-04 12:33:29,899 [messaging :208 ][ERROR ][622] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  21466. Traceback (most recent call last):
  21467. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  21468. self._call_hook_for(message, "workflow", message)
  21469. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21470. return True, func(*args, **kwargs)
  21471. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  21472. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21473. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21474. return True, func(*args, **kwargs)
  21475. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21476. return func(*args, **kwargs)
  21477. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  21478. conn.heartbeat()
  21479. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  21480. self.noop()
  21481. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  21482. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  21483. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  21484. raise attempt.get()
  21485. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  21486. six.reraise(self.value[0], self.value[1], self.value[2])
  21487. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  21488. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  21489. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  21490. self._begin_message()
  21491. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  21492. self.recv(ack=ACK_MESSAGE_BEGIN)
  21493. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  21494. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  21495. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  21496. raise attempt.get()
  21497. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  21498. six.reraise(self.value[0], self.value[1], self.value[2])
  21499. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  21500. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  21501. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  21502. raise Exception(msg)
  21503. Exception: Expected ack '12' but got '255'
  21504. 2020-08-04 12:33:31,302 [messaging :208 ][ERROR ][620] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  21505. Traceback (most recent call last):
  21506. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  21507. self._call_hook_for(message, "workflow", message)
  21508. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21509. return True, func(*args, **kwargs)
  21510. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  21511. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21512. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21513. return True, func(*args, **kwargs)
  21514. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21515. return func(*args, **kwargs)
  21516. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  21517. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  21518. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  21519. res = query("AT+QGPSLOC={:d}".format(mode))
  21520. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  21521. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  21522. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  21523. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  21524. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  21525. raise salt.exceptions.CommandExecutionError(message["error"])
  21526. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21527. 2020-08-04 12:33:36,357 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  21528. Traceback (most recent call last):
  21529. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21530. self._serial.open()
  21531. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21532. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21533. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21534. 2020-08-04 12:33:37,370 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  21535. Traceback (most recent call last):
  21536. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21537. self._serial.open()
  21538. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21539. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21540. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21541. 2020-08-04 12:33:38,374 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  21542. Traceback (most recent call last):
  21543. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21544. self._serial.open()
  21545. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21546. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21547. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21548. 2020-08-04 12:33:38,376 [messaging :742 ][ERROR ][619] Exception while processing event: {'tag': 'ec2x/req/a392dd2f-100e-443f-b065-dd3ba4b242a6', 'data': {'_stamp': '2020-08-04T12:33:36.345905', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/a392dd2f-100e-443f-b065-dd3ba4b242a6', 'kwargs': {'cooldown_delay': None}}}
  21549. Traceback (most recent call last):
  21550. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  21551. res = self.process(message)
  21552. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  21553. result = func(message, **settings)
  21554. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  21555. found, result = self._call_hook_for(message, "workflow", message)
  21556. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21557. return True, func(*args, **kwargs)
  21558. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  21559. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21560. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21561. return True, func(*args, **kwargs)
  21562. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21563. return func(*args, **kwargs)
  21564. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  21565. return _exec(cmd, **kwargs)
  21566. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  21567. conn.write_line(cmd)
  21568. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  21569. self.ensure_open()
  21570. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  21571. self.open()
  21572. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  21573. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  21574. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  21575. raise attempt.get()
  21576. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  21577. six.reraise(self.value[0], self.value[1], self.value[2])
  21578. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  21579. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  21580. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21581. self._serial.open()
  21582. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21583. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21584. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21585. 2020-08-04 12:33:38,410 [messaging :206 ][ERROR ][620] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  21586. Traceback (most recent call last):
  21587. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  21588. self._call_hook_for(message, "workflow", message)
  21589. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21590. return True, func(*args, **kwargs)
  21591. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  21592. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21593. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21594. return True, func(*args, **kwargs)
  21595. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21596. return func(*args, **kwargs)
  21597. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  21598. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  21599. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  21600. res = query("AT+QGPSLOC={:d}".format(mode))
  21601. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  21602. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  21603. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  21604. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  21605. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  21606. raise salt.exceptions.CommandExecutionError(message["error"])
  21607. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21608. 2020-08-04 12:33:41,420 [obd.obd :107 ][ERROR ][706] Failed to use explicit port '/dev/serial0'
  21609. Traceback (most recent call last):
  21610. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  21611. self.interface.open(baudrate, protocol=protocol)
  21612. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  21613. self.set_protocol(prot.pop("id", None), **prot)
  21614. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  21615. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  21616. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  21617. self._protocol = self._auto_protocol(**kwargs)
  21618. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  21619. res_0100 = self._verify_protocol("auto", test=not verify)
  21620. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  21621. for line in self.query("0100", parse=False, read_timeout=10):
  21622. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  21623. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  21624. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  21625. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  21626. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  21627. data = self._port.read(self._port.in_waiting or 1)
  21628. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  21629. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  21630. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  21631. sys.exit(salt.defaults.exitcodes.EX_OK)
  21632. SystemExit: 0
  21633. 2020-08-04 12:33:41,477 [obd.obd :120 ][WARNING ][706] Cannot load commands - no connection to bus
  21634. 2020-08-04 12:33:41,502 [obd.interfaces.elm327:730 ][ERROR ][706] Failed to relay command 'STSLCS' to interface
  21635. Traceback (most recent call last):
  21636. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  21637. lines = self.send(cmd, raw_response=raw_response)
  21638. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  21639. raise ELM327Error(self.ERRORS[line], code=line)
  21640. ELM327Error: Operation interrupted by a received RS232 character
  21641. 2020-08-04 12:33:41,505 [messaging :742 ][ERROR ][706] Exception while processing event: {'tag': 'obd/req/019a2e8e-c804-4aff-a929-1d8205d9dd4c', 'data': {'_stamp': '2020-08-04T12:33:36.212281', 'handler': 'execute', '_event_tag': 'obd/req/019a2e8e-c804-4aff-a929-1d8205d9dd4c', 'args': ['STSLCS']}}
  21642. Traceback (most recent call last):
  21643. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  21644. res = self.process(message)
  21645. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  21646. result = func(message, **settings)
  21647. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  21648. found, result = self._call_hook_for(message, "workflow", message)
  21649. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21650. return True, func(*args, **kwargs)
  21651. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  21652. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21653. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21654. return True, func(*args, **kwargs)
  21655. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21656. return func(*args, **kwargs)
  21657. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  21658. res = conn.execute(cmd)
  21659. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  21660. return func(self, *args, **kwargs)
  21661. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  21662. return self._obd.execute(cmd, **kwargs)
  21663. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  21664. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  21665. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  21666. lines = self.send(cmd, raw_response=raw_response)
  21667. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  21668. raise ELM327Error(self.ERRORS[line], code=line)
  21669. ELM327Error: Operation interrupted by a received RS232 character
  21670. 2020-08-04 12:33:42,212 [salt.utils.parsers:1050][WARNING ][418] Minion received a SIGTERM. Exiting.
  21671. 2020-08-04 12:33:42,752 [messaging :871 ][WARNING ][819] No reply message with tag 'obd/res/019a2e8e-c804-4aff-a929-1d8205d9dd4c' received within timeout of 30 secs
  21672. 2020-08-04 12:33:42,758 [salt.state :292 ][ERROR ][819] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  21673. 2020-08-04 12:33:59,196 [gpio_spi_conn :42 ][WARNING ][623] Unable to clear buffer - got unexpected value: 255
  21674. 2020-08-04 12:33:59,205 [gpio_spi_conn :42 ][WARNING ][623] Unable to clear buffer - got unexpected value: 255
  21675. 2020-08-04 12:33:59,211 [gpio_spi_conn :42 ][WARNING ][623] Unable to clear buffer - got unexpected value: 255
  21676. 2020-08-04 12:33:59,866 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  21677. Traceback (most recent call last):
  21678. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21679. self._serial.open()
  21680. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21681. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21682. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21683. 2020-08-04 12:34:00,880 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  21684. Traceback (most recent call last):
  21685. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21686. self._serial.open()
  21687. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21688. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21689. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21690. 2020-08-04 12:34:01,247 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  21691. 2020-08-04 12:34:01,750 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  21692. 2020-08-04 12:34:01,885 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  21693. Traceback (most recent call last):
  21694. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21695. self._serial.open()
  21696. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21697. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21698. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21699. 2020-08-04 12:34:02,253 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  21700. 2020-08-04 12:34:02,255 [spm_conn :139 ][WARNING ][623] Unable to get status: Expected ack '12' but got '255'
  21701. 2020-08-04 12:34:02,530 [messaging :208 ][ERROR ][620] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  21702. Traceback (most recent call last):
  21703. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  21704. self._call_hook_for(message, "workflow", message)
  21705. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21706. return True, func(*args, **kwargs)
  21707. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  21708. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21709. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21710. return True, func(*args, **kwargs)
  21711. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21712. return func(*args, **kwargs)
  21713. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  21714. res = _exec("AT+CCLK?")
  21715. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  21716. conn.write_line(cmd)
  21717. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  21718. self.ensure_open()
  21719. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  21720. self.open()
  21721. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  21722. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  21723. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  21724. raise attempt.get()
  21725. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  21726. six.reraise(self.value[0], self.value[1], self.value[2])
  21727. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  21728. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  21729. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21730. self._serial.open()
  21731. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21732. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21733. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21734. 2020-08-04 12:34:02,759 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  21735. 2020-08-04 12:34:03,263 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  21736. 2020-08-04 12:34:03,766 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  21737. 2020-08-04 12:34:03,768 [spm_conn :139 ][WARNING ][623] Unable to get status: Expected ack '12' but got '255'
  21738. 2020-08-04 12:34:04,273 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  21739. 2020-08-04 12:34:04,776 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  21740. 2020-08-04 12:34:05,279 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  21741. 2020-08-04 12:34:05,281 [spm_conn :139 ][WARNING ][623] Unable to get status: Expected ack '12' but got '255'
  21742. 2020-08-04 12:34:05,285 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  21743. 2020-08-04 12:34:05,788 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  21744. 2020-08-04 12:34:06,291 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  21745. 2020-08-04 12:34:06,294 [spm_conn :82 ][WARNING ][623] Unable to send noop: Expected ack '12' but got '255'
  21746. 2020-08-04 12:34:06,680 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  21747. Traceback (most recent call last):
  21748. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21749. self._serial.open()
  21750. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21751. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21752. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21753. 2020-08-04 12:34:06,798 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  21754. 2020-08-04 12:34:07,302 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  21755. 2020-08-04 12:34:07,686 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  21756. Traceback (most recent call last):
  21757. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21758. self._serial.open()
  21759. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21760. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21761. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21762. 2020-08-04 12:34:07,805 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  21763. 2020-08-04 12:34:07,807 [spm_conn :82 ][WARNING ][623] Unable to send noop: Expected ack '12' but got '255'
  21764. 2020-08-04 12:34:08,311 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  21765. 2020-08-04 12:34:08,690 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  21766. Traceback (most recent call last):
  21767. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21768. self._serial.open()
  21769. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21770. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21771. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21772. 2020-08-04 12:34:08,693 [messaging :742 ][ERROR ][620] Exception while processing event: {'tag': 'ec2x/req/12b22235-581f-4ad5-948a-bd0b04746a2e', 'data': {'_stamp': '2020-08-04T12:33:59.280785', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/12b22235-581f-4ad5-948a-bd0b04746a2e', 'kwargs': {'cooldown_delay': None}}}
  21773. Traceback (most recent call last):
  21774. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  21775. res = self.process(message)
  21776. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  21777. result = func(message, **settings)
  21778. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  21779. found, result = self._call_hook_for(message, "workflow", message)
  21780. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21781. return True, func(*args, **kwargs)
  21782. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  21783. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21784. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21785. return True, func(*args, **kwargs)
  21786. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21787. return func(*args, **kwargs)
  21788. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  21789. return _exec(cmd, **kwargs)
  21790. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  21791. conn.write_line(cmd)
  21792. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  21793. self.ensure_open()
  21794. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  21795. self.open()
  21796. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  21797. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  21798. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  21799. raise attempt.get()
  21800. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  21801. six.reraise(self.value[0], self.value[1], self.value[2])
  21802. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  21803. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  21804. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21805. self._serial.open()
  21806. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21807. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21808. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21809. 2020-08-04 12:34:08,815 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  21810. 2020-08-04 12:34:09,318 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  21811. 2020-08-04 12:34:09,321 [spm_conn :82 ][WARNING ][623] Unable to send noop: Expected ack '12' but got '255'
  21812. 2020-08-04 12:34:09,324 [messaging :208 ][ERROR ][623] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  21813. Traceback (most recent call last):
  21814. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  21815. self._call_hook_for(message, "workflow", message)
  21816. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21817. return True, func(*args, **kwargs)
  21818. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  21819. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21820. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21821. return True, func(*args, **kwargs)
  21822. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21823. return func(*args, **kwargs)
  21824. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  21825. conn.heartbeat()
  21826. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  21827. self.noop()
  21828. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  21829. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  21830. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  21831. raise attempt.get()
  21832. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  21833. six.reraise(self.value[0], self.value[1], self.value[2])
  21834. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  21835. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  21836. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  21837. self._begin_message()
  21838. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  21839. self.recv(ack=ACK_MESSAGE_BEGIN)
  21840. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  21841. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  21842. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  21843. raise attempt.get()
  21844. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  21845. six.reraise(self.value[0], self.value[1], self.value[2])
  21846. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  21847. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  21848. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  21849. raise Exception(msg)
  21850. Exception: Expected ack '12' but got '255'
  21851. 2020-08-04 12:34:09,368 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  21852. Traceback (most recent call last):
  21853. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21854. self._serial.open()
  21855. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21856. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21857. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21858. 2020-08-04 12:34:10,373 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  21859. Traceback (most recent call last):
  21860. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21861. self._serial.open()
  21862. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21863. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21864. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21865. 2020-08-04 12:34:11,137 [messaging :208 ][ERROR ][621] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  21866. Traceback (most recent call last):
  21867. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  21868. self._call_hook_for(message, "workflow", message)
  21869. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21870. return True, func(*args, **kwargs)
  21871. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  21872. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21873. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21874. return True, func(*args, **kwargs)
  21875. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21876. return func(*args, **kwargs)
  21877. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  21878. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  21879. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  21880. res = query("AT+QGPSLOC={:d}".format(mode))
  21881. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  21882. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  21883. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  21884. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  21885. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  21886. raise salt.exceptions.CommandExecutionError(message["error"])
  21887. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21888. 2020-08-04 12:34:11,377 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  21889. Traceback (most recent call last):
  21890. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21891. self._serial.open()
  21892. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21893. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21894. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21895. 2020-08-04 12:34:11,925 [messaging :206 ][ERROR ][620] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  21896. Traceback (most recent call last):
  21897. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  21898. self._call_hook_for(message, "workflow", message)
  21899. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21900. return True, func(*args, **kwargs)
  21901. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  21902. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21903. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21904. return True, func(*args, **kwargs)
  21905. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21906. return func(*args, **kwargs)
  21907. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  21908. res = _exec("AT+CCLK?")
  21909. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  21910. conn.write_line(cmd)
  21911. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  21912. self.ensure_open()
  21913. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  21914. self.open()
  21915. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  21916. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  21917. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  21918. raise attempt.get()
  21919. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  21920. six.reraise(self.value[0], self.value[1], self.value[2])
  21921. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  21922. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  21923. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21924. self._serial.open()
  21925. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21926. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21927. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21928. 2020-08-04 12:34:27,308 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][658] Timeout after 1.28205128205 second(s) waiting for interrupt
  21929. 2020-08-04 12:34:27,376 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  21930. Traceback (most recent call last):
  21931. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21932. self._serial.open()
  21933. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21934. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21935. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21936. 2020-08-04 12:34:28,381 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  21937. Traceback (most recent call last):
  21938. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21939. self._serial.open()
  21940. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21941. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21942. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21943. 2020-08-04 12:34:29,395 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  21944. Traceback (most recent call last):
  21945. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21946. self._serial.open()
  21947. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21948. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21949. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21950. 2020-08-04 12:34:29,399 [messaging :206 ][ERROR ][620] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  21951. Traceback (most recent call last):
  21952. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  21953. self._call_hook_for(message, "workflow", message)
  21954. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21955. return True, func(*args, **kwargs)
  21956. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  21957. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  21958. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  21959. return True, func(*args, **kwargs)
  21960. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  21961. return func(*args, **kwargs)
  21962. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  21963. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  21964. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  21965. conn.write_line(cmd)
  21966. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  21967. self.ensure_open()
  21968. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  21969. self.open()
  21970. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  21971. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  21972. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  21973. raise attempt.get()
  21974. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  21975. six.reraise(self.value[0], self.value[1], self.value[2])
  21976. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  21977. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  21978. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21979. self._serial.open()
  21980. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21981. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21982. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21983. 2020-08-04 12:34:29,401 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  21984. Traceback (most recent call last):
  21985. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21986. self._serial.open()
  21987. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21988. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21989. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21990. 2020-08-04 12:34:30,411 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  21991. Traceback (most recent call last):
  21992. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  21993. self._serial.open()
  21994. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  21995. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  21996. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  21997. 2020-08-04 12:34:31,415 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  21998. Traceback (most recent call last):
  21999. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22000. self._serial.open()
  22001. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22002. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22003. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22004. 2020-08-04 12:34:31,418 [messaging :742 ][ERROR ][620] Exception while processing event: {'tag': 'ec2x/req/95f35347-b515-4e3b-a330-6379bfdaf69a', 'data': {'_stamp': '2020-08-04T12:34:27.304393', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/95f35347-b515-4e3b-a330-6379bfdaf69a', 'kwargs': {'cooldown_delay': None}}}
  22005. Traceback (most recent call last):
  22006. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  22007. res = self.process(message)
  22008. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  22009. result = func(message, **settings)
  22010. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  22011. found, result = self._call_hook_for(message, "workflow", message)
  22012. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22013. return True, func(*args, **kwargs)
  22014. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  22015. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22016. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22017. return True, func(*args, **kwargs)
  22018. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22019. return func(*args, **kwargs)
  22020. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  22021. return _exec(cmd, **kwargs)
  22022. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  22023. conn.write_line(cmd)
  22024. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  22025. self.ensure_open()
  22026. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  22027. self.open()
  22028. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  22029. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  22030. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  22031. raise attempt.get()
  22032. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  22033. six.reraise(self.value[0], self.value[1], self.value[2])
  22034. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  22035. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  22036. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22037. self._serial.open()
  22038. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22039. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22040. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22041. 2020-08-04 12:34:31,446 [messaging :206 ][ERROR ][621] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  22042. Traceback (most recent call last):
  22043. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  22044. self._call_hook_for(message, "workflow", message)
  22045. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22046. return True, func(*args, **kwargs)
  22047. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  22048. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22049. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22050. return True, func(*args, **kwargs)
  22051. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22052. return func(*args, **kwargs)
  22053. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  22054. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  22055. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  22056. res = query("AT+QGPSLOC={:d}".format(mode))
  22057. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  22058. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  22059. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  22060. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  22061. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  22062. raise salt.exceptions.CommandExecutionError(message["error"])
  22063. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22064. 2020-08-04 12:34:36,469 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  22065. Traceback (most recent call last):
  22066. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22067. self._serial.open()
  22068. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22069. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22070. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22071. 2020-08-04 12:34:37,033 [obd.obd :107 ][ERROR ][657] Failed to use explicit port '/dev/serial0'
  22072. Traceback (most recent call last):
  22073. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  22074. self.interface.open(baudrate, protocol=protocol)
  22075. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  22076. self.set_protocol(prot.pop("id", None), **prot)
  22077. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  22078. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  22079. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  22080. self._protocol = self._auto_protocol(**kwargs)
  22081. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  22082. res_0100 = self._verify_protocol("auto", test=not verify)
  22083. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  22084. for line in self.query("0100", parse=False, read_timeout=10):
  22085. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  22086. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  22087. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  22088. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  22089. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  22090. data = self._port.read(self._port.in_waiting or 1)
  22091. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  22092. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  22093. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  22094. sys.exit(salt.defaults.exitcodes.EX_OK)
  22095. SystemExit: 0
  22096. 2020-08-04 12:34:37,068 [obd.obd :120 ][WARNING ][657] Cannot load commands - no connection to bus
  22097. 2020-08-04 12:34:37,097 [obd.interfaces.elm327:730 ][ERROR ][657] Failed to relay command 'STSLCS' to interface
  22098. Traceback (most recent call last):
  22099. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  22100. lines = self.send(cmd, raw_response=raw_response)
  22101. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  22102. raise ELM327Error(self.ERRORS[line], code=line)
  22103. ELM327Error: Operation interrupted by a received RS232 character
  22104. 2020-08-04 12:34:37,100 [messaging :742 ][ERROR ][657] Exception while processing event: {'tag': 'obd/req/9e945446-88d2-4e50-af2a-e5a0c45ee12d', 'data': {'_stamp': '2020-08-04T12:34:31.520761', 'handler': 'execute', '_event_tag': 'obd/req/9e945446-88d2-4e50-af2a-e5a0c45ee12d', 'args': ['STSLCS']}}
  22105. Traceback (most recent call last):
  22106. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  22107. res = self.process(message)
  22108. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  22109. result = func(message, **settings)
  22110. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  22111. found, result = self._call_hook_for(message, "workflow", message)
  22112. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22113. return True, func(*args, **kwargs)
  22114. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  22115. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22116. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22117. return True, func(*args, **kwargs)
  22118. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22119. return func(*args, **kwargs)
  22120. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  22121. res = conn.execute(cmd)
  22122. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  22123. return func(self, *args, **kwargs)
  22124. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  22125. return self._obd.execute(cmd, **kwargs)
  22126. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  22127. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  22128. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  22129. lines = self.send(cmd, raw_response=raw_response)
  22130. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  22131. raise ELM327Error(self.ERRORS[line], code=line)
  22132. ELM327Error: Operation interrupted by a received RS232 character
  22133. 2020-08-04 12:34:37,163 [messaging :753 ][WARNING ][620] No reply to send back for event: {'tag': 'ec2x/req/5bba2c9a-f51c-48b1-b6bc-592c9d72fc7a', 'data': {'_stamp': '2020-08-04T12:34:36.461502', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/5bba2c9a-f51c-48b1-b6bc-592c9d72fc7a', 'kwargs': {'cooldown_delay': None}}}
  22134. 2020-08-04 12:34:37,840 [salt.utils.parsers:1050][WARNING ][420] Minion received a SIGTERM. Exiting.
  22135. 2020-08-04 12:34:38,380 [messaging :871 ][WARNING ][834] No reply message with tag 'obd/res/9e945446-88d2-4e50-af2a-e5a0c45ee12d' received within timeout of 30 secs
  22136. 2020-08-04 12:34:38,383 [salt.state :292 ][ERROR ][834] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  22137. 2020-08-04 12:34:54,966 [gpio_spi_conn :42 ][WARNING ][625] Unable to clear buffer - got unexpected value: 255
  22138. 2020-08-04 12:34:54,974 [gpio_spi_conn :42 ][WARNING ][625] Unable to clear buffer - got unexpected value: 255
  22139. 2020-08-04 12:34:54,983 [gpio_spi_conn :42 ][WARNING ][625] Unable to clear buffer - got unexpected value: 255
  22140. 2020-08-04 12:34:55,632 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  22141. Traceback (most recent call last):
  22142. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22143. self._serial.open()
  22144. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22145. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22146. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22147. 2020-08-04 12:34:56,645 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  22148. Traceback (most recent call last):
  22149. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22150. self._serial.open()
  22151. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22152. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22153. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22154. 2020-08-04 12:34:57,010 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  22155. 2020-08-04 12:34:57,513 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  22156. 2020-08-04 12:34:57,649 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  22157. Traceback (most recent call last):
  22158. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22159. self._serial.open()
  22160. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22161. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22162. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22163. 2020-08-04 12:34:58,017 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  22164. 2020-08-04 12:34:58,019 [spm_conn :139 ][WARNING ][625] Unable to get status: Expected ack '12' but got '255'
  22165. 2020-08-04 12:34:58,292 [messaging :208 ][ERROR ][622] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  22166. Traceback (most recent call last):
  22167. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  22168. self._call_hook_for(message, "workflow", message)
  22169. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22170. return True, func(*args, **kwargs)
  22171. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  22172. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22173. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22174. return True, func(*args, **kwargs)
  22175. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22176. return func(*args, **kwargs)
  22177. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  22178. res = _exec("AT+CCLK?")
  22179. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  22180. conn.write_line(cmd)
  22181. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  22182. self.ensure_open()
  22183. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  22184. self.open()
  22185. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  22186. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  22187. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  22188. raise attempt.get()
  22189. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  22190. six.reraise(self.value[0], self.value[1], self.value[2])
  22191. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  22192. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  22193. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22194. self._serial.open()
  22195. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22196. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22197. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22198. 2020-08-04 12:34:58,523 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  22199. 2020-08-04 12:35:13,327 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][662] Timeout after 1.28205128205 second(s) waiting for interrupt
  22200. 2020-08-04 12:35:13,352 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  22201. Traceback (most recent call last):
  22202. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22203. self._serial.open()
  22204. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22205. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22206. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22207. 2020-08-04 12:35:13,617 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  22208. 2020-08-04 12:35:14,121 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  22209. 2020-08-04 12:35:14,124 [spm_conn :139 ][WARNING ][625] Unable to get status: Expected ack '12' but got '255'
  22210. 2020-08-04 12:35:14,357 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  22211. Traceback (most recent call last):
  22212. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22213. self._serial.open()
  22214. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22215. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22216. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22217. 2020-08-04 12:35:14,628 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  22218. 2020-08-04 12:35:15,131 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  22219. 2020-08-04 12:35:15,361 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  22220. Traceback (most recent call last):
  22221. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22222. self._serial.open()
  22223. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22224. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22225. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22226. 2020-08-04 12:35:15,365 [messaging :206 ][ERROR ][622] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  22227. Traceback (most recent call last):
  22228. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  22229. self._call_hook_for(message, "workflow", message)
  22230. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22231. return True, func(*args, **kwargs)
  22232. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  22233. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22234. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22235. return True, func(*args, **kwargs)
  22236. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22237. return func(*args, **kwargs)
  22238. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  22239. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  22240. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  22241. conn.write_line(cmd)
  22242. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  22243. self.ensure_open()
  22244. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  22245. self.open()
  22246. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  22247. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  22248. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  22249. raise attempt.get()
  22250. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  22251. six.reraise(self.value[0], self.value[1], self.value[2])
  22252. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  22253. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  22254. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22255. self._serial.open()
  22256. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22257. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22258. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22259. 2020-08-04 12:35:15,634 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  22260. 2020-08-04 12:35:15,636 [spm_conn :139 ][WARNING ][625] Unable to get status: Expected ack '12' but got '255'
  22261. 2020-08-04 12:35:15,639 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  22262. 2020-08-04 12:35:16,142 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  22263. 2020-08-04 12:35:16,645 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  22264. 2020-08-04 12:35:16,647 [spm_conn :82 ][WARNING ][625] Unable to send noop: Expected ack '12' but got '255'
  22265. 2020-08-04 12:35:17,064 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  22266. Traceback (most recent call last):
  22267. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22268. self._serial.open()
  22269. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22270. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22271. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22272. 2020-08-04 12:35:17,152 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  22273. 2020-08-04 12:35:17,655 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  22274. 2020-08-04 12:35:18,068 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  22275. Traceback (most recent call last):
  22276. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22277. self._serial.open()
  22278. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22279. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22280. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22281. 2020-08-04 12:35:18,162 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  22282. 2020-08-04 12:35:18,164 [spm_conn :82 ][WARNING ][625] Unable to send noop: Expected ack '12' but got '255'
  22283. 2020-08-04 12:35:18,668 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  22284. 2020-08-04 12:35:19,072 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  22285. Traceback (most recent call last):
  22286. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22287. self._serial.open()
  22288. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22289. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22290. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22291. 2020-08-04 12:35:19,084 [messaging :742 ][ERROR ][622] Exception while processing event: {'tag': 'ec2x/req/b42b8d44-8e92-4e4a-bdfd-cbf3aad23df8', 'data': {'_stamp': '2020-08-04T12:34:55.058816', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/b42b8d44-8e92-4e4a-bdfd-cbf3aad23df8', 'kwargs': {'cooldown_delay': None}}}
  22292. Traceback (most recent call last):
  22293. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  22294. res = self.process(message)
  22295. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  22296. result = func(message, **settings)
  22297. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  22298. found, result = self._call_hook_for(message, "workflow", message)
  22299. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22300. return True, func(*args, **kwargs)
  22301. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  22302. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22303. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22304. return True, func(*args, **kwargs)
  22305. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22306. return func(*args, **kwargs)
  22307. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  22308. return _exec(cmd, **kwargs)
  22309. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  22310. conn.write_line(cmd)
  22311. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  22312. self.ensure_open()
  22313. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  22314. self.open()
  22315. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  22316. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  22317. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  22318. raise attempt.get()
  22319. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  22320. six.reraise(self.value[0], self.value[1], self.value[2])
  22321. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  22322. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  22323. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22324. self._serial.open()
  22325. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22326. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22327. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22328. 2020-08-04 12:35:19,171 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  22329. 2020-08-04 12:35:19,674 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  22330. 2020-08-04 12:35:19,676 [spm_conn :82 ][WARNING ][625] Unable to send noop: Expected ack '12' but got '255'
  22331. 2020-08-04 12:35:19,679 [messaging :208 ][ERROR ][625] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  22332. Traceback (most recent call last):
  22333. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  22334. self._call_hook_for(message, "workflow", message)
  22335. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22336. return True, func(*args, **kwargs)
  22337. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  22338. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22339. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22340. return True, func(*args, **kwargs)
  22341. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22342. return func(*args, **kwargs)
  22343. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  22344. conn.heartbeat()
  22345. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  22346. self.noop()
  22347. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  22348. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  22349. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  22350. raise attempt.get()
  22351. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  22352. six.reraise(self.value[0], self.value[1], self.value[2])
  22353. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  22354. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  22355. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  22356. self._begin_message()
  22357. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  22358. self.recv(ack=ACK_MESSAGE_BEGIN)
  22359. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  22360. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  22361. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  22362. raise attempt.get()
  22363. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  22364. six.reraise(self.value[0], self.value[1], self.value[2])
  22365. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  22366. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  22367. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  22368. raise Exception(msg)
  22369. Exception: Expected ack '12' but got '255'
  22370. 2020-08-04 12:35:21,192 [messaging :208 ][ERROR ][623] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  22371. Traceback (most recent call last):
  22372. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  22373. self._call_hook_for(message, "workflow", message)
  22374. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22375. return True, func(*args, **kwargs)
  22376. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  22377. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22378. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22379. return True, func(*args, **kwargs)
  22380. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22381. return func(*args, **kwargs)
  22382. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  22383. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  22384. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  22385. res = query("AT+QGPSLOC={:d}".format(mode))
  22386. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  22387. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  22388. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  22389. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  22390. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  22391. raise salt.exceptions.CommandExecutionError(message["error"])
  22392. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22393. 2020-08-04 12:35:26,247 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  22394. Traceback (most recent call last):
  22395. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22396. self._serial.open()
  22397. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22398. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22399. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22400. 2020-08-04 12:35:27,251 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  22401. Traceback (most recent call last):
  22402. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22403. self._serial.open()
  22404. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22405. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22406. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22407. 2020-08-04 12:35:28,255 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  22408. Traceback (most recent call last):
  22409. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22410. self._serial.open()
  22411. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22412. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22413. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22414. 2020-08-04 12:35:28,258 [messaging :742 ][ERROR ][622] Exception while processing event: {'tag': 'ec2x/req/004b5817-d3d2-4930-b3f6-acaae16ba2fd', 'data': {'_stamp': '2020-08-04T12:35:26.235966', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/004b5817-d3d2-4930-b3f6-acaae16ba2fd', 'kwargs': {'cooldown_delay': None}}}
  22415. Traceback (most recent call last):
  22416. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  22417. res = self.process(message)
  22418. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  22419. result = func(message, **settings)
  22420. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  22421. found, result = self._call_hook_for(message, "workflow", message)
  22422. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22423. return True, func(*args, **kwargs)
  22424. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  22425. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22426. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22427. return True, func(*args, **kwargs)
  22428. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22429. return func(*args, **kwargs)
  22430. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  22431. return _exec(cmd, **kwargs)
  22432. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  22433. conn.write_line(cmd)
  22434. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  22435. self.ensure_open()
  22436. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  22437. self.open()
  22438. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  22439. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  22440. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  22441. raise attempt.get()
  22442. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  22443. six.reraise(self.value[0], self.value[1], self.value[2])
  22444. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  22445. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  22446. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22447. self._serial.open()
  22448. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22449. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22450. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22451. 2020-08-04 12:35:28,279 [messaging :206 ][ERROR ][623] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  22452. Traceback (most recent call last):
  22453. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  22454. self._call_hook_for(message, "workflow", message)
  22455. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22456. return True, func(*args, **kwargs)
  22457. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  22458. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22459. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22460. return True, func(*args, **kwargs)
  22461. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22462. return func(*args, **kwargs)
  22463. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  22464. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  22465. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  22466. res = query("AT+QGPSLOC={:d}".format(mode))
  22467. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  22468. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  22469. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  22470. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  22471. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  22472. raise salt.exceptions.CommandExecutionError(message["error"])
  22473. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22474. 2020-08-04 12:35:31,521 [obd.obd :107 ][ERROR ][659] Failed to use explicit port '/dev/serial0'
  22475. Traceback (most recent call last):
  22476. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  22477. self.interface.open(baudrate, protocol=protocol)
  22478. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  22479. self.set_protocol(prot.pop("id", None), **prot)
  22480. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  22481. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  22482. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  22483. self._protocol = self._auto_protocol(**kwargs)
  22484. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  22485. res_0100 = self._verify_protocol("auto", test=not verify)
  22486. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  22487. for line in self.query("0100", parse=False, read_timeout=10):
  22488. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  22489. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  22490. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  22491. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  22492. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  22493. data = self._port.read(self._port.in_waiting or 1)
  22494. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  22495. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  22496. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  22497. sys.exit(salt.defaults.exitcodes.EX_OK)
  22498. SystemExit: 0
  22499. 2020-08-04 12:35:31,553 [obd.obd :120 ][WARNING ][659] Cannot load commands - no connection to bus
  22500. 2020-08-04 12:35:31,583 [obd.interfaces.elm327:730 ][ERROR ][659] Failed to relay command 'STSLCS' to interface
  22501. Traceback (most recent call last):
  22502. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  22503. lines = self.send(cmd, raw_response=raw_response)
  22504. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  22505. raise ELM327Error(self.ERRORS[line], code=line)
  22506. ELM327Error: Operation interrupted by a received RS232 character
  22507. 2020-08-04 12:35:31,586 [messaging :742 ][ERROR ][659] Exception while processing event: {'tag': 'obd/req/49d266cd-0ca8-4d57-b984-e9cc4b55a0be', 'data': {'_stamp': '2020-08-04T12:35:26.001828', 'handler': 'execute', '_event_tag': 'obd/req/49d266cd-0ca8-4d57-b984-e9cc4b55a0be', 'args': ['STSLCS']}}
  22508. Traceback (most recent call last):
  22509. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  22510. res = self.process(message)
  22511. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  22512. result = func(message, **settings)
  22513. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  22514. found, result = self._call_hook_for(message, "workflow", message)
  22515. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22516. return True, func(*args, **kwargs)
  22517. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  22518. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22519. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22520. return True, func(*args, **kwargs)
  22521. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22522. return func(*args, **kwargs)
  22523. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  22524. res = conn.execute(cmd)
  22525. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  22526. return func(self, *args, **kwargs)
  22527. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  22528. return self._obd.execute(cmd, **kwargs)
  22529. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  22530. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  22531. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  22532. lines = self.send(cmd, raw_response=raw_response)
  22533. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  22534. raise ELM327Error(self.ERRORS[line], code=line)
  22535. ELM327Error: Operation interrupted by a received RS232 character
  22536. 2020-08-04 12:35:32,319 [salt.utils.parsers:1050][WARNING ][421] Minion received a SIGTERM. Exiting.
  22537. 2020-08-04 12:35:32,859 [messaging :871 ][WARNING ][822] No reply message with tag 'obd/res/49d266cd-0ca8-4d57-b984-e9cc4b55a0be' received within timeout of 30 secs
  22538. 2020-08-04 12:35:32,863 [salt.state :292 ][ERROR ][822] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  22539. 2020-08-04 12:35:50,092 [gpio_spi_conn :42 ][WARNING ][623] Unable to clear buffer - got unexpected value: 255
  22540. 2020-08-04 12:35:50,102 [gpio_spi_conn :42 ][WARNING ][623] Unable to clear buffer - got unexpected value: 255
  22541. 2020-08-04 12:35:50,107 [gpio_spi_conn :42 ][WARNING ][623] Unable to clear buffer - got unexpected value: 255
  22542. 2020-08-04 12:35:50,791 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  22543. Traceback (most recent call last):
  22544. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22545. self._serial.open()
  22546. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22547. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22548. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22549. 2020-08-04 12:35:51,803 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  22550. Traceback (most recent call last):
  22551. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22552. self._serial.open()
  22553. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22554. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22555. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22556. 2020-08-04 12:35:52,139 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  22557. 2020-08-04 12:35:52,642 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  22558. 2020-08-04 12:35:52,807 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  22559. Traceback (most recent call last):
  22560. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22561. self._serial.open()
  22562. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22563. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22564. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22565. 2020-08-04 12:35:53,145 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  22566. 2020-08-04 12:35:53,147 [spm_conn :139 ][WARNING ][623] Unable to get status: Expected ack '12' but got '255'
  22567. 2020-08-04 12:35:53,392 [messaging :208 ][ERROR ][620] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  22568. Traceback (most recent call last):
  22569. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  22570. self._call_hook_for(message, "workflow", message)
  22571. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22572. return True, func(*args, **kwargs)
  22573. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  22574. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22575. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22576. return True, func(*args, **kwargs)
  22577. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22578. return func(*args, **kwargs)
  22579. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  22580. res = _exec("AT+CCLK?")
  22581. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  22582. conn.write_line(cmd)
  22583. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  22584. self.ensure_open()
  22585. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  22586. self.open()
  22587. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  22588. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  22589. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  22590. raise attempt.get()
  22591. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  22592. six.reraise(self.value[0], self.value[1], self.value[2])
  22593. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  22594. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  22595. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22596. self._serial.open()
  22597. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22598. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22599. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22600. 2020-08-04 12:35:53,665 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  22601. 2020-08-04 12:36:07,947 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][708] Timeout after 1.28205128205 second(s) waiting for interrupt
  22602. 2020-08-04 12:36:07,996 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  22603. Traceback (most recent call last):
  22604. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22605. self._serial.open()
  22606. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22607. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22608. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22609. 2020-08-04 12:36:08,316 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  22610. 2020-08-04 12:36:08,819 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  22611. 2020-08-04 12:36:08,821 [spm_conn :139 ][WARNING ][623] Unable to get status: Expected ack '12' but got '255'
  22612. 2020-08-04 12:36:09,012 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  22613. Traceback (most recent call last):
  22614. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22615. self._serial.open()
  22616. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22617. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22618. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22619. 2020-08-04 12:36:09,325 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  22620. 2020-08-04 12:36:09,828 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  22621. 2020-08-04 12:36:10,017 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  22622. Traceback (most recent call last):
  22623. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22624. self._serial.open()
  22625. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22626. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22627. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22628. 2020-08-04 12:36:10,020 [messaging :206 ][ERROR ][620] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  22629. Traceback (most recent call last):
  22630. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  22631. self._call_hook_for(message, "workflow", message)
  22632. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22633. return True, func(*args, **kwargs)
  22634. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  22635. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22636. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22637. return True, func(*args, **kwargs)
  22638. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22639. return func(*args, **kwargs)
  22640. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  22641. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  22642. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  22643. conn.write_line(cmd)
  22644. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  22645. self.ensure_open()
  22646. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  22647. self.open()
  22648. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  22649. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  22650. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  22651. raise attempt.get()
  22652. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  22653. six.reraise(self.value[0], self.value[1], self.value[2])
  22654. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  22655. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  22656. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22657. self._serial.open()
  22658. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22659. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22660. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22661. 2020-08-04 12:36:10,331 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  22662. 2020-08-04 12:36:10,334 [spm_conn :139 ][WARNING ][623] Unable to get status: Expected ack '12' but got '255'
  22663. 2020-08-04 12:36:10,337 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  22664. 2020-08-04 12:36:10,840 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  22665. 2020-08-04 12:36:11,344 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  22666. 2020-08-04 12:36:11,347 [spm_conn :82 ][WARNING ][623] Unable to send noop: Expected ack '12' but got '255'
  22667. 2020-08-04 12:36:11,730 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  22668. Traceback (most recent call last):
  22669. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22670. self._serial.open()
  22671. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22672. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22673. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22674. 2020-08-04 12:36:11,851 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  22675. 2020-08-04 12:36:12,354 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  22676. 2020-08-04 12:36:12,734 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  22677. Traceback (most recent call last):
  22678. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22679. self._serial.open()
  22680. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22681. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22682. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22683. 2020-08-04 12:36:12,857 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  22684. 2020-08-04 12:36:12,860 [spm_conn :82 ][WARNING ][623] Unable to send noop: Expected ack '12' but got '255'
  22685. 2020-08-04 12:36:13,363 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  22686. 2020-08-04 12:36:13,738 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  22687. Traceback (most recent call last):
  22688. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22689. self._serial.open()
  22690. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22691. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22692. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22693. 2020-08-04 12:36:13,741 [messaging :742 ][ERROR ][620] Exception while processing event: {'tag': 'ec2x/req/5502f6b0-bc44-4115-b1c9-70b21bb8d7a6', 'data': {'_stamp': '2020-08-04T12:35:50.171774', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/5502f6b0-bc44-4115-b1c9-70b21bb8d7a6', 'kwargs': {'cooldown_delay': None}}}
  22694. Traceback (most recent call last):
  22695. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  22696. res = self.process(message)
  22697. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  22698. result = func(message, **settings)
  22699. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  22700. found, result = self._call_hook_for(message, "workflow", message)
  22701. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22702. return True, func(*args, **kwargs)
  22703. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  22704. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22705. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22706. return True, func(*args, **kwargs)
  22707. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22708. return func(*args, **kwargs)
  22709. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  22710. return _exec(cmd, **kwargs)
  22711. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  22712. conn.write_line(cmd)
  22713. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  22714. self.ensure_open()
  22715. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  22716. self.open()
  22717. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  22718. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  22719. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  22720. raise attempt.get()
  22721. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  22722. six.reraise(self.value[0], self.value[1], self.value[2])
  22723. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  22724. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  22725. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22726. self._serial.open()
  22727. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22728. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22729. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22730. 2020-08-04 12:36:13,866 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  22731. 2020-08-04 12:36:14,370 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  22732. 2020-08-04 12:36:14,372 [spm_conn :82 ][WARNING ][623] Unable to send noop: Expected ack '12' but got '255'
  22733. 2020-08-04 12:36:14,375 [messaging :208 ][ERROR ][623] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  22734. Traceback (most recent call last):
  22735. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  22736. self._call_hook_for(message, "workflow", message)
  22737. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22738. return True, func(*args, **kwargs)
  22739. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  22740. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22741. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22742. return True, func(*args, **kwargs)
  22743. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22744. return func(*args, **kwargs)
  22745. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  22746. conn.heartbeat()
  22747. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  22748. self.noop()
  22749. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  22750. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  22751. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  22752. raise attempt.get()
  22753. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  22754. six.reraise(self.value[0], self.value[1], self.value[2])
  22755. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  22756. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  22757. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  22758. self._begin_message()
  22759. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  22760. self.recv(ack=ACK_MESSAGE_BEGIN)
  22761. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  22762. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  22763. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  22764. raise attempt.get()
  22765. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  22766. six.reraise(self.value[0], self.value[1], self.value[2])
  22767. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  22768. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  22769. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  22770. raise Exception(msg)
  22771. Exception: Expected ack '12' but got '255'
  22772. 2020-08-04 12:36:15,918 [messaging :208 ][ERROR ][621] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  22773. Traceback (most recent call last):
  22774. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  22775. self._call_hook_for(message, "workflow", message)
  22776. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22777. return True, func(*args, **kwargs)
  22778. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  22779. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22780. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22781. return True, func(*args, **kwargs)
  22782. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22783. return func(*args, **kwargs)
  22784. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  22785. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  22786. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  22787. res = query("AT+QGPSLOC={:d}".format(mode))
  22788. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  22789. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  22790. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  22791. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  22792. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  22793. raise salt.exceptions.CommandExecutionError(message["error"])
  22794. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22795. 2020-08-04 12:36:20,972 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  22796. Traceback (most recent call last):
  22797. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22798. self._serial.open()
  22799. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22800. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22801. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22802. 2020-08-04 12:36:21,977 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  22803. Traceback (most recent call last):
  22804. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22805. self._serial.open()
  22806. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22807. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22808. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22809. 2020-08-04 12:36:22,981 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  22810. Traceback (most recent call last):
  22811. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22812. self._serial.open()
  22813. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22814. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22815. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22816. 2020-08-04 12:36:22,984 [messaging :742 ][ERROR ][620] Exception while processing event: {'tag': 'ec2x/req/733637ad-8015-481c-91c0-a18b923c0875', 'data': {'_stamp': '2020-08-04T12:36:20.959626', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/733637ad-8015-481c-91c0-a18b923c0875', 'kwargs': {'cooldown_delay': None}}}
  22817. Traceback (most recent call last):
  22818. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  22819. res = self.process(message)
  22820. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  22821. result = func(message, **settings)
  22822. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  22823. found, result = self._call_hook_for(message, "workflow", message)
  22824. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22825. return True, func(*args, **kwargs)
  22826. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  22827. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22828. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22829. return True, func(*args, **kwargs)
  22830. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22831. return func(*args, **kwargs)
  22832. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  22833. return _exec(cmd, **kwargs)
  22834. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  22835. conn.write_line(cmd)
  22836. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  22837. self.ensure_open()
  22838. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  22839. self.open()
  22840. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  22841. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  22842. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  22843. raise attempt.get()
  22844. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  22845. six.reraise(self.value[0], self.value[1], self.value[2])
  22846. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  22847. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  22848. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22849. self._serial.open()
  22850. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22851. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22852. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22853. 2020-08-04 12:36:23,024 [messaging :206 ][ERROR ][621] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  22854. Traceback (most recent call last):
  22855. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  22856. self._call_hook_for(message, "workflow", message)
  22857. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22858. return True, func(*args, **kwargs)
  22859. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  22860. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22861. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22862. return True, func(*args, **kwargs)
  22863. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22864. return func(*args, **kwargs)
  22865. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  22866. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  22867. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  22868. res = query("AT+QGPSLOC={:d}".format(mode))
  22869. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  22870. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  22871. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  22872. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  22873. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  22874. raise salt.exceptions.CommandExecutionError(message["error"])
  22875. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22876. 2020-08-04 12:36:26,369 [obd.obd :107 ][ERROR ][707] Failed to use explicit port '/dev/serial0'
  22877. Traceback (most recent call last):
  22878. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  22879. self.interface.open(baudrate, protocol=protocol)
  22880. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  22881. self.set_protocol(prot.pop("id", None), **prot)
  22882. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  22883. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  22884. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  22885. self._protocol = self._auto_protocol(**kwargs)
  22886. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  22887. res_0100 = self._verify_protocol("auto", test=not verify)
  22888. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  22889. for line in self.query("0100", parse=False, read_timeout=10):
  22890. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  22891. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  22892. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  22893. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  22894. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  22895. data = self._port.read(self._port.in_waiting or 1)
  22896. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  22897. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  22898. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  22899. sys.exit(salt.defaults.exitcodes.EX_OK)
  22900. SystemExit: 0
  22901. 2020-08-04 12:36:26,406 [obd.obd :120 ][WARNING ][707] Cannot load commands - no connection to bus
  22902. 2020-08-04 12:36:26,435 [obd.interfaces.elm327:730 ][ERROR ][707] Failed to relay command 'STSLCS' to interface
  22903. Traceback (most recent call last):
  22904. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  22905. lines = self.send(cmd, raw_response=raw_response)
  22906. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  22907. raise ELM327Error(self.ERRORS[line], code=line)
  22908. ELM327Error: Operation interrupted by a received RS232 character
  22909. 2020-08-04 12:36:26,438 [messaging :742 ][ERROR ][707] Exception while processing event: {'tag': 'obd/req/b4de1ed5-1025-40cc-a2f4-85e4b8e0f015', 'data': {'_stamp': '2020-08-04T12:36:20.924321', 'handler': 'execute', '_event_tag': 'obd/req/b4de1ed5-1025-40cc-a2f4-85e4b8e0f015', 'args': ['STSLCS']}}
  22910. Traceback (most recent call last):
  22911. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  22912. res = self.process(message)
  22913. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  22914. result = func(message, **settings)
  22915. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  22916. found, result = self._call_hook_for(message, "workflow", message)
  22917. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22918. return True, func(*args, **kwargs)
  22919. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  22920. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22921. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22922. return True, func(*args, **kwargs)
  22923. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22924. return func(*args, **kwargs)
  22925. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  22926. res = conn.execute(cmd)
  22927. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  22928. return func(self, *args, **kwargs)
  22929. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  22930. return self._obd.execute(cmd, **kwargs)
  22931. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  22932. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  22933. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  22934. lines = self.send(cmd, raw_response=raw_response)
  22935. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  22936. raise ELM327Error(self.ERRORS[line], code=line)
  22937. ELM327Error: Operation interrupted by a received RS232 character
  22938. 2020-08-04 12:36:27,306 [salt.utils.parsers:1050][WARNING ][420] Minion received a SIGTERM. Exiting.
  22939. 2020-08-04 12:36:27,844 [messaging :871 ][WARNING ][820] No reply message with tag 'obd/res/b4de1ed5-1025-40cc-a2f4-85e4b8e0f015' received within timeout of 30 secs
  22940. 2020-08-04 12:36:27,848 [salt.state :292 ][ERROR ][820] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  22941. 2020-08-04 12:36:45,082 [gpio_spi_conn :42 ][WARNING ][632] Unable to clear buffer - got unexpected value: 255
  22942. 2020-08-04 12:36:45,098 [gpio_spi_conn :42 ][WARNING ][632] Unable to clear buffer - got unexpected value: 255
  22943. 2020-08-04 12:36:45,107 [gpio_spi_conn :42 ][WARNING ][632] Unable to clear buffer - got unexpected value: 255
  22944. 2020-08-04 12:36:45,778 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  22945. Traceback (most recent call last):
  22946. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22947. self._serial.open()
  22948. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22949. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22950. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22951. 2020-08-04 12:36:46,802 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  22952. Traceback (most recent call last):
  22953. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22954. self._serial.open()
  22955. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22956. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22957. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22958. 2020-08-04 12:36:47,140 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  22959. 2020-08-04 12:36:47,645 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  22960. 2020-08-04 12:36:47,814 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  22961. Traceback (most recent call last):
  22962. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22963. self._serial.open()
  22964. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  22965. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  22966. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  22967. 2020-08-04 12:36:48,150 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  22968. 2020-08-04 12:36:48,152 [spm_conn :139 ][WARNING ][632] Unable to get status: Expected ack '12' but got '255'
  22969. 2020-08-04 12:36:48,433 [messaging :208 ][ERROR ][629] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  22970. Traceback (most recent call last):
  22971. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  22972. self._call_hook_for(message, "workflow", message)
  22973. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22974. return True, func(*args, **kwargs)
  22975. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  22976. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  22977. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  22978. return True, func(*args, **kwargs)
  22979. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  22980. return func(*args, **kwargs)
  22981. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  22982. res = _exec("AT+CCLK?")
  22983. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  22984. conn.write_line(cmd)
  22985. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  22986. self.ensure_open()
  22987. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  22988. self.open()
  22989. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  22990. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  22991. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  22992. raise attempt.get()
  22993. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  22994. six.reraise(self.value[0], self.value[1], self.value[2])
  22995. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  22996. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  22997. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  22998. self._serial.open()
  22999. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23000. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23001. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23002. 2020-08-04 12:36:48,659 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  23003. 2020-08-04 12:37:02,940 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][669] Timeout after 1.28205128205 second(s) waiting for interrupt
  23004. 2020-08-04 12:37:03,002 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  23005. Traceback (most recent call last):
  23006. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23007. self._serial.open()
  23008. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23009. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23010. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23011. 2020-08-04 12:37:03,261 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  23012. 2020-08-04 12:37:03,764 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  23013. 2020-08-04 12:37:03,767 [spm_conn :139 ][WARNING ][632] Unable to get status: Expected ack '12' but got '255'
  23014. 2020-08-04 12:37:04,007 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  23015. Traceback (most recent call last):
  23016. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23017. self._serial.open()
  23018. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23019. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23020. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23021. 2020-08-04 12:37:04,271 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  23022. 2020-08-04 12:37:04,775 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  23023. 2020-08-04 12:37:05,011 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  23024. Traceback (most recent call last):
  23025. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23026. self._serial.open()
  23027. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23028. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23029. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23030. 2020-08-04 12:37:05,015 [messaging :206 ][ERROR ][629] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  23031. Traceback (most recent call last):
  23032. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  23033. self._call_hook_for(message, "workflow", message)
  23034. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23035. return True, func(*args, **kwargs)
  23036. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  23037. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23038. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23039. return True, func(*args, **kwargs)
  23040. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23041. return func(*args, **kwargs)
  23042. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  23043. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  23044. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  23045. conn.write_line(cmd)
  23046. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  23047. self.ensure_open()
  23048. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  23049. self.open()
  23050. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  23051. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  23052. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  23053. raise attempt.get()
  23054. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  23055. six.reraise(self.value[0], self.value[1], self.value[2])
  23056. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  23057. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  23058. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23059. self._serial.open()
  23060. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23061. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23062. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23063. 2020-08-04 12:37:05,278 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  23064. 2020-08-04 12:37:05,280 [spm_conn :139 ][WARNING ][632] Unable to get status: Expected ack '12' but got '255'
  23065. 2020-08-04 12:37:05,284 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  23066. 2020-08-04 12:37:05,787 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  23067. 2020-08-04 12:37:06,290 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  23068. 2020-08-04 12:37:06,293 [spm_conn :82 ][WARNING ][632] Unable to send noop: Expected ack '12' but got '255'
  23069. 2020-08-04 12:37:06,652 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  23070. Traceback (most recent call last):
  23071. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23072. self._serial.open()
  23073. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23074. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23075. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23076. 2020-08-04 12:37:06,796 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  23077. 2020-08-04 12:37:07,299 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  23078. 2020-08-04 12:37:07,657 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  23079. Traceback (most recent call last):
  23080. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23081. self._serial.open()
  23082. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23083. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23084. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23085. 2020-08-04 12:37:07,802 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  23086. 2020-08-04 12:37:07,804 [spm_conn :82 ][WARNING ][632] Unable to send noop: Expected ack '12' but got '255'
  23087. 2020-08-04 12:37:08,308 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  23088. 2020-08-04 12:37:08,661 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  23089. Traceback (most recent call last):
  23090. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23091. self._serial.open()
  23092. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23093. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23094. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23095. 2020-08-04 12:37:08,672 [messaging :742 ][ERROR ][629] Exception while processing event: {'tag': 'ec2x/req/e37cc82f-fac3-4b91-ba8a-9f0d48469c76', 'data': {'_stamp': '2020-08-04T12:36:45.148491', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/e37cc82f-fac3-4b91-ba8a-9f0d48469c76', 'kwargs': {'cooldown_delay': None}}}
  23096. Traceback (most recent call last):
  23097. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  23098. res = self.process(message)
  23099. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  23100. result = func(message, **settings)
  23101. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  23102. found, result = self._call_hook_for(message, "workflow", message)
  23103. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23104. return True, func(*args, **kwargs)
  23105. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  23106. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23107. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23108. return True, func(*args, **kwargs)
  23109. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23110. return func(*args, **kwargs)
  23111. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  23112. return _exec(cmd, **kwargs)
  23113. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  23114. conn.write_line(cmd)
  23115. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  23116. self.ensure_open()
  23117. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  23118. self.open()
  23119. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  23120. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  23121. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  23122. raise attempt.get()
  23123. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  23124. six.reraise(self.value[0], self.value[1], self.value[2])
  23125. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  23126. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  23127. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23128. self._serial.open()
  23129. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23130. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23131. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23132. 2020-08-04 12:37:08,811 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  23133. 2020-08-04 12:37:09,314 [gpio_spi_conn :109 ][WARNING ][632] Expected ack '12' but got '255'
  23134. 2020-08-04 12:37:09,317 [spm_conn :82 ][WARNING ][632] Unable to send noop: Expected ack '12' but got '255'
  23135. 2020-08-04 12:37:09,319 [messaging :208 ][ERROR ][632] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  23136. Traceback (most recent call last):
  23137. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  23138. self._call_hook_for(message, "workflow", message)
  23139. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23140. return True, func(*args, **kwargs)
  23141. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  23142. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23143. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23144. return True, func(*args, **kwargs)
  23145. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23146. return func(*args, **kwargs)
  23147. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  23148. conn.heartbeat()
  23149. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  23150. self.noop()
  23151. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  23152. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  23153. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  23154. raise attempt.get()
  23155. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  23156. six.reraise(self.value[0], self.value[1], self.value[2])
  23157. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  23158. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  23159. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  23160. self._begin_message()
  23161. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  23162. self.recv(ack=ACK_MESSAGE_BEGIN)
  23163. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  23164. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  23165. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  23166. raise attempt.get()
  23167. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  23168. six.reraise(self.value[0], self.value[1], self.value[2])
  23169. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  23170. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  23171. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  23172. raise Exception(msg)
  23173. Exception: Expected ack '12' but got '255'
  23174. 2020-08-04 12:37:10,831 [messaging :208 ][ERROR ][630] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  23175. Traceback (most recent call last):
  23176. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  23177. self._call_hook_for(message, "workflow", message)
  23178. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23179. return True, func(*args, **kwargs)
  23180. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  23181. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23182. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23183. return True, func(*args, **kwargs)
  23184. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23185. return func(*args, **kwargs)
  23186. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  23187. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  23188. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  23189. res = query("AT+QGPSLOC={:d}".format(mode))
  23190. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  23191. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  23192. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  23193. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  23194. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  23195. raise salt.exceptions.CommandExecutionError(message["error"])
  23196. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23197. 2020-08-04 12:37:15,913 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  23198. Traceback (most recent call last):
  23199. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23200. self._serial.open()
  23201. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23202. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23203. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23204. 2020-08-04 12:37:16,922 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  23205. Traceback (most recent call last):
  23206. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23207. self._serial.open()
  23208. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23209. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23210. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23211. 2020-08-04 12:37:17,926 [serial_conn :79 ][ERROR ][629] Failed to open serial connection
  23212. Traceback (most recent call last):
  23213. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23214. self._serial.open()
  23215. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23216. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23217. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23218. 2020-08-04 12:37:17,930 [messaging :742 ][ERROR ][629] Exception while processing event: {'tag': 'ec2x/req/713bf2c7-cf66-4d48-b3da-f9e80407ebed', 'data': {'_stamp': '2020-08-04T12:37:15.906495', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/713bf2c7-cf66-4d48-b3da-f9e80407ebed', 'kwargs': {'cooldown_delay': None}}}
  23219. Traceback (most recent call last):
  23220. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  23221. res = self.process(message)
  23222. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  23223. result = func(message, **settings)
  23224. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  23225. found, result = self._call_hook_for(message, "workflow", message)
  23226. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23227. return True, func(*args, **kwargs)
  23228. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  23229. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23230. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23231. return True, func(*args, **kwargs)
  23232. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23233. return func(*args, **kwargs)
  23234. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  23235. return _exec(cmd, **kwargs)
  23236. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  23237. conn.write_line(cmd)
  23238. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  23239. self.ensure_open()
  23240. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  23241. self.open()
  23242. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  23243. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  23244. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  23245. raise attempt.get()
  23246. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  23247. six.reraise(self.value[0], self.value[1], self.value[2])
  23248. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  23249. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  23250. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23251. self._serial.open()
  23252. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23253. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23254. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23255. 2020-08-04 12:37:17,967 [messaging :206 ][ERROR ][630] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  23256. Traceback (most recent call last):
  23257. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  23258. self._call_hook_for(message, "workflow", message)
  23259. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23260. return True, func(*args, **kwargs)
  23261. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  23262. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23263. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23264. return True, func(*args, **kwargs)
  23265. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23266. return func(*args, **kwargs)
  23267. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  23268. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  23269. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  23270. res = query("AT+QGPSLOC={:d}".format(mode))
  23271. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  23272. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  23273. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  23274. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  23275. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  23276. raise salt.exceptions.CommandExecutionError(message["error"])
  23277. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23278. 2020-08-04 12:37:20,884 [obd.obd :107 ][ERROR ][666] Failed to use explicit port '/dev/serial0'
  23279. Traceback (most recent call last):
  23280. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  23281. self.interface.open(baudrate, protocol=protocol)
  23282. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  23283. self.set_protocol(prot.pop("id", None), **prot)
  23284. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  23285. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  23286. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  23287. self._protocol = self._auto_protocol(**kwargs)
  23288. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  23289. res_0100 = self._verify_protocol("auto", test=not verify)
  23290. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  23291. for line in self.query("0100", parse=False, read_timeout=10):
  23292. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  23293. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  23294. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  23295. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  23296. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  23297. data = self._port.read(self._port.in_waiting or 1)
  23298. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  23299. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  23300. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  23301. sys.exit(salt.defaults.exitcodes.EX_OK)
  23302. SystemExit: 0
  23303. 2020-08-04 12:37:20,927 [obd.obd :120 ][WARNING ][666] Cannot load commands - no connection to bus
  23304. 2020-08-04 12:37:20,959 [obd.interfaces.elm327:730 ][ERROR ][666] Failed to relay command 'STSLCS' to interface
  23305. Traceback (most recent call last):
  23306. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  23307. lines = self.send(cmd, raw_response=raw_response)
  23308. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  23309. raise ELM327Error(self.ERRORS[line], code=line)
  23310. ELM327Error: Operation interrupted by a received RS232 character
  23311. 2020-08-04 12:37:20,962 [messaging :742 ][ERROR ][666] Exception while processing event: {'tag': 'obd/req/d88abafd-96e6-4973-958a-657edc1aa0ef', 'data': {'_stamp': '2020-08-04T12:37:15.733963', 'handler': 'execute', '_event_tag': 'obd/req/d88abafd-96e6-4973-958a-657edc1aa0ef', 'args': ['STSLCS']}}
  23312. Traceback (most recent call last):
  23313. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  23314. res = self.process(message)
  23315. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  23316. result = func(message, **settings)
  23317. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  23318. found, result = self._call_hook_for(message, "workflow", message)
  23319. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23320. return True, func(*args, **kwargs)
  23321. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  23322. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23323. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23324. return True, func(*args, **kwargs)
  23325. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23326. return func(*args, **kwargs)
  23327. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  23328. res = conn.execute(cmd)
  23329. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  23330. return func(self, *args, **kwargs)
  23331. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  23332. return self._obd.execute(cmd, **kwargs)
  23333. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  23334. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  23335. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  23336. lines = self.send(cmd, raw_response=raw_response)
  23337. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  23338. raise ELM327Error(self.ERRORS[line], code=line)
  23339. ELM327Error: Operation interrupted by a received RS232 character
  23340. 2020-08-04 12:37:21,676 [salt.utils.parsers:1050][WARNING ][428] Minion received a SIGTERM. Exiting.
  23341. 2020-08-04 12:37:22,216 [messaging :871 ][WARNING ][829] No reply message with tag 'obd/res/d88abafd-96e6-4973-958a-657edc1aa0ef' received within timeout of 30 secs
  23342. 2020-08-04 12:37:22,222 [salt.state :292 ][ERROR ][829] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  23343. 2020-08-04 12:37:39,074 [gpio_spi_conn :42 ][WARNING ][627] Unable to clear buffer - got unexpected value: 255
  23344. 2020-08-04 12:37:39,087 [gpio_spi_conn :42 ][WARNING ][627] Unable to clear buffer - got unexpected value: 255
  23345. 2020-08-04 12:37:39,096 [gpio_spi_conn :42 ][WARNING ][627] Unable to clear buffer - got unexpected value: 255
  23346. 2020-08-04 12:37:39,755 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  23347. Traceback (most recent call last):
  23348. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23349. self._serial.open()
  23350. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23351. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23352. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23353. 2020-08-04 12:37:40,771 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  23354. Traceback (most recent call last):
  23355. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23356. self._serial.open()
  23357. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23358. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23359. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23360. 2020-08-04 12:37:41,133 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  23361. 2020-08-04 12:37:41,638 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  23362. 2020-08-04 12:37:41,775 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  23363. Traceback (most recent call last):
  23364. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23365. self._serial.open()
  23366. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23367. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23368. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23369. 2020-08-04 12:37:42,141 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  23370. 2020-08-04 12:37:42,146 [spm_conn :139 ][WARNING ][627] Unable to get status: Expected ack '12' but got '255'
  23371. 2020-08-04 12:37:42,410 [messaging :208 ][ERROR ][624] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  23372. Traceback (most recent call last):
  23373. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  23374. self._call_hook_for(message, "workflow", message)
  23375. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23376. return True, func(*args, **kwargs)
  23377. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  23378. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23379. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23380. return True, func(*args, **kwargs)
  23381. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23382. return func(*args, **kwargs)
  23383. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  23384. res = _exec("AT+CCLK?")
  23385. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  23386. conn.write_line(cmd)
  23387. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  23388. self.ensure_open()
  23389. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  23390. self.open()
  23391. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  23392. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  23393. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  23394. raise attempt.get()
  23395. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  23396. six.reraise(self.value[0], self.value[1], self.value[2])
  23397. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  23398. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  23399. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23400. self._serial.open()
  23401. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23402. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23403. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23404. 2020-08-04 12:37:42,652 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  23405. 2020-08-04 12:37:43,156 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  23406. 2020-08-04 12:37:43,659 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  23407. 2020-08-04 12:37:43,661 [spm_conn :139 ][WARNING ][627] Unable to get status: Expected ack '12' but got '255'
  23408. 2020-08-04 12:37:44,165 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  23409. 2020-08-04 12:37:44,681 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  23410. 2020-08-04 12:37:45,186 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  23411. 2020-08-04 12:37:45,190 [spm_conn :139 ][WARNING ][627] Unable to get status: Expected ack '12' but got '255'
  23412. 2020-08-04 12:37:45,195 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  23413. 2020-08-04 12:37:45,700 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  23414. 2020-08-04 12:37:46,205 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  23415. 2020-08-04 12:37:46,207 [spm_conn :82 ][WARNING ][627] Unable to send noop: Expected ack '12' but got '255'
  23416. 2020-08-04 12:37:46,532 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  23417. Traceback (most recent call last):
  23418. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23419. self._serial.open()
  23420. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23421. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23422. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23423. 2020-08-04 12:37:46,711 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  23424. 2020-08-04 12:37:47,213 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  23425. 2020-08-04 12:37:47,536 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  23426. Traceback (most recent call last):
  23427. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23428. self._serial.open()
  23429. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23430. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23431. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23432. 2020-08-04 12:37:47,716 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  23433. 2020-08-04 12:37:47,718 [spm_conn :82 ][WARNING ][627] Unable to send noop: Expected ack '12' but got '255'
  23434. 2020-08-04 12:37:48,222 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  23435. 2020-08-04 12:37:48,541 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  23436. Traceback (most recent call last):
  23437. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23438. self._serial.open()
  23439. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23440. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23441. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23442. 2020-08-04 12:37:48,555 [messaging :742 ][ERROR ][624] Exception while processing event: {'tag': 'ec2x/req/7e8aede9-45dc-4e59-a182-ff04f19c2de2', 'data': {'_stamp': '2020-08-04T12:37:39.149569', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/7e8aede9-45dc-4e59-a182-ff04f19c2de2', 'kwargs': {'cooldown_delay': None}}}
  23443. Traceback (most recent call last):
  23444. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  23445. res = self.process(message)
  23446. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  23447. result = func(message, **settings)
  23448. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  23449. found, result = self._call_hook_for(message, "workflow", message)
  23450. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23451. return True, func(*args, **kwargs)
  23452. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  23453. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23454. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23455. return True, func(*args, **kwargs)
  23456. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23457. return func(*args, **kwargs)
  23458. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  23459. return _exec(cmd, **kwargs)
  23460. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  23461. conn.write_line(cmd)
  23462. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  23463. self.ensure_open()
  23464. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  23465. self.open()
  23466. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  23467. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  23468. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  23469. raise attempt.get()
  23470. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  23471. six.reraise(self.value[0], self.value[1], self.value[2])
  23472. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  23473. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  23474. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23475. self._serial.open()
  23476. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23477. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23478. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23479. 2020-08-04 12:37:48,727 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  23480. 2020-08-04 12:37:49,164 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  23481. Traceback (most recent call last):
  23482. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23483. self._serial.open()
  23484. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23485. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23486. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23487. 2020-08-04 12:37:49,233 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  23488. 2020-08-04 12:37:49,236 [spm_conn :82 ][WARNING ][627] Unable to send noop: Expected ack '12' but got '255'
  23489. 2020-08-04 12:37:49,239 [messaging :208 ][ERROR ][627] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  23490. Traceback (most recent call last):
  23491. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  23492. self._call_hook_for(message, "workflow", message)
  23493. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23494. return True, func(*args, **kwargs)
  23495. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  23496. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23497. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23498. return True, func(*args, **kwargs)
  23499. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23500. return func(*args, **kwargs)
  23501. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  23502. conn.heartbeat()
  23503. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  23504. self.noop()
  23505. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  23506. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  23507. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  23508. raise attempt.get()
  23509. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  23510. six.reraise(self.value[0], self.value[1], self.value[2])
  23511. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  23512. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  23513. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  23514. self._begin_message()
  23515. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  23516. self.recv(ack=ACK_MESSAGE_BEGIN)
  23517. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  23518. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  23519. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  23520. raise attempt.get()
  23521. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  23522. six.reraise(self.value[0], self.value[1], self.value[2])
  23523. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  23524. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  23525. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  23526. raise Exception(msg)
  23527. Exception: Expected ack '12' but got '255'
  23528. 2020-08-04 12:37:50,170 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  23529. Traceback (most recent call last):
  23530. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23531. self._serial.open()
  23532. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23533. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23534. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23535. 2020-08-04 12:37:50,789 [messaging :208 ][ERROR ][625] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  23536. Traceback (most recent call last):
  23537. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  23538. self._call_hook_for(message, "workflow", message)
  23539. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23540. return True, func(*args, **kwargs)
  23541. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  23542. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23543. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23544. return True, func(*args, **kwargs)
  23545. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23546. return func(*args, **kwargs)
  23547. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  23548. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  23549. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  23550. res = query("AT+QGPSLOC={:d}".format(mode))
  23551. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  23552. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  23553. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  23554. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  23555. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  23556. raise salt.exceptions.CommandExecutionError(message["error"])
  23557. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23558. 2020-08-04 12:37:51,174 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  23559. Traceback (most recent call last):
  23560. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23561. self._serial.open()
  23562. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23563. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23564. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23565. 2020-08-04 12:37:51,686 [messaging :206 ][ERROR ][624] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  23566. Traceback (most recent call last):
  23567. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  23568. self._call_hook_for(message, "workflow", message)
  23569. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23570. return True, func(*args, **kwargs)
  23571. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  23572. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23573. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23574. return True, func(*args, **kwargs)
  23575. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23576. return func(*args, **kwargs)
  23577. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  23578. res = _exec("AT+CCLK?")
  23579. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  23580. conn.write_line(cmd)
  23581. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  23582. self.ensure_open()
  23583. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  23584. self.open()
  23585. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  23586. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  23587. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  23588. raise attempt.get()
  23589. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  23590. six.reraise(self.value[0], self.value[1], self.value[2])
  23591. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  23592. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  23593. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23594. self._serial.open()
  23595. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23596. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23597. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23598. 2020-08-04 12:37:55,880 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  23599. Traceback (most recent call last):
  23600. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23601. self._serial.open()
  23602. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23603. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23604. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23605. 2020-08-04 12:37:56,885 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  23606. Traceback (most recent call last):
  23607. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23608. self._serial.open()
  23609. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23610. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23611. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23612. 2020-08-04 12:37:57,889 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  23613. Traceback (most recent call last):
  23614. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23615. self._serial.open()
  23616. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23617. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23618. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23619. 2020-08-04 12:37:57,892 [messaging :742 ][ERROR ][624] Exception while processing event: {'tag': 'ec2x/req/19531cd9-a489-4dd3-9e53-d6a2d4500d33', 'data': {'_stamp': '2020-08-04T12:37:55.857905', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/19531cd9-a489-4dd3-9e53-d6a2d4500d33', 'kwargs': {'cooldown_delay': None}}}
  23620. Traceback (most recent call last):
  23621. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  23622. res = self.process(message)
  23623. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  23624. result = func(message, **settings)
  23625. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  23626. found, result = self._call_hook_for(message, "workflow", message)
  23627. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23628. return True, func(*args, **kwargs)
  23629. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  23630. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23631. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23632. return True, func(*args, **kwargs)
  23633. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23634. return func(*args, **kwargs)
  23635. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  23636. return _exec(cmd, **kwargs)
  23637. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  23638. conn.write_line(cmd)
  23639. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  23640. self.ensure_open()
  23641. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  23642. self.open()
  23643. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  23644. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  23645. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  23646. raise attempt.get()
  23647. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  23648. six.reraise(self.value[0], self.value[1], self.value[2])
  23649. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  23650. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  23651. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23652. self._serial.open()
  23653. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23654. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23655. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23656. 2020-08-04 12:37:57,937 [messaging :206 ][ERROR ][625] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  23657. Traceback (most recent call last):
  23658. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  23659. self._call_hook_for(message, "workflow", message)
  23660. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23661. return True, func(*args, **kwargs)
  23662. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  23663. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23664. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23665. return True, func(*args, **kwargs)
  23666. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23667. return func(*args, **kwargs)
  23668. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  23669. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  23670. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  23671. res = query("AT+QGPSLOC={:d}".format(mode))
  23672. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  23673. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  23674. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  23675. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  23676. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  23677. raise salt.exceptions.CommandExecutionError(message["error"])
  23678. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23679. 2020-08-04 12:37:58,480 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  23680. Traceback (most recent call last):
  23681. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23682. self._serial.open()
  23683. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23684. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23685. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23686. 2020-08-04 12:37:59,485 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  23687. Traceback (most recent call last):
  23688. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23689. self._serial.open()
  23690. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23691. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23692. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23693. 2020-08-04 12:38:00,490 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  23694. Traceback (most recent call last):
  23695. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23696. self._serial.open()
  23697. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23698. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23699. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23700. 2020-08-04 12:38:00,544 [salt.loaded.int.module.cmdmod:693 ][ERROR ][624] Command '['timedatectl', 'set-ntp', '1']' failed with return code: 1
  23701. 2020-08-04 12:38:00,546 [salt.loaded.int.module.cmdmod:697 ][ERROR ][624] stderr: Failed to set ntp: Refusing activation, D-Bus is shutting down.
  23702. 2020-08-04 12:38:00,548 [salt.loaded.int.module.cmdmod:699 ][ERROR ][624] retcode: 1
  23703. 2020-08-04 12:38:00,550 [messaging :208 ][ERROR ][624] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  23704. Traceback (most recent call last):
  23705. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  23706. self._call_hook_for(message, "workflow", message)
  23707. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23708. return True, func(*args, **kwargs)
  23709. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  23710. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23711. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23712. return True, func(*args, **kwargs)
  23713. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23714. return func(*args, **kwargs)
  23715. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 295, in sync_time_handler
  23716. __salt__["clock.ntp"](enable=True)
  23717. File "/var/cache/salt/minion/extmods/modules/clock.py", line 76, in ntp
  23718. raise salt.exceptions.CommandExecutionError(res["stderr"])
  23719. CommandExecutionError: Failed to set ntp: Refusing activation, D-Bus is shutting down.
  23720. 2020-08-04 12:38:01,314 [obd.obd :107 ][ERROR ][713] Failed to use explicit port '/dev/serial0'
  23721. Traceback (most recent call last):
  23722. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  23723. self.interface.open(baudrate, protocol=protocol)
  23724. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  23725. self.set_protocol(prot.pop("id", None), **prot)
  23726. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  23727. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  23728. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  23729. self._protocol = self._auto_protocol(**kwargs)
  23730. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  23731. res_0100 = self._verify_protocol("auto", test=not verify)
  23732. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  23733. for line in self.query("0100", parse=False, read_timeout=10):
  23734. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  23735. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  23736. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  23737. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  23738. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  23739. data = self._port.read(self._port.in_waiting or 1)
  23740. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  23741. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  23742. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  23743. sys.exit(salt.defaults.exitcodes.EX_OK)
  23744. SystemExit: 0
  23745. 2020-08-04 12:38:01,349 [obd.obd :120 ][WARNING ][713] Cannot load commands - no connection to bus
  23746. 2020-08-04 12:38:01,377 [obd.interfaces.elm327:730 ][ERROR ][713] Failed to relay command 'STSLCS' to interface
  23747. Traceback (most recent call last):
  23748. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  23749. lines = self.send(cmd, raw_response=raw_response)
  23750. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  23751. raise ELM327Error(self.ERRORS[line], code=line)
  23752. ELM327Error: Operation interrupted by a received RS232 character
  23753. 2020-08-04 12:38:01,381 [messaging :742 ][ERROR ][713] Exception while processing event: {'tag': 'obd/req/78c2db3e-4e31-4a11-854a-699ff3076efb', 'data': {'_stamp': '2020-08-04T12:37:55.724615', 'handler': 'execute', '_event_tag': 'obd/req/78c2db3e-4e31-4a11-854a-699ff3076efb', 'args': ['STSLCS']}}
  23754. Traceback (most recent call last):
  23755. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  23756. res = self.process(message)
  23757. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  23758. result = func(message, **settings)
  23759. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  23760. found, result = self._call_hook_for(message, "workflow", message)
  23761. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23762. return True, func(*args, **kwargs)
  23763. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  23764. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23765. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23766. return True, func(*args, **kwargs)
  23767. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23768. return func(*args, **kwargs)
  23769. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  23770. res = conn.execute(cmd)
  23771. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  23772. return func(self, *args, **kwargs)
  23773. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  23774. return self._obd.execute(cmd, **kwargs)
  23775. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  23776. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  23777. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  23778. lines = self.send(cmd, raw_response=raw_response)
  23779. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  23780. raise ELM327Error(self.ERRORS[line], code=line)
  23781. ELM327Error: Operation interrupted by a received RS232 character
  23782. 2020-08-04 12:38:02,177 [salt.utils.parsers:1050][WARNING ][423] Minion received a SIGTERM. Exiting.
  23783. 2020-08-04 12:38:02,717 [messaging :871 ][WARNING ][838] No reply message with tag 'obd/res/78c2db3e-4e31-4a11-854a-699ff3076efb' received within timeout of 30 secs
  23784. 2020-08-04 12:38:02,721 [salt.state :292 ][ERROR ][838] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  23785. 2020-08-04 12:38:19,030 [gpio_spi_conn :42 ][WARNING ][646] Unable to clear buffer - got unexpected value: 255
  23786. 2020-08-04 12:38:19,043 [gpio_spi_conn :42 ][WARNING ][646] Unable to clear buffer - got unexpected value: 255
  23787. 2020-08-04 12:38:19,046 [gpio_spi_conn :42 ][WARNING ][646] Unable to clear buffer - got unexpected value: 255
  23788. 2020-08-04 12:38:19,141 [serial_conn :79 ][ERROR ][643] Failed to open serial connection
  23789. Traceback (most recent call last):
  23790. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23791. self._serial.open()
  23792. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23793. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23794. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23795. 2020-08-04 12:38:20,153 [serial_conn :79 ][ERROR ][643] Failed to open serial connection
  23796. Traceback (most recent call last):
  23797. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23798. self._serial.open()
  23799. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23800. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23801. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23802. 2020-08-04 12:38:21,076 [gpio_spi_conn :109 ][WARNING ][646] Expected ack '12' but got '255'
  23803. 2020-08-04 12:38:21,157 [serial_conn :79 ][ERROR ][643] Failed to open serial connection
  23804. Traceback (most recent call last):
  23805. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23806. self._serial.open()
  23807. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23808. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23809. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23810. 2020-08-04 12:38:21,579 [gpio_spi_conn :109 ][WARNING ][646] Expected ack '12' but got '255'
  23811. 2020-08-04 12:38:21,758 [messaging :208 ][ERROR ][643] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  23812. Traceback (most recent call last):
  23813. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  23814. self._call_hook_for(message, "workflow", message)
  23815. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23816. return True, func(*args, **kwargs)
  23817. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  23818. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23819. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23820. return True, func(*args, **kwargs)
  23821. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23822. return func(*args, **kwargs)
  23823. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  23824. res = _exec("AT+CCLK?")
  23825. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  23826. conn.write_line(cmd)
  23827. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  23828. self.ensure_open()
  23829. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  23830. self.open()
  23831. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  23832. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  23833. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  23834. raise attempt.get()
  23835. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  23836. six.reraise(self.value[0], self.value[1], self.value[2])
  23837. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  23838. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  23839. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23840. self._serial.open()
  23841. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23842. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23843. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23844. 2020-08-04 12:38:22,081 [gpio_spi_conn :109 ][WARNING ][646] Expected ack '12' but got '255'
  23845. 2020-08-04 12:38:22,085 [spm_conn :139 ][WARNING ][646] Unable to get status: Expected ack '12' but got '255'
  23846. 2020-08-04 12:38:22,589 [gpio_spi_conn :109 ][WARNING ][646] Expected ack '12' but got '255'
  23847. 2020-08-04 12:38:23,101 [gpio_spi_conn :109 ][WARNING ][646] Expected ack '12' but got '255'
  23848. 2020-08-04 12:38:23,606 [gpio_spi_conn :109 ][WARNING ][646] Expected ack '12' but got '255'
  23849. 2020-08-04 12:38:23,609 [spm_conn :139 ][WARNING ][646] Unable to get status: Expected ack '12' but got '255'
  23850. 2020-08-04 12:38:24,112 [gpio_spi_conn :109 ][WARNING ][646] Expected ack '12' but got '255'
  23851. 2020-08-04 12:38:24,618 [gpio_spi_conn :109 ][WARNING ][646] Expected ack '12' but got '255'
  23852. 2020-08-04 12:38:25,121 [gpio_spi_conn :109 ][WARNING ][646] Expected ack '12' but got '255'
  23853. 2020-08-04 12:38:25,123 [spm_conn :139 ][WARNING ][646] Unable to get status: Expected ack '12' but got '255'
  23854. 2020-08-04 12:38:25,127 [gpio_spi_conn :109 ][WARNING ][646] Expected ack '12' but got '255'
  23855. 2020-08-04 12:38:25,630 [gpio_spi_conn :109 ][WARNING ][646] Expected ack '12' but got '255'
  23856. 2020-08-04 12:38:26,133 [gpio_spi_conn :109 ][WARNING ][646] Expected ack '12' but got '255'
  23857. 2020-08-04 12:38:26,137 [spm_conn :82 ][WARNING ][646] Unable to send noop: Expected ack '12' but got '255'
  23858. 2020-08-04 12:38:26,344 [serial_conn :79 ][ERROR ][643] Failed to open serial connection
  23859. Traceback (most recent call last):
  23860. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23861. self._serial.open()
  23862. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23863. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23864. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23865. 2020-08-04 12:38:26,640 [gpio_spi_conn :109 ][WARNING ][646] Expected ack '12' but got '255'
  23866. 2020-08-04 12:38:27,144 [gpio_spi_conn :109 ][WARNING ][646] Expected ack '12' but got '255'
  23867. 2020-08-04 12:38:27,348 [serial_conn :79 ][ERROR ][643] Failed to open serial connection
  23868. Traceback (most recent call last):
  23869. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23870. self._serial.open()
  23871. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23872. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23873. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23874. 2020-08-04 12:38:27,648 [gpio_spi_conn :109 ][WARNING ][646] Expected ack '12' but got '255'
  23875. 2020-08-04 12:38:27,650 [spm_conn :82 ][WARNING ][646] Unable to send noop: Expected ack '12' but got '255'
  23876. 2020-08-04 12:38:28,160 [gpio_spi_conn :109 ][WARNING ][646] Expected ack '12' but got '255'
  23877. 2020-08-04 12:38:28,352 [serial_conn :79 ][ERROR ][643] Failed to open serial connection
  23878. Traceback (most recent call last):
  23879. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23880. self._serial.open()
  23881. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23882. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23883. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23884. 2020-08-04 12:38:28,355 [messaging :742 ][ERROR ][643] Exception while processing event: {'tag': 'ec2x/req/892b19d4-c056-4004-8a04-499c5db55f84', 'data': {'_stamp': '2020-08-04T12:38:19.092396', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/892b19d4-c056-4004-8a04-499c5db55f84', 'kwargs': {'cooldown_delay': None}}}
  23885. Traceback (most recent call last):
  23886. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  23887. res = self.process(message)
  23888. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  23889. result = func(message, **settings)
  23890. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  23891. found, result = self._call_hook_for(message, "workflow", message)
  23892. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23893. return True, func(*args, **kwargs)
  23894. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  23895. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23896. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23897. return True, func(*args, **kwargs)
  23898. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23899. return func(*args, **kwargs)
  23900. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  23901. return _exec(cmd, **kwargs)
  23902. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  23903. conn.write_line(cmd)
  23904. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  23905. self.ensure_open()
  23906. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  23907. self.open()
  23908. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  23909. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  23910. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  23911. raise attempt.get()
  23912. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  23913. six.reraise(self.value[0], self.value[1], self.value[2])
  23914. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  23915. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  23916. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23917. self._serial.open()
  23918. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23919. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23920. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23921. 2020-08-04 12:38:28,666 [gpio_spi_conn :109 ][WARNING ][646] Expected ack '12' but got '255'
  23922. 2020-08-04 12:38:29,054 [serial_conn :79 ][ERROR ][643] Failed to open serial connection
  23923. Traceback (most recent call last):
  23924. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23925. self._serial.open()
  23926. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23927. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23928. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23929. 2020-08-04 12:38:29,169 [gpio_spi_conn :109 ][WARNING ][646] Expected ack '12' but got '255'
  23930. 2020-08-04 12:38:29,172 [spm_conn :82 ][WARNING ][646] Unable to send noop: Expected ack '12' but got '255'
  23931. 2020-08-04 12:38:29,176 [messaging :208 ][ERROR ][646] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  23932. Traceback (most recent call last):
  23933. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  23934. self._call_hook_for(message, "workflow", message)
  23935. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23936. return True, func(*args, **kwargs)
  23937. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  23938. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23939. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23940. return True, func(*args, **kwargs)
  23941. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23942. return func(*args, **kwargs)
  23943. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  23944. conn.heartbeat()
  23945. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  23946. self.noop()
  23947. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  23948. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  23949. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  23950. raise attempt.get()
  23951. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  23952. six.reraise(self.value[0], self.value[1], self.value[2])
  23953. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  23954. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  23955. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  23956. self._begin_message()
  23957. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  23958. self.recv(ack=ACK_MESSAGE_BEGIN)
  23959. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  23960. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  23961. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  23962. raise attempt.get()
  23963. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  23964. six.reraise(self.value[0], self.value[1], self.value[2])
  23965. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  23966. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  23967. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  23968. raise Exception(msg)
  23969. Exception: Expected ack '12' but got '255'
  23970. 2020-08-04 12:38:30,059 [serial_conn :79 ][ERROR ][643] Failed to open serial connection
  23971. Traceback (most recent call last):
  23972. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  23973. self._serial.open()
  23974. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  23975. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  23976. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  23977. 2020-08-04 12:38:30,573 [messaging :208 ][ERROR ][644] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  23978. Traceback (most recent call last):
  23979. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  23980. self._call_hook_for(message, "workflow", message)
  23981. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23982. return True, func(*args, **kwargs)
  23983. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  23984. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  23985. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  23986. return True, func(*args, **kwargs)
  23987. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  23988. return func(*args, **kwargs)
  23989. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  23990. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  23991. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  23992. res = query("AT+QGPSLOC={:d}".format(mode))
  23993. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  23994. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  23995. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  23996. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  23997. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  23998. raise salt.exceptions.CommandExecutionError(message["error"])
  23999. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24000. 2020-08-04 12:38:31,064 [serial_conn :79 ][ERROR ][643] Failed to open serial connection
  24001. Traceback (most recent call last):
  24002. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24003. self._serial.open()
  24004. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24005. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24006. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24007. 2020-08-04 12:38:31,553 [messaging :206 ][ERROR ][643] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  24008. Traceback (most recent call last):
  24009. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  24010. self._call_hook_for(message, "workflow", message)
  24011. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24012. return True, func(*args, **kwargs)
  24013. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  24014. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24015. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24016. return True, func(*args, **kwargs)
  24017. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24018. return func(*args, **kwargs)
  24019. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  24020. res = _exec("AT+CCLK?")
  24021. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  24022. conn.write_line(cmd)
  24023. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  24024. self.ensure_open()
  24025. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  24026. self.open()
  24027. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  24028. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  24029. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  24030. raise attempt.get()
  24031. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  24032. six.reraise(self.value[0], self.value[1], self.value[2])
  24033. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  24034. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  24035. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24036. self._serial.open()
  24037. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24038. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24039. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24040. 2020-08-04 12:39:01,436 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][668] Timeout after 1.28205128205 second(s) waiting for interrupt
  24041. 2020-08-04 12:39:01,451 [serial_conn :79 ][ERROR ][643] Failed to open serial connection
  24042. Traceback (most recent call last):
  24043. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24044. self._serial.open()
  24045. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24046. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24047. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24048. 2020-08-04 12:39:02,456 [serial_conn :79 ][ERROR ][643] Failed to open serial connection
  24049. Traceback (most recent call last):
  24050. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24051. self._serial.open()
  24052. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24053. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24054. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24055. 2020-08-04 12:39:03,460 [serial_conn :79 ][ERROR ][643] Failed to open serial connection
  24056. Traceback (most recent call last):
  24057. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24058. self._serial.open()
  24059. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24060. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24061. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24062. 2020-08-04 12:39:03,478 [messaging :742 ][ERROR ][643] Exception while processing event: {'tag': 'ec2x/req/fe55f1e8-15a0-44d3-9cd2-b356a78db576', 'data': {'_stamp': '2020-08-04T12:39:01.442710', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/fe55f1e8-15a0-44d3-9cd2-b356a78db576', 'kwargs': {'cooldown_delay': None}}}
  24063. Traceback (most recent call last):
  24064. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  24065. res = self.process(message)
  24066. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  24067. result = func(message, **settings)
  24068. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  24069. found, result = self._call_hook_for(message, "workflow", message)
  24070. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24071. return True, func(*args, **kwargs)
  24072. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  24073. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24074. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24075. return True, func(*args, **kwargs)
  24076. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24077. return func(*args, **kwargs)
  24078. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  24079. return _exec(cmd, **kwargs)
  24080. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  24081. conn.write_line(cmd)
  24082. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  24083. self.ensure_open()
  24084. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  24085. self.open()
  24086. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  24087. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  24088. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  24089. raise attempt.get()
  24090. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  24091. six.reraise(self.value[0], self.value[1], self.value[2])
  24092. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  24093. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  24094. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24095. self._serial.open()
  24096. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24097. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24098. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24099. 2020-08-04 12:39:03,510 [messaging :206 ][ERROR ][644] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  24100. Traceback (most recent call last):
  24101. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  24102. self._call_hook_for(message, "workflow", message)
  24103. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24104. return True, func(*args, **kwargs)
  24105. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  24106. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24107. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24108. return True, func(*args, **kwargs)
  24109. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24110. return func(*args, **kwargs)
  24111. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  24112. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  24113. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  24114. res = query("AT+QGPSLOC={:d}".format(mode))
  24115. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  24116. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  24117. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  24118. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  24119. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  24120. raise salt.exceptions.CommandExecutionError(message["error"])
  24121. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24122. 2020-08-04 12:39:04,086 [serial_conn :79 ][ERROR ][643] Failed to open serial connection
  24123. Traceback (most recent call last):
  24124. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24125. self._serial.open()
  24126. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24127. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24128. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24129. 2020-08-04 12:39:05,090 [serial_conn :79 ][ERROR ][643] Failed to open serial connection
  24130. Traceback (most recent call last):
  24131. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24132. self._serial.open()
  24133. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24134. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24135. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24136. 2020-08-04 12:39:06,094 [serial_conn :79 ][ERROR ][643] Failed to open serial connection
  24137. Traceback (most recent call last):
  24138. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24139. self._serial.open()
  24140. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24141. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24142. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24143. 2020-08-04 12:39:06,629 [messaging :206 ][ERROR ][643] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  24144. Traceback (most recent call last):
  24145. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  24146. self._call_hook_for(message, "workflow", message)
  24147. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24148. return True, func(*args, **kwargs)
  24149. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  24150. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24151. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24152. return True, func(*args, **kwargs)
  24153. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24154. return func(*args, **kwargs)
  24155. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  24156. res = _exec("AT+CCLK?")
  24157. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  24158. conn.write_line(cmd)
  24159. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  24160. self.ensure_open()
  24161. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  24162. self.open()
  24163. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  24164. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  24165. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  24166. raise attempt.get()
  24167. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  24168. six.reraise(self.value[0], self.value[1], self.value[2])
  24169. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  24170. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  24171. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24172. self._serial.open()
  24173. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24174. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24175. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24176. 2020-08-04 12:39:08,541 [serial_conn :79 ][ERROR ][643] Failed to open serial connection
  24177. Traceback (most recent call last):
  24178. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24179. self._serial.open()
  24180. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24181. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24182. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24183. 2020-08-04 12:39:09,545 [serial_conn :79 ][ERROR ][643] Failed to open serial connection
  24184. Traceback (most recent call last):
  24185. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24186. self._serial.open()
  24187. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24188. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24189. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24190. 2020-08-04 12:39:10,308 [obd.obd :107 ][ERROR ][667] Failed to use explicit port '/dev/serial0'
  24191. Traceback (most recent call last):
  24192. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  24193. self.interface.open(baudrate, protocol=protocol)
  24194. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  24195. self.set_protocol(prot.pop("id", None), **prot)
  24196. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  24197. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  24198. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  24199. self._protocol = self._auto_protocol(**kwargs)
  24200. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  24201. res_0100 = self._verify_protocol("auto", test=not verify)
  24202. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  24203. for line in self.query("0100", parse=False, read_timeout=10):
  24204. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  24205. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  24206. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  24207. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  24208. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  24209. data = self._port.read(self._port.in_waiting or 1)
  24210. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  24211. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  24212. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  24213. sys.exit(salt.defaults.exitcodes.EX_OK)
  24214. SystemExit: 0
  24215. 2020-08-04 12:39:10,343 [obd.obd :120 ][WARNING ][667] Cannot load commands - no connection to bus
  24216. 2020-08-04 12:39:10,369 [obd.interfaces.elm327:730 ][ERROR ][667] Failed to relay command 'STSLCS' to interface
  24217. Traceback (most recent call last):
  24218. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  24219. lines = self.send(cmd, raw_response=raw_response)
  24220. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  24221. raise ELM327Error(self.ERRORS[line], code=line)
  24222. ELM327Error: Operation interrupted by a received RS232 character
  24223. 2020-08-04 12:39:10,372 [messaging :742 ][ERROR ][667] Exception while processing event: {'tag': 'obd/req/2ca486f5-4bc5-48b6-bffb-3700c8178bc4', 'data': {'_stamp': '2020-08-04T12:39:04.900128', 'handler': 'execute', '_event_tag': 'obd/req/2ca486f5-4bc5-48b6-bffb-3700c8178bc4', 'args': ['STSLCS']}}
  24224. Traceback (most recent call last):
  24225. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  24226. res = self.process(message)
  24227. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  24228. result = func(message, **settings)
  24229. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  24230. found, result = self._call_hook_for(message, "workflow", message)
  24231. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24232. return True, func(*args, **kwargs)
  24233. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  24234. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24235. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24236. return True, func(*args, **kwargs)
  24237. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24238. return func(*args, **kwargs)
  24239. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  24240. res = conn.execute(cmd)
  24241. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  24242. return func(self, *args, **kwargs)
  24243. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  24244. return self._obd.execute(cmd, **kwargs)
  24245. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  24246. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  24247. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  24248. lines = self.send(cmd, raw_response=raw_response)
  24249. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  24250. raise ELM327Error(self.ERRORS[line], code=line)
  24251. ELM327Error: Operation interrupted by a received RS232 character
  24252. 2020-08-04 12:39:10,496 [messaging :753 ][WARNING ][643] No reply to send back for event: {'tag': 'ec2x/req/afb1e2b8-10ae-42b3-85c3-045fac05554e', 'data': {'_stamp': '2020-08-04T12:39:08.532158', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/afb1e2b8-10ae-42b3-85c3-045fac05554e', 'kwargs': {'cooldown_delay': None}}}
  24253. 2020-08-04 12:39:11,193 [salt.utils.parsers:1050][WARNING ][443] Minion received a SIGTERM. Exiting.
  24254. 2020-08-04 12:39:11,733 [messaging :871 ][WARNING ][843] No reply message with tag 'obd/res/2ca486f5-4bc5-48b6-bffb-3700c8178bc4' received within timeout of 30 secs
  24255. 2020-08-04 12:39:11,737 [salt.state :292 ][ERROR ][843] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  24256. 2020-08-04 12:39:27,995 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  24257. 2020-08-04 12:39:28,001 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  24258. 2020-08-04 12:39:28,005 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  24259. 2020-08-04 12:39:28,723 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24260. Traceback (most recent call last):
  24261. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24262. self._serial.open()
  24263. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24264. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24265. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24266. 2020-08-04 12:39:29,735 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24267. Traceback (most recent call last):
  24268. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24269. self._serial.open()
  24270. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24271. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24272. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24273. 2020-08-04 12:39:30,033 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24274. 2020-08-04 12:39:30,536 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24275. 2020-08-04 12:39:30,739 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24276. Traceback (most recent call last):
  24277. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24278. self._serial.open()
  24279. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24280. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24281. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24282. 2020-08-04 12:39:31,040 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24283. 2020-08-04 12:39:31,043 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  24284. 2020-08-04 12:39:31,358 [messaging :208 ][ERROR ][617] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  24285. Traceback (most recent call last):
  24286. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  24287. self._call_hook_for(message, "workflow", message)
  24288. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24289. return True, func(*args, **kwargs)
  24290. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  24291. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24292. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24293. return True, func(*args, **kwargs)
  24294. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24295. return func(*args, **kwargs)
  24296. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  24297. res = _exec("AT+CCLK?")
  24298. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  24299. conn.write_line(cmd)
  24300. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  24301. self.ensure_open()
  24302. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  24303. self.open()
  24304. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  24305. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  24306. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  24307. raise attempt.get()
  24308. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  24309. six.reraise(self.value[0], self.value[1], self.value[2])
  24310. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  24311. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  24312. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24313. self._serial.open()
  24314. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24315. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24316. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24317. 2020-08-04 12:39:31,547 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24318. 2020-08-04 12:39:32,050 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24319. 2020-08-04 12:39:32,560 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24320. 2020-08-04 12:39:32,563 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  24321. 2020-08-04 12:39:33,067 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24322. 2020-08-04 12:39:33,571 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24323. 2020-08-04 12:39:34,075 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24324. 2020-08-04 12:39:34,078 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  24325. 2020-08-04 12:39:34,081 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24326. 2020-08-04 12:39:34,584 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24327. 2020-08-04 12:39:35,088 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24328. 2020-08-04 12:39:35,091 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  24329. 2020-08-04 12:39:35,431 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24330. Traceback (most recent call last):
  24331. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24332. self._serial.open()
  24333. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24334. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24335. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24336. 2020-08-04 12:39:35,599 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24337. 2020-08-04 12:39:36,103 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24338. 2020-08-04 12:39:36,436 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24339. Traceback (most recent call last):
  24340. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24341. self._serial.open()
  24342. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24343. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24344. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24345. 2020-08-04 12:39:36,606 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24346. 2020-08-04 12:39:36,608 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  24347. 2020-08-04 12:39:37,113 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24348. 2020-08-04 12:39:37,440 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24349. Traceback (most recent call last):
  24350. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24351. self._serial.open()
  24352. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24353. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24354. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24355. 2020-08-04 12:39:37,444 [messaging :742 ][ERROR ][617] Exception while processing event: {'tag': 'ec2x/req/54103958-35b1-42ab-ba83-6f9f69b44499', 'data': {'_stamp': '2020-08-04T12:39:28.086915', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/54103958-35b1-42ab-ba83-6f9f69b44499', 'kwargs': {'cooldown_delay': None}}}
  24356. Traceback (most recent call last):
  24357. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  24358. res = self.process(message)
  24359. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  24360. result = func(message, **settings)
  24361. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  24362. found, result = self._call_hook_for(message, "workflow", message)
  24363. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24364. return True, func(*args, **kwargs)
  24365. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  24366. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24367. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24368. return True, func(*args, **kwargs)
  24369. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24370. return func(*args, **kwargs)
  24371. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  24372. return _exec(cmd, **kwargs)
  24373. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  24374. conn.write_line(cmd)
  24375. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  24376. self.ensure_open()
  24377. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  24378. self.open()
  24379. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  24380. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  24381. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  24382. raise attempt.get()
  24383. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  24384. six.reraise(self.value[0], self.value[1], self.value[2])
  24385. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  24386. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  24387. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24388. self._serial.open()
  24389. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24390. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24391. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24392. 2020-08-04 12:39:37,617 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24393. 2020-08-04 12:39:38,131 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24394. 2020-08-04 12:39:38,133 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  24395. 2020-08-04 12:39:38,133 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24396. Traceback (most recent call last):
  24397. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24398. self._serial.open()
  24399. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24400. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24401. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24402. 2020-08-04 12:39:38,136 [messaging :208 ][ERROR ][620] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  24403. Traceback (most recent call last):
  24404. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  24405. self._call_hook_for(message, "workflow", message)
  24406. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24407. return True, func(*args, **kwargs)
  24408. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  24409. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24410. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24411. return True, func(*args, **kwargs)
  24412. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24413. return func(*args, **kwargs)
  24414. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  24415. conn.heartbeat()
  24416. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  24417. self.noop()
  24418. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  24419. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  24420. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  24421. raise attempt.get()
  24422. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  24423. six.reraise(self.value[0], self.value[1], self.value[2])
  24424. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  24425. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  24426. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  24427. self._begin_message()
  24428. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  24429. self.recv(ack=ACK_MESSAGE_BEGIN)
  24430. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  24431. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  24432. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  24433. raise attempt.get()
  24434. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  24435. six.reraise(self.value[0], self.value[1], self.value[2])
  24436. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  24437. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  24438. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  24439. raise Exception(msg)
  24440. Exception: Expected ack '12' but got '255'
  24441. 2020-08-04 12:39:39,139 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24442. Traceback (most recent call last):
  24443. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24444. self._serial.open()
  24445. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24446. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24447. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24448. 2020-08-04 12:39:39,680 [messaging :208 ][ERROR ][618] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  24449. Traceback (most recent call last):
  24450. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  24451. self._call_hook_for(message, "workflow", message)
  24452. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24453. return True, func(*args, **kwargs)
  24454. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  24455. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24456. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24457. return True, func(*args, **kwargs)
  24458. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24459. return func(*args, **kwargs)
  24460. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  24461. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  24462. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  24463. res = query("AT+QGPSLOC={:d}".format(mode))
  24464. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  24465. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  24466. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  24467. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  24468. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  24469. raise salt.exceptions.CommandExecutionError(message["error"])
  24470. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24471. 2020-08-04 12:39:40,143 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24472. Traceback (most recent call last):
  24473. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24474. self._serial.open()
  24475. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24476. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24477. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24478. 2020-08-04 12:39:40,648 [messaging :206 ][ERROR ][617] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  24479. Traceback (most recent call last):
  24480. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  24481. self._call_hook_for(message, "workflow", message)
  24482. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24483. return True, func(*args, **kwargs)
  24484. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  24485. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24486. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24487. return True, func(*args, **kwargs)
  24488. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24489. return func(*args, **kwargs)
  24490. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  24491. res = _exec("AT+CCLK?")
  24492. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  24493. conn.write_line(cmd)
  24494. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  24495. self.ensure_open()
  24496. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  24497. self.open()
  24498. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  24499. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  24500. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  24501. raise attempt.get()
  24502. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  24503. six.reraise(self.value[0], self.value[1], self.value[2])
  24504. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  24505. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  24506. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24507. self._serial.open()
  24508. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24509. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24510. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24511. 2020-08-04 12:39:56,147 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][657] Timeout after 1.28205128205 second(s) waiting for interrupt
  24512. 2020-08-04 12:39:56,186 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24513. Traceback (most recent call last):
  24514. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24515. self._serial.open()
  24516. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24517. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24518. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24519. 2020-08-04 12:39:57,191 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24520. Traceback (most recent call last):
  24521. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24522. self._serial.open()
  24523. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24524. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24525. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24526. 2020-08-04 12:39:58,195 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24527. Traceback (most recent call last):
  24528. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24529. self._serial.open()
  24530. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24531. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24532. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24533. 2020-08-04 12:39:58,198 [messaging :206 ][ERROR ][617] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  24534. Traceback (most recent call last):
  24535. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  24536. self._call_hook_for(message, "workflow", message)
  24537. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24538. return True, func(*args, **kwargs)
  24539. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  24540. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24541. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24542. return True, func(*args, **kwargs)
  24543. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24544. return func(*args, **kwargs)
  24545. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  24546. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  24547. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  24548. conn.write_line(cmd)
  24549. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  24550. self.ensure_open()
  24551. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  24552. self.open()
  24553. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  24554. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  24555. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  24556. raise attempt.get()
  24557. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  24558. six.reraise(self.value[0], self.value[1], self.value[2])
  24559. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  24560. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  24561. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24562. self._serial.open()
  24563. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24564. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24565. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24566. 2020-08-04 12:39:58,200 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24567. Traceback (most recent call last):
  24568. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24569. self._serial.open()
  24570. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24571. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24572. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24573. 2020-08-04 12:39:59,208 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24574. Traceback (most recent call last):
  24575. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24576. self._serial.open()
  24577. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24578. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24579. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24580. 2020-08-04 12:40:00,212 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24581. Traceback (most recent call last):
  24582. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24583. self._serial.open()
  24584. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24585. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24586. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24587. 2020-08-04 12:40:00,216 [messaging :742 ][ERROR ][617] Exception while processing event: {'tag': 'ec2x/req/e0079472-f893-4e1e-ae22-64629ad92d04', 'data': {'_stamp': '2020-08-04T12:39:56.127348', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/e0079472-f893-4e1e-ae22-64629ad92d04', 'kwargs': {'cooldown_delay': None}}}
  24588. Traceback (most recent call last):
  24589. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  24590. res = self.process(message)
  24591. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  24592. result = func(message, **settings)
  24593. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  24594. found, result = self._call_hook_for(message, "workflow", message)
  24595. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24596. return True, func(*args, **kwargs)
  24597. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  24598. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24599. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24600. return True, func(*args, **kwargs)
  24601. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24602. return func(*args, **kwargs)
  24603. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  24604. return _exec(cmd, **kwargs)
  24605. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  24606. conn.write_line(cmd)
  24607. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  24608. self.ensure_open()
  24609. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  24610. self.open()
  24611. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  24612. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  24613. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  24614. raise attempt.get()
  24615. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  24616. six.reraise(self.value[0], self.value[1], self.value[2])
  24617. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  24618. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  24619. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24620. self._serial.open()
  24621. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24622. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24623. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24624. 2020-08-04 12:40:00,252 [messaging :206 ][ERROR ][618] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  24625. Traceback (most recent call last):
  24626. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  24627. self._call_hook_for(message, "workflow", message)
  24628. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24629. return True, func(*args, **kwargs)
  24630. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  24631. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24632. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24633. return True, func(*args, **kwargs)
  24634. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24635. return func(*args, **kwargs)
  24636. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  24637. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  24638. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  24639. res = query("AT+QGPSLOC={:d}".format(mode))
  24640. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  24641. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  24642. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  24643. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  24644. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  24645. raise salt.exceptions.CommandExecutionError(message["error"])
  24646. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24647. 2020-08-04 12:40:05,106 [obd.obd :107 ][ERROR ][654] Failed to use explicit port '/dev/serial0'
  24648. Traceback (most recent call last):
  24649. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  24650. self.interface.open(baudrate, protocol=protocol)
  24651. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  24652. self.set_protocol(prot.pop("id", None), **prot)
  24653. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  24654. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  24655. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  24656. self._protocol = self._auto_protocol(**kwargs)
  24657. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  24658. res_0100 = self._verify_protocol("auto", test=not verify)
  24659. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  24660. for line in self.query("0100", parse=False, read_timeout=10):
  24661. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  24662. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  24663. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  24664. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  24665. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  24666. data = self._port.read(self._port.in_waiting or 1)
  24667. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  24668. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  24669. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  24670. sys.exit(salt.defaults.exitcodes.EX_OK)
  24671. SystemExit: 0
  24672. 2020-08-04 12:40:05,141 [obd.obd :120 ][WARNING ][654] Cannot load commands - no connection to bus
  24673. 2020-08-04 12:40:05,170 [obd.interfaces.elm327:730 ][ERROR ][654] Failed to relay command 'STSLCS' to interface
  24674. Traceback (most recent call last):
  24675. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  24676. lines = self.send(cmd, raw_response=raw_response)
  24677. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  24678. raise ELM327Error(self.ERRORS[line], code=line)
  24679. ELM327Error: Operation interrupted by a received RS232 character
  24680. 2020-08-04 12:40:05,173 [messaging :742 ][ERROR ][654] Exception while processing event: {'tag': 'obd/req/928da780-8f4b-4c59-b87c-2397296f65e9', 'data': {'_stamp': '2020-08-04T12:39:59.607269', 'handler': 'execute', '_event_tag': 'obd/req/928da780-8f4b-4c59-b87c-2397296f65e9', 'args': ['STSLCS']}}
  24681. Traceback (most recent call last):
  24682. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  24683. res = self.process(message)
  24684. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  24685. result = func(message, **settings)
  24686. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  24687. found, result = self._call_hook_for(message, "workflow", message)
  24688. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24689. return True, func(*args, **kwargs)
  24690. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  24691. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24692. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24693. return True, func(*args, **kwargs)
  24694. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24695. return func(*args, **kwargs)
  24696. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  24697. res = conn.execute(cmd)
  24698. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  24699. return func(self, *args, **kwargs)
  24700. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  24701. return self._obd.execute(cmd, **kwargs)
  24702. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  24703. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  24704. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  24705. lines = self.send(cmd, raw_response=raw_response)
  24706. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  24707. raise ELM327Error(self.ERRORS[line], code=line)
  24708. ELM327Error: Operation interrupted by a received RS232 character
  24709. 2020-08-04 12:40:05,960 [salt.utils.parsers:1050][WARNING ][417] Minion received a SIGTERM. Exiting.
  24710. 2020-08-04 12:40:06,500 [messaging :871 ][WARNING ][831] No reply message with tag 'obd/res/928da780-8f4b-4c59-b87c-2397296f65e9' received within timeout of 30 secs
  24711. 2020-08-04 12:40:06,506 [salt.state :292 ][ERROR ][831] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  24712. 2020-08-04 12:40:23,109 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  24713. 2020-08-04 12:40:23,132 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  24714. 2020-08-04 12:40:23,143 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  24715. 2020-08-04 12:40:23,808 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24716. Traceback (most recent call last):
  24717. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24718. self._serial.open()
  24719. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24720. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24721. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24722. 2020-08-04 12:40:24,830 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24723. Traceback (most recent call last):
  24724. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24725. self._serial.open()
  24726. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24727. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24728. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24729. 2020-08-04 12:40:25,181 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24730. 2020-08-04 12:40:25,684 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24731. 2020-08-04 12:40:25,843 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24732. Traceback (most recent call last):
  24733. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24734. self._serial.open()
  24735. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24736. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24737. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24738. 2020-08-04 12:40:26,187 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24739. 2020-08-04 12:40:26,189 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  24740. 2020-08-04 12:40:26,487 [messaging :208 ][ERROR ][617] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  24741. Traceback (most recent call last):
  24742. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  24743. self._call_hook_for(message, "workflow", message)
  24744. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24745. return True, func(*args, **kwargs)
  24746. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  24747. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24748. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24749. return True, func(*args, **kwargs)
  24750. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24751. return func(*args, **kwargs)
  24752. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  24753. res = _exec("AT+CCLK?")
  24754. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  24755. conn.write_line(cmd)
  24756. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  24757. self.ensure_open()
  24758. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  24759. self.open()
  24760. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  24761. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  24762. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  24763. raise attempt.get()
  24764. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  24765. six.reraise(self.value[0], self.value[1], self.value[2])
  24766. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  24767. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  24768. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24769. self._serial.open()
  24770. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24771. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24772. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24773. 2020-08-04 12:40:26,693 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24774. 2020-08-04 12:40:27,196 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24775. 2020-08-04 12:40:27,698 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24776. 2020-08-04 12:40:27,701 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  24777. 2020-08-04 12:40:28,204 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24778. 2020-08-04 12:40:28,708 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24779. 2020-08-04 12:40:29,211 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24780. 2020-08-04 12:40:29,213 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  24781. 2020-08-04 12:40:29,216 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24782. 2020-08-04 12:40:29,719 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24783. 2020-08-04 12:40:30,222 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24784. 2020-08-04 12:40:30,224 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  24785. 2020-08-04 12:40:30,610 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24786. Traceback (most recent call last):
  24787. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24788. self._serial.open()
  24789. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24790. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24791. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24792. 2020-08-04 12:40:30,733 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24793. 2020-08-04 12:40:31,236 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24794. 2020-08-04 12:40:31,627 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24795. Traceback (most recent call last):
  24796. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24797. self._serial.open()
  24798. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24799. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24800. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24801. 2020-08-04 12:40:31,738 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24802. 2020-08-04 12:40:31,741 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  24803. 2020-08-04 12:40:32,244 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24804. 2020-08-04 12:40:32,640 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24805. Traceback (most recent call last):
  24806. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24807. self._serial.open()
  24808. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24809. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24810. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24811. 2020-08-04 12:40:32,654 [messaging :742 ][ERROR ][617] Exception while processing event: {'tag': 'ec2x/req/94b6034e-86a2-4bfd-b0a3-d985c74fd0ba', 'data': {'_stamp': '2020-08-04T12:40:23.185070', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/94b6034e-86a2-4bfd-b0a3-d985c74fd0ba', 'kwargs': {'cooldown_delay': None}}}
  24812. Traceback (most recent call last):
  24813. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  24814. res = self.process(message)
  24815. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  24816. result = func(message, **settings)
  24817. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  24818. found, result = self._call_hook_for(message, "workflow", message)
  24819. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24820. return True, func(*args, **kwargs)
  24821. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  24822. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24823. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24824. return True, func(*args, **kwargs)
  24825. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24826. return func(*args, **kwargs)
  24827. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  24828. return _exec(cmd, **kwargs)
  24829. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  24830. conn.write_line(cmd)
  24831. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  24832. self.ensure_open()
  24833. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  24834. self.open()
  24835. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  24836. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  24837. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  24838. raise attempt.get()
  24839. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  24840. six.reraise(self.value[0], self.value[1], self.value[2])
  24841. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  24842. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  24843. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24844. self._serial.open()
  24845. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24846. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24847. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24848. 2020-08-04 12:40:32,747 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24849. 2020-08-04 12:40:33,250 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  24850. 2020-08-04 12:40:33,253 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  24851. 2020-08-04 12:40:33,255 [messaging :208 ][ERROR ][620] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  24852. Traceback (most recent call last):
  24853. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  24854. self._call_hook_for(message, "workflow", message)
  24855. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24856. return True, func(*args, **kwargs)
  24857. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  24858. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24859. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24860. return True, func(*args, **kwargs)
  24861. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24862. return func(*args, **kwargs)
  24863. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  24864. conn.heartbeat()
  24865. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  24866. self.noop()
  24867. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  24868. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  24869. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  24870. raise attempt.get()
  24871. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  24872. six.reraise(self.value[0], self.value[1], self.value[2])
  24873. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  24874. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  24875. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  24876. self._begin_message()
  24877. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  24878. self.recv(ack=ACK_MESSAGE_BEGIN)
  24879. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  24880. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  24881. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  24882. raise attempt.get()
  24883. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  24884. six.reraise(self.value[0], self.value[1], self.value[2])
  24885. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  24886. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  24887. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  24888. raise Exception(msg)
  24889. Exception: Expected ack '12' but got '255'
  24890. 2020-08-04 12:40:33,313 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24891. Traceback (most recent call last):
  24892. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24893. self._serial.open()
  24894. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24895. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24896. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24897. 2020-08-04 12:40:34,319 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24898. Traceback (most recent call last):
  24899. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24900. self._serial.open()
  24901. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24902. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24903. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24904. 2020-08-04 12:40:34,827 [messaging :208 ][ERROR ][618] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  24905. Traceback (most recent call last):
  24906. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  24907. self._call_hook_for(message, "workflow", message)
  24908. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24909. return True, func(*args, **kwargs)
  24910. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  24911. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24912. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24913. return True, func(*args, **kwargs)
  24914. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24915. return func(*args, **kwargs)
  24916. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  24917. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  24918. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  24919. res = query("AT+QGPSLOC={:d}".format(mode))
  24920. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  24921. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  24922. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  24923. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  24924. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  24925. raise salt.exceptions.CommandExecutionError(message["error"])
  24926. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24927. 2020-08-04 12:40:35,324 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24928. Traceback (most recent call last):
  24929. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24930. self._serial.open()
  24931. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24932. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24933. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24934. 2020-08-04 12:40:35,841 [messaging :206 ][ERROR ][617] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  24935. Traceback (most recent call last):
  24936. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  24937. self._call_hook_for(message, "workflow", message)
  24938. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24939. return True, func(*args, **kwargs)
  24940. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  24941. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24942. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24943. return True, func(*args, **kwargs)
  24944. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  24945. return func(*args, **kwargs)
  24946. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  24947. res = _exec("AT+CCLK?")
  24948. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  24949. conn.write_line(cmd)
  24950. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  24951. self.ensure_open()
  24952. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  24953. self.open()
  24954. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  24955. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  24956. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  24957. raise attempt.get()
  24958. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  24959. six.reraise(self.value[0], self.value[1], self.value[2])
  24960. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  24961. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  24962. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24963. self._serial.open()
  24964. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24965. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24966. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24967. 2020-08-04 12:40:51,140 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][657] Timeout after 1.28205128205 second(s) waiting for interrupt
  24968. 2020-08-04 12:40:51,187 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24969. Traceback (most recent call last):
  24970. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24971. self._serial.open()
  24972. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24973. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24974. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24975. 2020-08-04 12:40:52,192 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24976. Traceback (most recent call last):
  24977. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24978. self._serial.open()
  24979. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24980. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24981. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24982. 2020-08-04 12:40:53,208 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  24983. Traceback (most recent call last):
  24984. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  24985. self._serial.open()
  24986. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  24987. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  24988. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  24989. 2020-08-04 12:40:53,211 [messaging :206 ][ERROR ][617] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  24990. Traceback (most recent call last):
  24991. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  24992. self._call_hook_for(message, "workflow", message)
  24993. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24994. return True, func(*args, **kwargs)
  24995. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  24996. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  24997. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  24998. return True, func(*args, **kwargs)
  24999. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25000. return func(*args, **kwargs)
  25001. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  25002. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  25003. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  25004. conn.write_line(cmd)
  25005. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  25006. self.ensure_open()
  25007. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  25008. self.open()
  25009. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  25010. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  25011. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  25012. raise attempt.get()
  25013. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  25014. six.reraise(self.value[0], self.value[1], self.value[2])
  25015. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  25016. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  25017. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25018. self._serial.open()
  25019. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25020. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25021. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25022. 2020-08-04 12:40:53,213 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  25023. Traceback (most recent call last):
  25024. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25025. self._serial.open()
  25026. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25027. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25028. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25029. 2020-08-04 12:40:54,223 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  25030. Traceback (most recent call last):
  25031. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25032. self._serial.open()
  25033. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25034. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25035. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25036. 2020-08-04 12:40:55,227 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  25037. Traceback (most recent call last):
  25038. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25039. self._serial.open()
  25040. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25041. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25042. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25043. 2020-08-04 12:40:55,229 [messaging :742 ][ERROR ][617] Exception while processing event: {'tag': 'ec2x/req/3a8c62df-2f4f-482d-945d-6417e23a4dd2', 'data': {'_stamp': '2020-08-04T12:40:51.138572', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/3a8c62df-2f4f-482d-945d-6417e23a4dd2', 'kwargs': {'cooldown_delay': None}}}
  25044. Traceback (most recent call last):
  25045. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  25046. res = self.process(message)
  25047. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  25048. result = func(message, **settings)
  25049. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  25050. found, result = self._call_hook_for(message, "workflow", message)
  25051. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25052. return True, func(*args, **kwargs)
  25053. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  25054. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25055. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25056. return True, func(*args, **kwargs)
  25057. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25058. return func(*args, **kwargs)
  25059. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  25060. return _exec(cmd, **kwargs)
  25061. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  25062. conn.write_line(cmd)
  25063. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  25064. self.ensure_open()
  25065. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  25066. self.open()
  25067. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  25068. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  25069. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  25070. raise attempt.get()
  25071. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  25072. six.reraise(self.value[0], self.value[1], self.value[2])
  25073. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  25074. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  25075. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25076. self._serial.open()
  25077. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25078. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25079. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25080. 2020-08-04 12:40:55,257 [messaging :206 ][ERROR ][618] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  25081. Traceback (most recent call last):
  25082. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  25083. self._call_hook_for(message, "workflow", message)
  25084. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25085. return True, func(*args, **kwargs)
  25086. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  25087. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25088. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25089. return True, func(*args, **kwargs)
  25090. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25091. return func(*args, **kwargs)
  25092. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  25093. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  25094. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  25095. res = query("AT+QGPSLOC={:d}".format(mode))
  25096. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  25097. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  25098. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  25099. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  25100. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  25101. raise salt.exceptions.CommandExecutionError(message["error"])
  25102. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25103. 2020-08-04 12:41:00,282 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  25104. Traceback (most recent call last):
  25105. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25106. self._serial.open()
  25107. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25108. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25109. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25110. 2020-08-04 12:41:01,113 [obd.obd :107 ][ERROR ][656] Failed to use explicit port '/dev/serial0'
  25111. Traceback (most recent call last):
  25112. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  25113. self.interface.open(baudrate, protocol=protocol)
  25114. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  25115. self.set_protocol(prot.pop("id", None), **prot)
  25116. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  25117. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  25118. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  25119. self._protocol = self._auto_protocol(**kwargs)
  25120. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  25121. res_0100 = self._verify_protocol("auto", test=not verify)
  25122. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  25123. for line in self.query("0100", parse=False, read_timeout=10):
  25124. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  25125. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  25126. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  25127. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  25128. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  25129. data = self._port.read(self._port.in_waiting or 1)
  25130. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  25131. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  25132. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  25133. sys.exit(salt.defaults.exitcodes.EX_OK)
  25134. SystemExit: 0
  25135. 2020-08-04 12:41:01,148 [obd.obd :120 ][WARNING ][656] Cannot load commands - no connection to bus
  25136. 2020-08-04 12:41:01,238 [messaging :753 ][WARNING ][617] No reply to send back for event: {'tag': 'ec2x/req/94e9a9af-ecdc-4eb8-8bc3-e32bcb0297fa', 'data': {'_stamp': '2020-08-04T12:41:00.272921', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/94e9a9af-ecdc-4eb8-8bc3-e32bcb0297fa', 'kwargs': {'cooldown_delay': None}}}
  25137. 2020-08-04 12:41:01,935 [salt.utils.parsers:1050][WARNING ][416] Minion received a SIGTERM. Exiting.
  25138. 2020-08-04 12:41:02,475 [messaging :871 ][WARNING ][831] No reply message with tag 'obd/res/f1619ecb-bca6-413f-82f7-1b926e11e7b9' received within timeout of 30 secs
  25139. 2020-08-04 12:41:02,479 [salt.state :292 ][ERROR ][831] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  25140. 2020-08-04 12:41:18,935 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  25141. 2020-08-04 12:41:18,942 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  25142. 2020-08-04 12:41:18,945 [gpio_spi_conn :42 ][WARNING ][619] Unable to clear buffer - got unexpected value: 255
  25143. 2020-08-04 12:41:19,654 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  25144. Traceback (most recent call last):
  25145. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25146. self._serial.open()
  25147. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25148. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25149. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25150. 2020-08-04 12:41:20,673 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  25151. Traceback (most recent call last):
  25152. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25153. self._serial.open()
  25154. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25155. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25156. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25157. 2020-08-04 12:41:20,970 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  25158. 2020-08-04 12:41:21,473 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  25159. 2020-08-04 12:41:21,677 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  25160. Traceback (most recent call last):
  25161. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25162. self._serial.open()
  25163. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25164. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25165. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25166. 2020-08-04 12:41:21,976 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  25167. 2020-08-04 12:41:21,978 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  25168. 2020-08-04 12:41:22,298 [messaging :208 ][ERROR ][616] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  25169. Traceback (most recent call last):
  25170. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  25171. self._call_hook_for(message, "workflow", message)
  25172. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25173. return True, func(*args, **kwargs)
  25174. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  25175. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25176. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25177. return True, func(*args, **kwargs)
  25178. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25179. return func(*args, **kwargs)
  25180. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  25181. res = _exec("AT+CCLK?")
  25182. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  25183. conn.write_line(cmd)
  25184. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  25185. self.ensure_open()
  25186. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  25187. self.open()
  25188. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  25189. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  25190. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  25191. raise attempt.get()
  25192. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  25193. six.reraise(self.value[0], self.value[1], self.value[2])
  25194. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  25195. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  25196. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25197. self._serial.open()
  25198. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25199. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25200. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25201. 2020-08-04 12:41:22,488 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  25202. 2020-08-04 12:41:37,517 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][690] Timeout after 1.28205128205 second(s) waiting for interrupt
  25203. 2020-08-04 12:41:37,597 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  25204. Traceback (most recent call last):
  25205. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25206. self._serial.open()
  25207. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25208. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25209. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25210. 2020-08-04 12:41:37,784 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  25211. 2020-08-04 12:41:38,288 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  25212. 2020-08-04 12:41:38,290 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  25213. 2020-08-04 12:41:38,602 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  25214. Traceback (most recent call last):
  25215. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25216. self._serial.open()
  25217. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25218. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25219. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25220. 2020-08-04 12:41:38,794 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  25221. 2020-08-04 12:41:39,297 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  25222. 2020-08-04 12:41:39,606 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  25223. Traceback (most recent call last):
  25224. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25225. self._serial.open()
  25226. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25227. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25228. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25229. 2020-08-04 12:41:39,611 [messaging :206 ][ERROR ][616] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  25230. Traceback (most recent call last):
  25231. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  25232. self._call_hook_for(message, "workflow", message)
  25233. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25234. return True, func(*args, **kwargs)
  25235. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  25236. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25237. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25238. return True, func(*args, **kwargs)
  25239. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25240. return func(*args, **kwargs)
  25241. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  25242. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  25243. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  25244. conn.write_line(cmd)
  25245. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  25246. self.ensure_open()
  25247. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  25248. self.open()
  25249. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  25250. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  25251. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  25252. raise attempt.get()
  25253. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  25254. six.reraise(self.value[0], self.value[1], self.value[2])
  25255. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  25256. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  25257. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25258. self._serial.open()
  25259. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25260. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25261. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25262. 2020-08-04 12:41:39,800 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  25263. 2020-08-04 12:41:39,803 [spm_conn :139 ][WARNING ][619] Unable to get status: Expected ack '12' but got '255'
  25264. 2020-08-04 12:41:39,807 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  25265. 2020-08-04 12:41:40,311 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  25266. 2020-08-04 12:41:40,815 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  25267. 2020-08-04 12:41:40,817 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  25268. 2020-08-04 12:41:41,309 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  25269. Traceback (most recent call last):
  25270. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25271. self._serial.open()
  25272. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25273. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25274. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25275. 2020-08-04 12:41:41,324 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  25276. 2020-08-04 12:41:41,827 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  25277. 2020-08-04 12:41:42,316 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  25278. Traceback (most recent call last):
  25279. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25280. self._serial.open()
  25281. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25282. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25283. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25284. 2020-08-04 12:41:42,330 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  25285. 2020-08-04 12:41:42,332 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  25286. 2020-08-04 12:41:42,835 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  25287. 2020-08-04 12:41:43,321 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  25288. Traceback (most recent call last):
  25289. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25290. self._serial.open()
  25291. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25292. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25293. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25294. 2020-08-04 12:41:43,324 [messaging :742 ][ERROR ][616] Exception while processing event: {'tag': 'ec2x/req/6b760a91-9c18-4c0e-a9b9-54abcdf26403', 'data': {'_stamp': '2020-08-04T12:41:19.013239', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/6b760a91-9c18-4c0e-a9b9-54abcdf26403', 'kwargs': {'cooldown_delay': None}}}
  25295. Traceback (most recent call last):
  25296. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  25297. res = self.process(message)
  25298. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  25299. result = func(message, **settings)
  25300. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  25301. found, result = self._call_hook_for(message, "workflow", message)
  25302. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25303. return True, func(*args, **kwargs)
  25304. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  25305. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25306. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25307. return True, func(*args, **kwargs)
  25308. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25309. return func(*args, **kwargs)
  25310. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  25311. return _exec(cmd, **kwargs)
  25312. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  25313. conn.write_line(cmd)
  25314. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  25315. self.ensure_open()
  25316. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  25317. self.open()
  25318. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  25319. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  25320. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  25321. raise attempt.get()
  25322. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  25323. six.reraise(self.value[0], self.value[1], self.value[2])
  25324. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  25325. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  25326. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25327. self._serial.open()
  25328. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25329. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25330. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25331. 2020-08-04 12:41:43,338 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  25332. 2020-08-04 12:41:43,841 [gpio_spi_conn :109 ][WARNING ][619] Expected ack '12' but got '255'
  25333. 2020-08-04 12:41:43,844 [spm_conn :82 ][WARNING ][619] Unable to send noop: Expected ack '12' but got '255'
  25334. 2020-08-04 12:41:43,847 [messaging :208 ][ERROR ][619] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  25335. Traceback (most recent call last):
  25336. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  25337. self._call_hook_for(message, "workflow", message)
  25338. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25339. return True, func(*args, **kwargs)
  25340. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  25341. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25342. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25343. return True, func(*args, **kwargs)
  25344. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25345. return func(*args, **kwargs)
  25346. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  25347. conn.heartbeat()
  25348. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  25349. self.noop()
  25350. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  25351. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  25352. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  25353. raise attempt.get()
  25354. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  25355. six.reraise(self.value[0], self.value[1], self.value[2])
  25356. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  25357. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  25358. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  25359. self._begin_message()
  25360. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  25361. self.recv(ack=ACK_MESSAGE_BEGIN)
  25362. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  25363. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  25364. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  25365. raise attempt.get()
  25366. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  25367. six.reraise(self.value[0], self.value[1], self.value[2])
  25368. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  25369. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  25370. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  25371. raise Exception(msg)
  25372. Exception: Expected ack '12' but got '255'
  25373. 2020-08-04 12:41:45,379 [messaging :208 ][ERROR ][617] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  25374. Traceback (most recent call last):
  25375. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  25376. self._call_hook_for(message, "workflow", message)
  25377. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25378. return True, func(*args, **kwargs)
  25379. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  25380. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25381. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25382. return True, func(*args, **kwargs)
  25383. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25384. return func(*args, **kwargs)
  25385. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  25386. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  25387. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  25388. res = query("AT+QGPSLOC={:d}".format(mode))
  25389. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  25390. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  25391. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  25392. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  25393. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  25394. raise salt.exceptions.CommandExecutionError(message["error"])
  25395. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25396. 2020-08-04 12:41:50,452 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  25397. Traceback (most recent call last):
  25398. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25399. self._serial.open()
  25400. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25401. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25402. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25403. 2020-08-04 12:41:51,464 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  25404. Traceback (most recent call last):
  25405. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25406. self._serial.open()
  25407. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25408. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25409. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25410. 2020-08-04 12:41:52,469 [serial_conn :79 ][ERROR ][616] Failed to open serial connection
  25411. Traceback (most recent call last):
  25412. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25413. self._serial.open()
  25414. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25415. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25416. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25417. 2020-08-04 12:41:52,473 [messaging :742 ][ERROR ][616] Exception while processing event: {'tag': 'ec2x/req/a99b3ae3-8981-4181-b32c-5ef028f58469', 'data': {'_stamp': '2020-08-04T12:41:50.443798', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/a99b3ae3-8981-4181-b32c-5ef028f58469', 'kwargs': {'cooldown_delay': None}}}
  25418. Traceback (most recent call last):
  25419. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  25420. res = self.process(message)
  25421. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  25422. result = func(message, **settings)
  25423. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  25424. found, result = self._call_hook_for(message, "workflow", message)
  25425. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25426. return True, func(*args, **kwargs)
  25427. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  25428. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25429. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25430. return True, func(*args, **kwargs)
  25431. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25432. return func(*args, **kwargs)
  25433. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  25434. return _exec(cmd, **kwargs)
  25435. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  25436. conn.write_line(cmd)
  25437. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  25438. self.ensure_open()
  25439. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  25440. self.open()
  25441. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  25442. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  25443. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  25444. raise attempt.get()
  25445. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  25446. six.reraise(self.value[0], self.value[1], self.value[2])
  25447. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  25448. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  25449. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25450. self._serial.open()
  25451. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25452. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25453. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25454. 2020-08-04 12:41:52,490 [messaging :206 ][ERROR ][617] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  25455. Traceback (most recent call last):
  25456. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  25457. self._call_hook_for(message, "workflow", message)
  25458. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25459. return True, func(*args, **kwargs)
  25460. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  25461. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25462. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25463. return True, func(*args, **kwargs)
  25464. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25465. return func(*args, **kwargs)
  25466. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  25467. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  25468. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  25469. res = query("AT+QGPSLOC={:d}".format(mode))
  25470. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  25471. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  25472. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  25473. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  25474. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  25475. raise salt.exceptions.CommandExecutionError(message["error"])
  25476. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25477. 2020-08-04 12:41:55,747 [obd.obd :107 ][ERROR ][677] Failed to use explicit port '/dev/serial0'
  25478. Traceback (most recent call last):
  25479. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  25480. self.interface.open(baudrate, protocol=protocol)
  25481. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  25482. self.set_protocol(prot.pop("id", None), **prot)
  25483. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  25484. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  25485. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  25486. self._protocol = self._auto_protocol(**kwargs)
  25487. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  25488. res_0100 = self._verify_protocol("auto", test=not verify)
  25489. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  25490. for line in self.query("0100", parse=False, read_timeout=10):
  25491. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  25492. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  25493. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  25494. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  25495. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  25496. data = self._port.read(self._port.in_waiting or 1)
  25497. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  25498. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  25499. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  25500. sys.exit(salt.defaults.exitcodes.EX_OK)
  25501. SystemExit: 0
  25502. 2020-08-04 12:41:55,785 [obd.obd :120 ][WARNING ][677] Cannot load commands - no connection to bus
  25503. 2020-08-04 12:41:55,816 [obd.interfaces.elm327:730 ][ERROR ][677] Failed to relay command 'STSLCS' to interface
  25504. Traceback (most recent call last):
  25505. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  25506. lines = self.send(cmd, raw_response=raw_response)
  25507. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  25508. raise ELM327Error(self.ERRORS[line], code=line)
  25509. ELM327Error: Operation interrupted by a received RS232 character
  25510. 2020-08-04 12:41:55,819 [messaging :742 ][ERROR ][677] Exception while processing event: {'tag': 'obd/req/193af430-3f0a-4e28-89db-3d51619a6bb4', 'data': {'_stamp': '2020-08-04T12:41:50.260539', 'handler': 'execute', '_event_tag': 'obd/req/193af430-3f0a-4e28-89db-3d51619a6bb4', 'args': ['STSLCS']}}
  25511. Traceback (most recent call last):
  25512. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  25513. res = self.process(message)
  25514. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  25515. result = func(message, **settings)
  25516. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  25517. found, result = self._call_hook_for(message, "workflow", message)
  25518. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25519. return True, func(*args, **kwargs)
  25520. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  25521. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25522. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25523. return True, func(*args, **kwargs)
  25524. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25525. return func(*args, **kwargs)
  25526. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  25527. res = conn.execute(cmd)
  25528. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  25529. return func(self, *args, **kwargs)
  25530. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  25531. return self._obd.execute(cmd, **kwargs)
  25532. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  25533. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  25534. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  25535. lines = self.send(cmd, raw_response=raw_response)
  25536. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  25537. raise ELM327Error(self.ERRORS[line], code=line)
  25538. ELM327Error: Operation interrupted by a received RS232 character
  25539. 2020-08-04 12:41:56,596 [salt.utils.parsers:1050][WARNING ][416] Minion received a SIGTERM. Exiting.
  25540. 2020-08-04 12:41:57,136 [messaging :871 ][WARNING ][816] No reply message with tag 'obd/res/193af430-3f0a-4e28-89db-3d51619a6bb4' received within timeout of 30 secs
  25541. 2020-08-04 12:41:57,140 [salt.state :292 ][ERROR ][816] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  25542. 2020-08-04 12:42:14,057 [gpio_spi_conn :42 ][WARNING ][635] Unable to clear buffer - got unexpected value: 255
  25543. 2020-08-04 12:42:14,072 [gpio_spi_conn :42 ][WARNING ][635] Unable to clear buffer - got unexpected value: 255
  25544. 2020-08-04 12:42:14,094 [gpio_spi_conn :42 ][WARNING ][635] Unable to clear buffer - got unexpected value: 255
  25545. 2020-08-04 12:42:14,727 [serial_conn :79 ][ERROR ][632] Failed to open serial connection
  25546. Traceback (most recent call last):
  25547. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25548. self._serial.open()
  25549. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25550. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25551. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25552. 2020-08-04 12:42:15,744 [serial_conn :79 ][ERROR ][632] Failed to open serial connection
  25553. Traceback (most recent call last):
  25554. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25555. self._serial.open()
  25556. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25557. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25558. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25559. 2020-08-04 12:42:16,114 [gpio_spi_conn :109 ][WARNING ][635] Expected ack '12' but got '255'
  25560. 2020-08-04 12:42:16,617 [gpio_spi_conn :109 ][WARNING ][635] Expected ack '12' but got '255'
  25561. 2020-08-04 12:42:16,749 [serial_conn :79 ][ERROR ][632] Failed to open serial connection
  25562. Traceback (most recent call last):
  25563. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25564. self._serial.open()
  25565. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25566. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25567. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25568. 2020-08-04 12:42:17,120 [gpio_spi_conn :109 ][WARNING ][635] Expected ack '12' but got '255'
  25569. 2020-08-04 12:42:17,122 [spm_conn :139 ][WARNING ][635] Unable to get status: Expected ack '12' but got '255'
  25570. 2020-08-04 12:42:17,303 [messaging :208 ][ERROR ][632] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  25571. Traceback (most recent call last):
  25572. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  25573. self._call_hook_for(message, "workflow", message)
  25574. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25575. return True, func(*args, **kwargs)
  25576. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  25577. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25578. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25579. return True, func(*args, **kwargs)
  25580. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25581. return func(*args, **kwargs)
  25582. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  25583. res = _exec("AT+CCLK?")
  25584. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  25585. conn.write_line(cmd)
  25586. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  25587. self.ensure_open()
  25588. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  25589. self.open()
  25590. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  25591. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  25592. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  25593. raise attempt.get()
  25594. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  25595. six.reraise(self.value[0], self.value[1], self.value[2])
  25596. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  25597. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  25598. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25599. self._serial.open()
  25600. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25601. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25602. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25603. 2020-08-04 12:42:17,626 [gpio_spi_conn :109 ][WARNING ][635] Expected ack '12' but got '255'
  25604. 2020-08-04 12:42:18,129 [gpio_spi_conn :109 ][WARNING ][635] Expected ack '12' but got '255'
  25605. 2020-08-04 12:42:18,632 [gpio_spi_conn :109 ][WARNING ][635] Expected ack '12' but got '255'
  25606. 2020-08-04 12:42:18,636 [spm_conn :139 ][WARNING ][635] Unable to get status: Expected ack '12' but got '255'
  25607. 2020-08-04 12:42:19,140 [gpio_spi_conn :109 ][WARNING ][635] Expected ack '12' but got '255'
  25608. 2020-08-04 12:42:19,643 [gpio_spi_conn :109 ][WARNING ][635] Expected ack '12' but got '255'
  25609. 2020-08-04 12:42:20,149 [gpio_spi_conn :109 ][WARNING ][635] Expected ack '12' but got '255'
  25610. 2020-08-04 12:42:20,151 [spm_conn :139 ][WARNING ][635] Unable to get status: Expected ack '12' but got '255'
  25611. 2020-08-04 12:42:20,154 [gpio_spi_conn :109 ][WARNING ][635] Expected ack '12' but got '255'
  25612. 2020-08-04 12:42:20,657 [gpio_spi_conn :109 ][WARNING ][635] Expected ack '12' but got '255'
  25613. 2020-08-04 12:42:21,160 [gpio_spi_conn :109 ][WARNING ][635] Expected ack '12' but got '255'
  25614. 2020-08-04 12:42:21,162 [spm_conn :82 ][WARNING ][635] Unable to send noop: Expected ack '12' but got '255'
  25615. 2020-08-04 12:42:21,665 [gpio_spi_conn :109 ][WARNING ][635] Expected ack '12' but got '255'
  25616. 2020-08-04 12:42:21,730 [serial_conn :79 ][ERROR ][632] Failed to open serial connection
  25617. Traceback (most recent call last):
  25618. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25619. self._serial.open()
  25620. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25621. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25622. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25623. 2020-08-04 12:42:22,168 [gpio_spi_conn :109 ][WARNING ][635] Expected ack '12' but got '255'
  25624. 2020-08-04 12:42:22,671 [gpio_spi_conn :109 ][WARNING ][635] Expected ack '12' but got '255'
  25625. 2020-08-04 12:42:22,674 [spm_conn :82 ][WARNING ][635] Unable to send noop: Expected ack '12' but got '255'
  25626. 2020-08-04 12:42:22,734 [serial_conn :79 ][ERROR ][632] Failed to open serial connection
  25627. Traceback (most recent call last):
  25628. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25629. self._serial.open()
  25630. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25631. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25632. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25633. 2020-08-04 12:42:23,178 [gpio_spi_conn :109 ][WARNING ][635] Expected ack '12' but got '255'
  25634. 2020-08-04 12:42:23,681 [gpio_spi_conn :109 ][WARNING ][635] Expected ack '12' but got '255'
  25635. 2020-08-04 12:42:23,739 [serial_conn :79 ][ERROR ][632] Failed to open serial connection
  25636. Traceback (most recent call last):
  25637. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25638. self._serial.open()
  25639. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25640. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25641. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25642. 2020-08-04 12:42:23,742 [messaging :742 ][ERROR ][632] Exception while processing event: {'tag': 'ec2x/req/44dce162-ddc7-487c-8db6-562d165a5347', 'data': {'_stamp': '2020-08-04T12:42:14.146434', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/44dce162-ddc7-487c-8db6-562d165a5347', 'kwargs': {'cooldown_delay': None}}}
  25643. Traceback (most recent call last):
  25644. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  25645. res = self.process(message)
  25646. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  25647. result = func(message, **settings)
  25648. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  25649. found, result = self._call_hook_for(message, "workflow", message)
  25650. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25651. return True, func(*args, **kwargs)
  25652. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  25653. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25654. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25655. return True, func(*args, **kwargs)
  25656. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25657. return func(*args, **kwargs)
  25658. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  25659. return _exec(cmd, **kwargs)
  25660. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  25661. conn.write_line(cmd)
  25662. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  25663. self.ensure_open()
  25664. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  25665. self.open()
  25666. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  25667. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  25668. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  25669. raise attempt.get()
  25670. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  25671. six.reraise(self.value[0], self.value[1], self.value[2])
  25672. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  25673. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  25674. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25675. self._serial.open()
  25676. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25677. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25678. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25679. 2020-08-04 12:42:24,184 [gpio_spi_conn :109 ][WARNING ][635] Expected ack '12' but got '255'
  25680. 2020-08-04 12:42:24,187 [spm_conn :82 ][WARNING ][635] Unable to send noop: Expected ack '12' but got '255'
  25681. 2020-08-04 12:42:24,189 [messaging :208 ][ERROR ][635] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  25682. Traceback (most recent call last):
  25683. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  25684. self._call_hook_for(message, "workflow", message)
  25685. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25686. return True, func(*args, **kwargs)
  25687. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  25688. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25689. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25690. return True, func(*args, **kwargs)
  25691. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25692. return func(*args, **kwargs)
  25693. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  25694. conn.heartbeat()
  25695. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  25696. self.noop()
  25697. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  25698. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  25699. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  25700. raise attempt.get()
  25701. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  25702. six.reraise(self.value[0], self.value[1], self.value[2])
  25703. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  25704. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  25705. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  25706. self._begin_message()
  25707. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  25708. self.recv(ack=ACK_MESSAGE_BEGIN)
  25709. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  25710. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  25711. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  25712. raise attempt.get()
  25713. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  25714. six.reraise(self.value[0], self.value[1], self.value[2])
  25715. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  25716. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  25717. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  25718. raise Exception(msg)
  25719. Exception: Expected ack '12' but got '255'
  25720. 2020-08-04 12:42:24,381 [serial_conn :79 ][ERROR ][632] Failed to open serial connection
  25721. Traceback (most recent call last):
  25722. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25723. self._serial.open()
  25724. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25725. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25726. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25727. 2020-08-04 12:42:25,386 [serial_conn :79 ][ERROR ][632] Failed to open serial connection
  25728. Traceback (most recent call last):
  25729. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25730. self._serial.open()
  25731. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25732. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25733. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25734. 2020-08-04 12:42:26,197 [messaging :208 ][ERROR ][633] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  25735. Traceback (most recent call last):
  25736. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  25737. self._call_hook_for(message, "workflow", message)
  25738. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25739. return True, func(*args, **kwargs)
  25740. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  25741. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25742. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25743. return True, func(*args, **kwargs)
  25744. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25745. return func(*args, **kwargs)
  25746. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  25747. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  25748. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  25749. res = query("AT+QGPSLOC={:d}".format(mode))
  25750. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  25751. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  25752. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  25753. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  25754. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  25755. raise salt.exceptions.CommandExecutionError(message["error"])
  25756. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25757. 2020-08-04 12:42:26,391 [serial_conn :79 ][ERROR ][632] Failed to open serial connection
  25758. Traceback (most recent call last):
  25759. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25760. self._serial.open()
  25761. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25762. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25763. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25764. 2020-08-04 12:42:26,903 [messaging :206 ][ERROR ][632] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  25765. Traceback (most recent call last):
  25766. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  25767. self._call_hook_for(message, "workflow", message)
  25768. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25769. return True, func(*args, **kwargs)
  25770. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  25771. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25772. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25773. return True, func(*args, **kwargs)
  25774. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25775. return func(*args, **kwargs)
  25776. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  25777. res = _exec("AT+CCLK?")
  25778. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  25779. conn.write_line(cmd)
  25780. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  25781. self.ensure_open()
  25782. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  25783. self.open()
  25784. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  25785. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  25786. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  25787. raise attempt.get()
  25788. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  25789. six.reraise(self.value[0], self.value[1], self.value[2])
  25790. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  25791. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  25792. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25793. self._serial.open()
  25794. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25795. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25796. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25797. 2020-08-04 12:42:31,236 [serial_conn :79 ][ERROR ][632] Failed to open serial connection
  25798. Traceback (most recent call last):
  25799. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25800. self._serial.open()
  25801. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25802. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25803. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25804. 2020-08-04 12:42:32,241 [serial_conn :79 ][ERROR ][632] Failed to open serial connection
  25805. Traceback (most recent call last):
  25806. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25807. self._serial.open()
  25808. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25809. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25810. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25811. 2020-08-04 12:42:33,246 [serial_conn :79 ][ERROR ][632] Failed to open serial connection
  25812. Traceback (most recent call last):
  25813. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25814. self._serial.open()
  25815. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25816. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25817. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25818. 2020-08-04 12:42:33,251 [messaging :742 ][ERROR ][632] Exception while processing event: {'tag': 'ec2x/req/c683146c-6de2-4d22-a54b-0a6b5537c030', 'data': {'_stamp': '2020-08-04T12:42:31.225252', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/c683146c-6de2-4d22-a54b-0a6b5537c030', 'kwargs': {'cooldown_delay': None}}}
  25819. Traceback (most recent call last):
  25820. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  25821. res = self.process(message)
  25822. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  25823. result = func(message, **settings)
  25824. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  25825. found, result = self._call_hook_for(message, "workflow", message)
  25826. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25827. return True, func(*args, **kwargs)
  25828. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  25829. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25830. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25831. return True, func(*args, **kwargs)
  25832. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25833. return func(*args, **kwargs)
  25834. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  25835. return _exec(cmd, **kwargs)
  25836. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  25837. conn.write_line(cmd)
  25838. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  25839. self.ensure_open()
  25840. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  25841. self.open()
  25842. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  25843. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  25844. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  25845. raise attempt.get()
  25846. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  25847. six.reraise(self.value[0], self.value[1], self.value[2])
  25848. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  25849. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  25850. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25851. self._serial.open()
  25852. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25853. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25854. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25855. 2020-08-04 12:42:33,309 [messaging :206 ][ERROR ][633] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  25856. Traceback (most recent call last):
  25857. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  25858. self._call_hook_for(message, "workflow", message)
  25859. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25860. return True, func(*args, **kwargs)
  25861. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  25862. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25863. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25864. return True, func(*args, **kwargs)
  25865. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25866. return func(*args, **kwargs)
  25867. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  25868. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  25869. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  25870. res = query("AT+QGPSLOC={:d}".format(mode))
  25871. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  25872. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  25873. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  25874. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  25875. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  25876. raise salt.exceptions.CommandExecutionError(message["error"])
  25877. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25878. 2020-08-04 12:42:33,829 [serial_conn :79 ][ERROR ][632] Failed to open serial connection
  25879. Traceback (most recent call last):
  25880. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25881. self._serial.open()
  25882. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25883. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25884. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25885. 2020-08-04 12:42:34,833 [serial_conn :79 ][ERROR ][632] Failed to open serial connection
  25886. Traceback (most recent call last):
  25887. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25888. self._serial.open()
  25889. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25890. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25891. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25892. 2020-08-04 12:42:35,838 [serial_conn :79 ][ERROR ][632] Failed to open serial connection
  25893. Traceback (most recent call last):
  25894. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25895. self._serial.open()
  25896. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25897. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25898. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25899. 2020-08-04 12:42:35,897 [salt.loaded.int.module.cmdmod:693 ][ERROR ][632] Command '['timedatectl', 'set-ntp', '1']' failed with return code: 1
  25900. 2020-08-04 12:42:35,899 [salt.loaded.int.module.cmdmod:697 ][ERROR ][632] stderr: Failed to set ntp: Refusing activation, D-Bus is shutting down.
  25901. 2020-08-04 12:42:35,901 [salt.loaded.int.module.cmdmod:699 ][ERROR ][632] retcode: 1
  25902. 2020-08-04 12:42:35,904 [messaging :208 ][ERROR ][632] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  25903. Traceback (most recent call last):
  25904. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  25905. self._call_hook_for(message, "workflow", message)
  25906. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25907. return True, func(*args, **kwargs)
  25908. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  25909. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25910. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25911. return True, func(*args, **kwargs)
  25912. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25913. return func(*args, **kwargs)
  25914. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 295, in sync_time_handler
  25915. __salt__["clock.ntp"](enable=True)
  25916. File "/var/cache/salt/minion/extmods/modules/clock.py", line 76, in ntp
  25917. raise salt.exceptions.CommandExecutionError(res["stderr"])
  25918. CommandExecutionError: Failed to set ntp: Refusing activation, D-Bus is shutting down.
  25919. 2020-08-04 12:42:36,632 [obd.obd :107 ][ERROR ][719] Failed to use explicit port '/dev/serial0'
  25920. Traceback (most recent call last):
  25921. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  25922. self.interface.open(baudrate, protocol=protocol)
  25923. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  25924. self.set_protocol(prot.pop("id", None), **prot)
  25925. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  25926. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  25927. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  25928. self._protocol = self._auto_protocol(**kwargs)
  25929. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  25930. res_0100 = self._verify_protocol("auto", test=not verify)
  25931. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  25932. for line in self.query("0100", parse=False, read_timeout=10):
  25933. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  25934. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  25935. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  25936. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  25937. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  25938. data = self._port.read(self._port.in_waiting or 1)
  25939. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  25940. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  25941. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  25942. sys.exit(salt.defaults.exitcodes.EX_OK)
  25943. SystemExit: 0
  25944. 2020-08-04 12:42:36,691 [obd.obd :120 ][WARNING ][719] Cannot load commands - no connection to bus
  25945. 2020-08-04 12:42:36,727 [obd.interfaces.elm327:730 ][ERROR ][719] Failed to relay command 'STSLCS' to interface
  25946. Traceback (most recent call last):
  25947. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  25948. lines = self.send(cmd, raw_response=raw_response)
  25949. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  25950. raise ELM327Error(self.ERRORS[line], code=line)
  25951. ELM327Error: Operation interrupted by a received RS232 character
  25952. 2020-08-04 12:42:36,731 [messaging :742 ][ERROR ][719] Exception while processing event: {'tag': 'obd/req/3c606d05-d5e2-4f71-ba7c-f614fc2366d9', 'data': {'_stamp': '2020-08-04T12:42:31.053709', 'handler': 'execute', '_event_tag': 'obd/req/3c606d05-d5e2-4f71-ba7c-f614fc2366d9', 'args': ['STSLCS']}}
  25953. Traceback (most recent call last):
  25954. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  25955. res = self.process(message)
  25956. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  25957. result = func(message, **settings)
  25958. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  25959. found, result = self._call_hook_for(message, "workflow", message)
  25960. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25961. return True, func(*args, **kwargs)
  25962. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  25963. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  25964. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  25965. return True, func(*args, **kwargs)
  25966. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  25967. return func(*args, **kwargs)
  25968. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  25969. res = conn.execute(cmd)
  25970. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  25971. return func(self, *args, **kwargs)
  25972. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  25973. return self._obd.execute(cmd, **kwargs)
  25974. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  25975. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  25976. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  25977. lines = self.send(cmd, raw_response=raw_response)
  25978. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  25979. raise ELM327Error(self.ERRORS[line], code=line)
  25980. ELM327Error: Operation interrupted by a received RS232 character
  25981. 2020-08-04 12:42:37,473 [salt.utils.parsers:1050][WARNING ][431] Minion received a SIGTERM. Exiting.
  25982. 2020-08-04 12:42:38,014 [messaging :871 ][WARNING ][846] No reply message with tag 'obd/res/3c606d05-d5e2-4f71-ba7c-f614fc2366d9' received within timeout of 30 secs
  25983. 2020-08-04 12:42:38,018 [salt.state :292 ][ERROR ][846] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  25984. 2020-08-04 12:42:54,775 [gpio_spi_conn :42 ][WARNING ][628] Unable to clear buffer - got unexpected value: 255
  25985. 2020-08-04 12:42:54,794 [gpio_spi_conn :42 ][WARNING ][628] Unable to clear buffer - got unexpected value: 255
  25986. 2020-08-04 12:42:54,800 [gpio_spi_conn :42 ][WARNING ][628] Unable to clear buffer - got unexpected value: 255
  25987. 2020-08-04 12:42:54,922 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  25988. Traceback (most recent call last):
  25989. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25990. self._serial.open()
  25991. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25992. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  25993. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  25994. 2020-08-04 12:42:55,941 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  25995. Traceback (most recent call last):
  25996. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  25997. self._serial.open()
  25998. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  25999. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26000. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26001. 2020-08-04 12:42:56,828 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26002. 2020-08-04 12:42:56,945 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  26003. Traceback (most recent call last):
  26004. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26005. self._serial.open()
  26006. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26007. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26008. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26009. 2020-08-04 12:42:57,331 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26010. 2020-08-04 12:42:57,606 [messaging :208 ][ERROR ][625] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  26011. Traceback (most recent call last):
  26012. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  26013. self._call_hook_for(message, "workflow", message)
  26014. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26015. return True, func(*args, **kwargs)
  26016. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  26017. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26018. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26019. return True, func(*args, **kwargs)
  26020. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26021. return func(*args, **kwargs)
  26022. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  26023. res = _exec("AT+CCLK?")
  26024. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  26025. conn.write_line(cmd)
  26026. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  26027. self.ensure_open()
  26028. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  26029. self.open()
  26030. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  26031. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  26032. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  26033. raise attempt.get()
  26034. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  26035. six.reraise(self.value[0], self.value[1], self.value[2])
  26036. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  26037. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  26038. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26039. self._serial.open()
  26040. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26041. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26042. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26043. 2020-08-04 12:42:57,834 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26044. 2020-08-04 12:42:57,836 [spm_conn :139 ][WARNING ][628] Unable to get status: Expected ack '12' but got '255'
  26045. 2020-08-04 12:42:58,340 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26046. 2020-08-04 12:42:58,845 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26047. 2020-08-04 12:42:59,349 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26048. 2020-08-04 12:42:59,351 [spm_conn :139 ][WARNING ][628] Unable to get status: Expected ack '12' but got '255'
  26049. 2020-08-04 12:42:59,855 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26050. 2020-08-04 12:43:00,368 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26051. 2020-08-04 12:43:00,872 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26052. 2020-08-04 12:43:00,874 [spm_conn :139 ][WARNING ][628] Unable to get status: Expected ack '12' but got '255'
  26053. 2020-08-04 12:43:00,878 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26054. 2020-08-04 12:43:01,381 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26055. 2020-08-04 12:43:01,885 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26056. 2020-08-04 12:43:01,887 [spm_conn :82 ][WARNING ][628] Unable to send noop: Expected ack '12' but got '255'
  26057. 2020-08-04 12:43:02,160 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  26058. Traceback (most recent call last):
  26059. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26060. self._serial.open()
  26061. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26062. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26063. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26064. 2020-08-04 12:43:02,392 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26065. 2020-08-04 12:43:02,895 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26066. 2020-08-04 12:43:03,184 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  26067. Traceback (most recent call last):
  26068. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26069. self._serial.open()
  26070. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26071. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26072. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26073. 2020-08-04 12:43:03,398 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26074. 2020-08-04 12:43:03,401 [spm_conn :82 ][WARNING ][628] Unable to send noop: Expected ack '12' but got '255'
  26075. 2020-08-04 12:43:03,905 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26076. 2020-08-04 12:43:04,197 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  26077. Traceback (most recent call last):
  26078. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26079. self._serial.open()
  26080. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26081. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26082. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26083. 2020-08-04 12:43:04,199 [messaging :742 ][ERROR ][625] Exception while processing event: {'tag': 'ec2x/req/1ab07e4d-ac76-493a-a1c2-88ae1b36de72', 'data': {'_stamp': '2020-08-04T12:42:54.850764', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/1ab07e4d-ac76-493a-a1c2-88ae1b36de72', 'kwargs': {'cooldown_delay': None}}}
  26084. Traceback (most recent call last):
  26085. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  26086. res = self.process(message)
  26087. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  26088. result = func(message, **settings)
  26089. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  26090. found, result = self._call_hook_for(message, "workflow", message)
  26091. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26092. return True, func(*args, **kwargs)
  26093. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  26094. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26095. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26096. return True, func(*args, **kwargs)
  26097. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26098. return func(*args, **kwargs)
  26099. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  26100. return _exec(cmd, **kwargs)
  26101. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  26102. conn.write_line(cmd)
  26103. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  26104. self.ensure_open()
  26105. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  26106. self.open()
  26107. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  26108. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  26109. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  26110. raise attempt.get()
  26111. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  26112. six.reraise(self.value[0], self.value[1], self.value[2])
  26113. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  26114. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  26115. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26116. self._serial.open()
  26117. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26118. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26119. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26120. 2020-08-04 12:43:04,413 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26121. 2020-08-04 12:43:04,842 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  26122. Traceback (most recent call last):
  26123. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26124. self._serial.open()
  26125. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26126. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26127. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26128. 2020-08-04 12:43:04,917 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26129. 2020-08-04 12:43:04,925 [spm_conn :82 ][WARNING ][628] Unable to send noop: Expected ack '12' but got '255'
  26130. 2020-08-04 12:43:04,929 [messaging :208 ][ERROR ][628] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  26131. Traceback (most recent call last):
  26132. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  26133. self._call_hook_for(message, "workflow", message)
  26134. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26135. return True, func(*args, **kwargs)
  26136. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  26137. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26138. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26139. return True, func(*args, **kwargs)
  26140. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26141. return func(*args, **kwargs)
  26142. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  26143. conn.heartbeat()
  26144. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  26145. self.noop()
  26146. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  26147. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  26148. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  26149. raise attempt.get()
  26150. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  26151. six.reraise(self.value[0], self.value[1], self.value[2])
  26152. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  26153. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  26154. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  26155. self._begin_message()
  26156. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  26157. self.recv(ack=ACK_MESSAGE_BEGIN)
  26158. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  26159. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  26160. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  26161. raise attempt.get()
  26162. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  26163. six.reraise(self.value[0], self.value[1], self.value[2])
  26164. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  26165. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  26166. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  26167. raise Exception(msg)
  26168. Exception: Expected ack '12' but got '255'
  26169. 2020-08-04 12:43:05,848 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  26170. Traceback (most recent call last):
  26171. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26172. self._serial.open()
  26173. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26174. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26175. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26176. 2020-08-04 12:43:06,478 [messaging :208 ][ERROR ][626] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  26177. Traceback (most recent call last):
  26178. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  26179. self._call_hook_for(message, "workflow", message)
  26180. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26181. return True, func(*args, **kwargs)
  26182. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  26183. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26184. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26185. return True, func(*args, **kwargs)
  26186. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26187. return func(*args, **kwargs)
  26188. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  26189. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  26190. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  26191. res = query("AT+QGPSLOC={:d}".format(mode))
  26192. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  26193. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  26194. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  26195. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  26196. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  26197. raise salt.exceptions.CommandExecutionError(message["error"])
  26198. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26199. 2020-08-04 12:43:06,853 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  26200. Traceback (most recent call last):
  26201. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26202. self._serial.open()
  26203. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26204. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26205. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26206. 2020-08-04 12:43:07,360 [messaging :206 ][ERROR ][625] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  26207. Traceback (most recent call last):
  26208. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  26209. self._call_hook_for(message, "workflow", message)
  26210. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26211. return True, func(*args, **kwargs)
  26212. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  26213. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26214. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26215. return True, func(*args, **kwargs)
  26216. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26217. return func(*args, **kwargs)
  26218. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  26219. res = _exec("AT+CCLK?")
  26220. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  26221. conn.write_line(cmd)
  26222. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  26223. self.ensure_open()
  26224. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  26225. self.open()
  26226. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  26227. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  26228. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  26229. raise attempt.get()
  26230. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  26231. six.reraise(self.value[0], self.value[1], self.value[2])
  26232. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  26233. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  26234. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26235. self._serial.open()
  26236. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26237. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26238. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26239. 2020-08-04 12:43:11,523 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  26240. Traceback (most recent call last):
  26241. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26242. self._serial.open()
  26243. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26244. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26245. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26246. 2020-08-04 12:43:12,527 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  26247. Traceback (most recent call last):
  26248. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26249. self._serial.open()
  26250. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26251. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26252. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26253. 2020-08-04 12:43:13,531 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  26254. Traceback (most recent call last):
  26255. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26256. self._serial.open()
  26257. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26258. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26259. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26260. 2020-08-04 12:43:13,535 [messaging :742 ][ERROR ][625] Exception while processing event: {'tag': 'ec2x/req/2f40a21a-7003-4e3a-8635-5956f6a9d6e9', 'data': {'_stamp': '2020-08-04T12:43:11.516028', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/2f40a21a-7003-4e3a-8635-5956f6a9d6e9', 'kwargs': {'cooldown_delay': None}}}
  26261. Traceback (most recent call last):
  26262. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  26263. res = self.process(message)
  26264. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  26265. result = func(message, **settings)
  26266. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  26267. found, result = self._call_hook_for(message, "workflow", message)
  26268. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26269. return True, func(*args, **kwargs)
  26270. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  26271. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26272. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26273. return True, func(*args, **kwargs)
  26274. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26275. return func(*args, **kwargs)
  26276. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  26277. return _exec(cmd, **kwargs)
  26278. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  26279. conn.write_line(cmd)
  26280. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  26281. self.ensure_open()
  26282. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  26283. self.open()
  26284. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  26285. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  26286. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  26287. raise attempt.get()
  26288. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  26289. six.reraise(self.value[0], self.value[1], self.value[2])
  26290. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  26291. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  26292. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26293. self._serial.open()
  26294. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26295. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26296. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26297. 2020-08-04 12:43:13,589 [messaging :206 ][ERROR ][626] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  26298. Traceback (most recent call last):
  26299. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  26300. self._call_hook_for(message, "workflow", message)
  26301. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26302. return True, func(*args, **kwargs)
  26303. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  26304. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26305. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26306. return True, func(*args, **kwargs)
  26307. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26308. return func(*args, **kwargs)
  26309. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  26310. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  26311. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  26312. res = query("AT+QGPSLOC={:d}".format(mode))
  26313. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  26314. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  26315. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  26316. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  26317. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  26318. raise salt.exceptions.CommandExecutionError(message["error"])
  26319. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26320. 2020-08-04 12:43:14,130 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  26321. Traceback (most recent call last):
  26322. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26323. self._serial.open()
  26324. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26325. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26326. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26327. 2020-08-04 12:43:15,135 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  26328. Traceback (most recent call last):
  26329. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26330. self._serial.open()
  26331. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26332. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26333. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26334. 2020-08-04 12:43:16,139 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  26335. Traceback (most recent call last):
  26336. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26337. self._serial.open()
  26338. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26339. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26340. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26341. 2020-08-04 12:43:16,195 [salt.loaded.int.module.cmdmod:693 ][ERROR ][625] Command '['timedatectl', 'set-ntp', '1']' failed with return code: 1
  26342. 2020-08-04 12:43:16,198 [salt.loaded.int.module.cmdmod:697 ][ERROR ][625] stderr: Failed to set ntp: Refusing activation, D-Bus is shutting down.
  26343. 2020-08-04 12:43:16,200 [salt.loaded.int.module.cmdmod:699 ][ERROR ][625] retcode: 1
  26344. 2020-08-04 12:43:16,202 [messaging :208 ][ERROR ][625] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  26345. Traceback (most recent call last):
  26346. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  26347. self._call_hook_for(message, "workflow", message)
  26348. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26349. return True, func(*args, **kwargs)
  26350. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  26351. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26352. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26353. return True, func(*args, **kwargs)
  26354. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26355. return func(*args, **kwargs)
  26356. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 295, in sync_time_handler
  26357. __salt__["clock.ntp"](enable=True)
  26358. File "/var/cache/salt/minion/extmods/modules/clock.py", line 76, in ntp
  26359. raise salt.exceptions.CommandExecutionError(res["stderr"])
  26360. CommandExecutionError: Failed to set ntp: Refusing activation, D-Bus is shutting down.
  26361. 2020-08-04 12:43:16,995 [obd.obd :107 ][ERROR ][701] Failed to use explicit port '/dev/serial0'
  26362. Traceback (most recent call last):
  26363. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  26364. self.interface.open(baudrate, protocol=protocol)
  26365. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  26366. self.set_protocol(prot.pop("id", None), **prot)
  26367. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  26368. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  26369. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  26370. self._protocol = self._auto_protocol(**kwargs)
  26371. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  26372. res_0100 = self._verify_protocol("auto", test=not verify)
  26373. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  26374. for line in self.query("0100", parse=False, read_timeout=10):
  26375. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  26376. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  26377. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  26378. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  26379. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  26380. data = self._port.read(self._port.in_waiting or 1)
  26381. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  26382. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  26383. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  26384. sys.exit(salt.defaults.exitcodes.EX_OK)
  26385. SystemExit: 0
  26386. 2020-08-04 12:43:17,044 [obd.obd :120 ][WARNING ][701] Cannot load commands - no connection to bus
  26387. 2020-08-04 12:43:17,077 [obd.interfaces.elm327:730 ][ERROR ][701] Failed to relay command 'STSLCS' to interface
  26388. Traceback (most recent call last):
  26389. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  26390. lines = self.send(cmd, raw_response=raw_response)
  26391. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  26392. raise ELM327Error(self.ERRORS[line], code=line)
  26393. ELM327Error: Operation interrupted by a received RS232 character
  26394. 2020-08-04 12:43:17,080 [messaging :742 ][ERROR ][701] Exception while processing event: {'tag': 'obd/req/9b595c5e-1222-488e-935a-387cb49c45c2', 'data': {'_stamp': '2020-08-04T12:43:11.329403', 'handler': 'execute', '_event_tag': 'obd/req/9b595c5e-1222-488e-935a-387cb49c45c2', 'args': ['STSLCS']}}
  26395. Traceback (most recent call last):
  26396. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  26397. res = self.process(message)
  26398. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  26399. result = func(message, **settings)
  26400. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  26401. found, result = self._call_hook_for(message, "workflow", message)
  26402. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26403. return True, func(*args, **kwargs)
  26404. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  26405. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26406. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26407. return True, func(*args, **kwargs)
  26408. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26409. return func(*args, **kwargs)
  26410. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  26411. res = conn.execute(cmd)
  26412. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  26413. return func(self, *args, **kwargs)
  26414. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  26415. return self._obd.execute(cmd, **kwargs)
  26416. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  26417. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  26418. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  26419. lines = self.send(cmd, raw_response=raw_response)
  26420. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  26421. raise ELM327Error(self.ERRORS[line], code=line)
  26422. ELM327Error: Operation interrupted by a received RS232 character
  26423. 2020-08-04 12:43:17,759 [salt.utils.parsers:1050][WARNING ][424] Minion received a SIGTERM. Exiting.
  26424. 2020-08-04 12:43:18,299 [messaging :871 ][WARNING ][825] No reply message with tag 'obd/res/9b595c5e-1222-488e-935a-387cb49c45c2' received within timeout of 30 secs
  26425. 2020-08-04 12:43:18,303 [salt.state :292 ][ERROR ][825] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  26426. 2020-08-04 12:43:34,932 [gpio_spi_conn :42 ][WARNING ][616] Unable to clear buffer - got unexpected value: 255
  26427. 2020-08-04 12:43:34,952 [gpio_spi_conn :42 ][WARNING ][616] Unable to clear buffer - got unexpected value: 255
  26428. 2020-08-04 12:43:34,960 [gpio_spi_conn :42 ][WARNING ][616] Unable to clear buffer - got unexpected value: 255
  26429. 2020-08-04 12:43:35,068 [serial_conn :79 ][ERROR ][613] Failed to open serial connection
  26430. Traceback (most recent call last):
  26431. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26432. self._serial.open()
  26433. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26434. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26435. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26436. 2020-08-04 12:43:36,080 [serial_conn :79 ][ERROR ][613] Failed to open serial connection
  26437. Traceback (most recent call last):
  26438. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26439. self._serial.open()
  26440. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26441. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26442. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26443. 2020-08-04 12:43:36,986 [gpio_spi_conn :109 ][WARNING ][616] Expected ack '12' but got '255'
  26444. 2020-08-04 12:43:37,084 [serial_conn :79 ][ERROR ][613] Failed to open serial connection
  26445. Traceback (most recent call last):
  26446. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26447. self._serial.open()
  26448. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26449. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26450. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26451. 2020-08-04 12:43:37,489 [gpio_spi_conn :109 ][WARNING ][616] Expected ack '12' but got '255'
  26452. 2020-08-04 12:43:37,683 [messaging :208 ][ERROR ][613] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  26453. Traceback (most recent call last):
  26454. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  26455. self._call_hook_for(message, "workflow", message)
  26456. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26457. return True, func(*args, **kwargs)
  26458. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  26459. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26460. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26461. return True, func(*args, **kwargs)
  26462. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26463. return func(*args, **kwargs)
  26464. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  26465. res = _exec("AT+CCLK?")
  26466. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  26467. conn.write_line(cmd)
  26468. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  26469. self.ensure_open()
  26470. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  26471. self.open()
  26472. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  26473. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  26474. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  26475. raise attempt.get()
  26476. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  26477. six.reraise(self.value[0], self.value[1], self.value[2])
  26478. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  26479. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  26480. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26481. self._serial.open()
  26482. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26483. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26484. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26485. 2020-08-04 12:43:37,992 [gpio_spi_conn :109 ][WARNING ][616] Expected ack '12' but got '255'
  26486. 2020-08-04 12:43:37,995 [spm_conn :139 ][WARNING ][616] Unable to get status: Expected ack '12' but got '255'
  26487. 2020-08-04 12:44:21,621 [serial_conn :79 ][ERROR ][613] Failed to open serial connection
  26488. Traceback (most recent call last):
  26489. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26490. self._serial.open()
  26491. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26492. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26493. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26494. 2020-08-04 12:44:21,862 [gpio_spi_conn :109 ][WARNING ][616] Expected ack '12' but got '255'
  26495. 2020-08-04 12:44:22,366 [gpio_spi_conn :109 ][WARNING ][616] Expected ack '12' but got '255'
  26496. 2020-08-04 12:44:22,639 [serial_conn :79 ][ERROR ][613] Failed to open serial connection
  26497. Traceback (most recent call last):
  26498. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26499. self._serial.open()
  26500. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26501. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26502. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26503. 2020-08-04 12:44:22,869 [gpio_spi_conn :109 ][WARNING ][616] Expected ack '12' but got '255'
  26504. 2020-08-04 12:44:22,871 [spm_conn :139 ][WARNING ][616] Unable to get status: Expected ack '12' but got '255'
  26505. 2020-08-04 12:44:23,374 [gpio_spi_conn :109 ][WARNING ][616] Expected ack '12' but got '255'
  26506. 2020-08-04 12:44:23,657 [serial_conn :79 ][ERROR ][613] Failed to open serial connection
  26507. Traceback (most recent call last):
  26508. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26509. self._serial.open()
  26510. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26511. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26512. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26513. 2020-08-04 12:44:23,669 [messaging :206 ][ERROR ][613] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  26514. Traceback (most recent call last):
  26515. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  26516. self._call_hook_for(message, "workflow", message)
  26517. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26518. return True, func(*args, **kwargs)
  26519. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  26520. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26521. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26522. return True, func(*args, **kwargs)
  26523. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26524. return func(*args, **kwargs)
  26525. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  26526. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  26527. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  26528. conn.write_line(cmd)
  26529. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  26530. self.ensure_open()
  26531. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  26532. self.open()
  26533. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  26534. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  26535. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  26536. raise attempt.get()
  26537. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  26538. six.reraise(self.value[0], self.value[1], self.value[2])
  26539. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  26540. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  26541. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26542. self._serial.open()
  26543. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26544. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26545. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26546. 2020-08-04 12:44:23,878 [gpio_spi_conn :109 ][WARNING ][616] Expected ack '12' but got '255'
  26547. 2020-08-04 12:44:24,383 [gpio_spi_conn :109 ][WARNING ][616] Expected ack '12' but got '255'
  26548. 2020-08-04 12:44:24,386 [spm_conn :139 ][WARNING ][616] Unable to get status: Expected ack '12' but got '255'
  26549. 2020-08-04 12:44:24,389 [gpio_spi_conn :109 ][WARNING ][616] Expected ack '12' but got '255'
  26550. 2020-08-04 12:44:24,892 [gpio_spi_conn :109 ][WARNING ][616] Expected ack '12' but got '255'
  26551. 2020-08-04 12:44:25,395 [gpio_spi_conn :109 ][WARNING ][616] Expected ack '12' but got '255'
  26552. 2020-08-04 12:44:25,398 [spm_conn :82 ][WARNING ][616] Unable to send noop: Expected ack '12' but got '255'
  26553. 2020-08-04 12:44:25,692 [messaging :871 ][WARNING ][614] No reply message with tag 'ec2x/res/e4d8cc25-10cf-4153-b767-39028d903a65' received within timeout of 30 secs
  26554. 2020-08-04 12:44:25,683 [serial_conn :79 ][ERROR ][613] Failed to open serial connection
  26555. Traceback (most recent call last):
  26556. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26557. self._serial.open()
  26558. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26559. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26560. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26561. 2020-08-04 12:44:25,722 [messaging :208 ][ERROR ][614] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  26562. Traceback (most recent call last):
  26563. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  26564. self._call_hook_for(message, "workflow", message)
  26565. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26566. return True, func(*args, **kwargs)
  26567. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  26568. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26569. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26570. return True, func(*args, **kwargs)
  26571. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26572. return func(*args, **kwargs)
  26573. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  26574. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  26575. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  26576. res = query("AT+QGPSLOC={:d}".format(mode))
  26577. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  26578. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  26579. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  26580. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  26581. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 874, in _recv_reply
  26582. "No reply message received within timeout of {:d} secs - please try again and maybe increase timeout value".format(timeout))
  26583. CommandExecutionError: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  26584. 2020-08-04 12:44:25,902 [gpio_spi_conn :109 ][WARNING ][616] Expected ack '12' but got '255'
  26585. 2020-08-04 12:44:26,407 [gpio_spi_conn :109 ][WARNING ][616] Expected ack '12' but got '255'
  26586. 2020-08-04 12:44:26,724 [serial_conn :79 ][ERROR ][613] Failed to open serial connection
  26587. Traceback (most recent call last):
  26588. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26589. self._serial.open()
  26590. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26591. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26592. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26593. 2020-08-04 12:44:26,913 [gpio_spi_conn :109 ][WARNING ][616] Expected ack '12' but got '255'
  26594. 2020-08-04 12:44:26,917 [spm_conn :82 ][WARNING ][616] Unable to send noop: Expected ack '12' but got '255'
  26595. 2020-08-04 12:44:27,423 [gpio_spi_conn :109 ][WARNING ][616] Expected ack '12' but got '255'
  26596. 2020-08-04 12:44:27,729 [serial_conn :79 ][ERROR ][613] Failed to open serial connection
  26597. Traceback (most recent call last):
  26598. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26599. self._serial.open()
  26600. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26601. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26602. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26603. 2020-08-04 12:44:27,732 [messaging :742 ][ERROR ][613] Exception while processing event: {'tag': 'ec2x/req/e4d8cc25-10cf-4153-b767-39028d903a65', 'data': {'_stamp': '2020-08-04T12:43:35.013049', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/e4d8cc25-10cf-4153-b767-39028d903a65', 'kwargs': {'cooldown_delay': None}}}
  26604. Traceback (most recent call last):
  26605. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  26606. res = self.process(message)
  26607. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  26608. result = func(message, **settings)
  26609. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  26610. found, result = self._call_hook_for(message, "workflow", message)
  26611. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26612. return True, func(*args, **kwargs)
  26613. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  26614. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26615. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26616. return True, func(*args, **kwargs)
  26617. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26618. return func(*args, **kwargs)
  26619. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  26620. return _exec(cmd, **kwargs)
  26621. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  26622. conn.write_line(cmd)
  26623. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  26624. self.ensure_open()
  26625. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  26626. self.open()
  26627. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  26628. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  26629. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  26630. raise attempt.get()
  26631. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  26632. six.reraise(self.value[0], self.value[1], self.value[2])
  26633. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  26634. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  26635. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26636. self._serial.open()
  26637. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26638. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26639. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26640. 2020-08-04 12:44:27,928 [gpio_spi_conn :109 ][WARNING ][616] Expected ack '12' but got '255'
  26641. 2020-08-04 12:44:28,431 [gpio_spi_conn :109 ][WARNING ][616] Expected ack '12' but got '255'
  26642. 2020-08-04 12:44:28,434 [spm_conn :82 ][WARNING ][616] Unable to send noop: Expected ack '12' but got '255'
  26643. 2020-08-04 12:44:28,436 [messaging :208 ][ERROR ][616] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  26644. Traceback (most recent call last):
  26645. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  26646. self._call_hook_for(message, "workflow", message)
  26647. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26648. return True, func(*args, **kwargs)
  26649. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  26650. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26651. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26652. return True, func(*args, **kwargs)
  26653. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26654. return func(*args, **kwargs)
  26655. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  26656. conn.heartbeat()
  26657. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  26658. self.noop()
  26659. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  26660. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  26661. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  26662. raise attempt.get()
  26663. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  26664. six.reraise(self.value[0], self.value[1], self.value[2])
  26665. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  26666. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  26667. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  26668. self._begin_message()
  26669. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  26670. self.recv(ack=ACK_MESSAGE_BEGIN)
  26671. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  26672. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  26673. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  26674. raise attempt.get()
  26675. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  26676. six.reraise(self.value[0], self.value[1], self.value[2])
  26677. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  26678. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  26679. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  26680. raise Exception(msg)
  26681. Exception: Expected ack '12' but got '255'
  26682. 2020-08-04 12:44:30,772 [serial_conn :79 ][ERROR ][613] Failed to open serial connection
  26683. Traceback (most recent call last):
  26684. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26685. self._serial.open()
  26686. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26687. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26688. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26689. 2020-08-04 12:44:31,777 [serial_conn :79 ][ERROR ][613] Failed to open serial connection
  26690. Traceback (most recent call last):
  26691. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26692. self._serial.open()
  26693. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26694. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26695. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26696. 2020-08-04 12:44:32,781 [serial_conn :79 ][ERROR ][613] Failed to open serial connection
  26697. Traceback (most recent call last):
  26698. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26699. self._serial.open()
  26700. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26701. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26702. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26703. 2020-08-04 12:44:32,784 [messaging :742 ][ERROR ][613] Exception while processing event: {'tag': 'ec2x/req/bb45d0a9-2436-449a-9662-18c993360d59', 'data': {'_stamp': '2020-08-04T12:44:30.761134', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/bb45d0a9-2436-449a-9662-18c993360d59', 'kwargs': {'cooldown_delay': None}}}
  26704. Traceback (most recent call last):
  26705. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  26706. res = self.process(message)
  26707. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  26708. result = func(message, **settings)
  26709. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  26710. found, result = self._call_hook_for(message, "workflow", message)
  26711. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26712. return True, func(*args, **kwargs)
  26713. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  26714. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26715. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26716. return True, func(*args, **kwargs)
  26717. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26718. return func(*args, **kwargs)
  26719. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  26720. return _exec(cmd, **kwargs)
  26721. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  26722. conn.write_line(cmd)
  26723. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  26724. self.ensure_open()
  26725. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  26726. self.open()
  26727. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  26728. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  26729. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  26730. raise attempt.get()
  26731. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  26732. six.reraise(self.value[0], self.value[1], self.value[2])
  26733. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  26734. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  26735. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26736. self._serial.open()
  26737. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26738. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26739. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26740. 2020-08-04 12:44:32,821 [messaging :208 ][ERROR ][614] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  26741. Traceback (most recent call last):
  26742. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  26743. self._call_hook_for(message, "workflow", message)
  26744. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26745. return True, func(*args, **kwargs)
  26746. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  26747. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26748. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26749. return True, func(*args, **kwargs)
  26750. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26751. return func(*args, **kwargs)
  26752. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  26753. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  26754. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  26755. res = query("AT+QGPSLOC={:d}".format(mode))
  26756. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  26757. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  26758. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  26759. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  26760. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  26761. raise salt.exceptions.CommandExecutionError(message["error"])
  26762. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26763. 2020-08-04 12:44:37,841 [serial_conn :79 ][ERROR ][613] Failed to open serial connection
  26764. Traceback (most recent call last):
  26765. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26766. self._serial.open()
  26767. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26768. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26769. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26770. 2020-08-04 12:44:38,845 [serial_conn :79 ][ERROR ][613] Failed to open serial connection
  26771. Traceback (most recent call last):
  26772. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26773. self._serial.open()
  26774. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26775. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26776. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26777. 2020-08-04 12:44:39,850 [serial_conn :79 ][ERROR ][613] Failed to open serial connection
  26778. Traceback (most recent call last):
  26779. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26780. self._serial.open()
  26781. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26782. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26783. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26784. 2020-08-04 12:44:39,854 [messaging :742 ][ERROR ][613] Exception while processing event: {'tag': 'ec2x/req/f782ae61-b331-4e19-b720-a95f165460b6', 'data': {'_stamp': '2020-08-04T12:44:37.834305', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/f782ae61-b331-4e19-b720-a95f165460b6', 'kwargs': {'cooldown_delay': None}}}
  26785. Traceback (most recent call last):
  26786. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  26787. res = self.process(message)
  26788. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  26789. result = func(message, **settings)
  26790. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  26791. found, result = self._call_hook_for(message, "workflow", message)
  26792. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26793. return True, func(*args, **kwargs)
  26794. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  26795. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26796. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26797. return True, func(*args, **kwargs)
  26798. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26799. return func(*args, **kwargs)
  26800. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  26801. return _exec(cmd, **kwargs)
  26802. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  26803. conn.write_line(cmd)
  26804. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  26805. self.ensure_open()
  26806. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  26807. self.open()
  26808. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  26809. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  26810. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  26811. raise attempt.get()
  26812. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  26813. six.reraise(self.value[0], self.value[1], self.value[2])
  26814. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  26815. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  26816. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26817. self._serial.open()
  26818. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26819. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26820. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26821. 2020-08-04 12:44:39,892 [messaging :206 ][ERROR ][614] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  26822. Traceback (most recent call last):
  26823. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  26824. self._call_hook_for(message, "workflow", message)
  26825. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26826. return True, func(*args, **kwargs)
  26827. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  26828. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26829. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26830. return True, func(*args, **kwargs)
  26831. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26832. return func(*args, **kwargs)
  26833. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  26834. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  26835. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  26836. res = query("AT+QGPSLOC={:d}".format(mode))
  26837. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  26838. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  26839. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  26840. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  26841. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  26842. raise salt.exceptions.CommandExecutionError(message["error"])
  26843. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26844. 2020-08-04 12:44:40,475 [obd.obd :107 ][ERROR ][690] Failed to use explicit port '/dev/serial0'
  26845. Traceback (most recent call last):
  26846. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  26847. self.interface.open(baudrate, protocol=protocol)
  26848. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  26849. self.set_protocol(prot.pop("id", None), **prot)
  26850. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  26851. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  26852. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  26853. self._protocol = self._auto_protocol(**kwargs)
  26854. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  26855. res_0100 = self._verify_protocol("auto", test=not verify)
  26856. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  26857. for line in self.query("0100", parse=False, read_timeout=10):
  26858. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  26859. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  26860. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  26861. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  26862. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  26863. data = self._port.read(self._port.in_waiting or 1)
  26864. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  26865. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  26866. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  26867. sys.exit(salt.defaults.exitcodes.EX_OK)
  26868. SystemExit: 0
  26869. 2020-08-04 12:44:40,546 [obd.obd :120 ][WARNING ][690] Cannot load commands - no connection to bus
  26870. 2020-08-04 12:44:40,576 [obd.interfaces.elm327:730 ][ERROR ][690] Failed to relay command 'STSLCS' to interface
  26871. Traceback (most recent call last):
  26872. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  26873. lines = self.send(cmd, raw_response=raw_response)
  26874. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  26875. raise ELM327Error(self.ERRORS[line], code=line)
  26876. ELM327Error: Operation interrupted by a received RS232 character
  26877. 2020-08-04 12:44:40,579 [messaging :742 ][ERROR ][690] Exception while processing event: {'tag': 'obd/req/810b21bf-0d9d-4dd5-aa5e-0d9329befd02', 'data': {'_stamp': '2020-08-04T12:44:34.848389', 'handler': 'execute', '_event_tag': 'obd/req/810b21bf-0d9d-4dd5-aa5e-0d9329befd02', 'args': ['STSLCS']}}
  26878. Traceback (most recent call last):
  26879. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  26880. res = self.process(message)
  26881. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  26882. result = func(message, **settings)
  26883. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  26884. found, result = self._call_hook_for(message, "workflow", message)
  26885. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26886. return True, func(*args, **kwargs)
  26887. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  26888. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26889. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26890. return True, func(*args, **kwargs)
  26891. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26892. return func(*args, **kwargs)
  26893. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  26894. res = conn.execute(cmd)
  26895. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  26896. return func(self, *args, **kwargs)
  26897. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  26898. return self._obd.execute(cmd, **kwargs)
  26899. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  26900. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  26901. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  26902. lines = self.send(cmd, raw_response=raw_response)
  26903. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  26904. raise ELM327Error(self.ERRORS[line], code=line)
  26905. ELM327Error: Operation interrupted by a received RS232 character
  26906. 2020-08-04 12:44:41,287 [salt.utils.parsers:1050][WARNING ][413] Minion received a SIGTERM. Exiting.
  26907. 2020-08-04 12:44:58,088 [gpio_spi_conn :42 ][WARNING ][628] Unable to clear buffer - got unexpected value: 255
  26908. 2020-08-04 12:44:58,107 [gpio_spi_conn :42 ][WARNING ][628] Unable to clear buffer - got unexpected value: 255
  26909. 2020-08-04 12:44:58,111 [gpio_spi_conn :42 ][WARNING ][628] Unable to clear buffer - got unexpected value: 255
  26910. 2020-08-04 12:44:58,732 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  26911. Traceback (most recent call last):
  26912. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26913. self._serial.open()
  26914. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26915. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26916. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26917. 2020-08-04 12:44:59,746 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  26918. Traceback (most recent call last):
  26919. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26920. self._serial.open()
  26921. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26922. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26923. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26924. 2020-08-04 12:45:00,150 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26925. 2020-08-04 12:45:00,653 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26926. 2020-08-04 12:45:00,750 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  26927. Traceback (most recent call last):
  26928. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26929. self._serial.open()
  26930. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26931. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26932. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26933. 2020-08-04 12:45:01,156 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26934. 2020-08-04 12:45:01,158 [spm_conn :139 ][WARNING ][628] Unable to get status: Expected ack '12' but got '255'
  26935. 2020-08-04 12:45:01,357 [messaging :208 ][ERROR ][625] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  26936. Traceback (most recent call last):
  26937. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  26938. self._call_hook_for(message, "workflow", message)
  26939. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26940. return True, func(*args, **kwargs)
  26941. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  26942. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  26943. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  26944. return True, func(*args, **kwargs)
  26945. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  26946. return func(*args, **kwargs)
  26947. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  26948. res = _exec("AT+CCLK?")
  26949. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  26950. conn.write_line(cmd)
  26951. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  26952. self.ensure_open()
  26953. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  26954. self.open()
  26955. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  26956. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  26957. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  26958. raise attempt.get()
  26959. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  26960. six.reraise(self.value[0], self.value[1], self.value[2])
  26961. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  26962. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  26963. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26964. self._serial.open()
  26965. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26966. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26967. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26968. 2020-08-04 12:45:01,665 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26969. 2020-08-04 12:45:02,170 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26970. 2020-08-04 12:45:02,675 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26971. 2020-08-04 12:45:02,677 [spm_conn :139 ][WARNING ][628] Unable to get status: Expected ack '12' but got '255'
  26972. 2020-08-04 12:45:03,181 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26973. 2020-08-04 12:45:03,705 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26974. 2020-08-04 12:45:04,208 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26975. 2020-08-04 12:45:04,210 [spm_conn :139 ][WARNING ][628] Unable to get status: Expected ack '12' but got '255'
  26976. 2020-08-04 12:45:04,213 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26977. 2020-08-04 12:45:04,716 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26978. 2020-08-04 12:45:05,220 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26979. 2020-08-04 12:45:05,222 [spm_conn :82 ][WARNING ][628] Unable to send noop: Expected ack '12' but got '255'
  26980. 2020-08-04 12:45:05,554 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  26981. Traceback (most recent call last):
  26982. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26983. self._serial.open()
  26984. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26985. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26986. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26987. 2020-08-04 12:45:05,726 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26988. 2020-08-04 12:45:06,229 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26989. 2020-08-04 12:45:06,558 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  26990. Traceback (most recent call last):
  26991. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  26992. self._serial.open()
  26993. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  26994. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  26995. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  26996. 2020-08-04 12:45:06,732 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26997. 2020-08-04 12:45:06,746 [spm_conn :82 ][WARNING ][628] Unable to send noop: Expected ack '12' but got '255'
  26998. 2020-08-04 12:45:07,250 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  26999. 2020-08-04 12:45:07,563 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  27000. Traceback (most recent call last):
  27001. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27002. self._serial.open()
  27003. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27004. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27005. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27006. 2020-08-04 12:45:07,565 [messaging :742 ][ERROR ][625] Exception while processing event: {'tag': 'ec2x/req/06bac387-6adb-4752-bc6d-ff85f37faf0f', 'data': {'_stamp': '2020-08-04T12:44:58.178775', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/06bac387-6adb-4752-bc6d-ff85f37faf0f', 'kwargs': {'cooldown_delay': None}}}
  27007. Traceback (most recent call last):
  27008. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  27009. res = self.process(message)
  27010. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  27011. result = func(message, **settings)
  27012. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  27013. found, result = self._call_hook_for(message, "workflow", message)
  27014. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27015. return True, func(*args, **kwargs)
  27016. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  27017. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27018. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27019. return True, func(*args, **kwargs)
  27020. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27021. return func(*args, **kwargs)
  27022. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  27023. return _exec(cmd, **kwargs)
  27024. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  27025. conn.write_line(cmd)
  27026. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  27027. self.ensure_open()
  27028. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  27029. self.open()
  27030. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  27031. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  27032. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  27033. raise attempt.get()
  27034. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  27035. six.reraise(self.value[0], self.value[1], self.value[2])
  27036. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  27037. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  27038. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27039. self._serial.open()
  27040. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27041. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27042. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27043. 2020-08-04 12:45:07,753 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  27044. 2020-08-04 12:45:08,256 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  27045. 2020-08-04 12:45:08,256 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  27046. Traceback (most recent call last):
  27047. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27048. self._serial.open()
  27049. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27050. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27051. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27052. 2020-08-04 12:45:08,258 [spm_conn :82 ][WARNING ][628] Unable to send noop: Expected ack '12' but got '255'
  27053. 2020-08-04 12:45:08,261 [messaging :208 ][ERROR ][628] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  27054. Traceback (most recent call last):
  27055. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  27056. self._call_hook_for(message, "workflow", message)
  27057. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27058. return True, func(*args, **kwargs)
  27059. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  27060. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27061. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27062. return True, func(*args, **kwargs)
  27063. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27064. return func(*args, **kwargs)
  27065. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  27066. conn.heartbeat()
  27067. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  27068. self.noop()
  27069. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  27070. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  27071. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  27072. raise attempt.get()
  27073. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  27074. six.reraise(self.value[0], self.value[1], self.value[2])
  27075. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  27076. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  27077. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  27078. self._begin_message()
  27079. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  27080. self.recv(ack=ACK_MESSAGE_BEGIN)
  27081. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  27082. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  27083. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  27084. raise attempt.get()
  27085. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  27086. six.reraise(self.value[0], self.value[1], self.value[2])
  27087. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  27088. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  27089. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  27090. raise Exception(msg)
  27091. Exception: Expected ack '12' but got '255'
  27092. 2020-08-04 12:45:09,261 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  27093. Traceback (most recent call last):
  27094. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27095. self._serial.open()
  27096. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27097. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27098. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27099. 2020-08-04 12:45:09,792 [messaging :208 ][ERROR ][626] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  27100. Traceback (most recent call last):
  27101. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  27102. self._call_hook_for(message, "workflow", message)
  27103. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27104. return True, func(*args, **kwargs)
  27105. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  27106. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27107. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27108. return True, func(*args, **kwargs)
  27109. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27110. return func(*args, **kwargs)
  27111. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  27112. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  27113. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  27114. res = query("AT+QGPSLOC={:d}".format(mode))
  27115. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  27116. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  27117. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  27118. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  27119. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  27120. raise salt.exceptions.CommandExecutionError(message["error"])
  27121. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27122. 2020-08-04 12:45:10,266 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  27123. Traceback (most recent call last):
  27124. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27125. self._serial.open()
  27126. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27127. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27128. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27129. 2020-08-04 12:45:10,775 [messaging :206 ][ERROR ][625] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  27130. Traceback (most recent call last):
  27131. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  27132. self._call_hook_for(message, "workflow", message)
  27133. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27134. return True, func(*args, **kwargs)
  27135. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  27136. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27137. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27138. return True, func(*args, **kwargs)
  27139. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27140. return func(*args, **kwargs)
  27141. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  27142. res = _exec("AT+CCLK?")
  27143. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  27144. conn.write_line(cmd)
  27145. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  27146. self.ensure_open()
  27147. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  27148. self.open()
  27149. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  27150. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  27151. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  27152. raise attempt.get()
  27153. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  27154. six.reraise(self.value[0], self.value[1], self.value[2])
  27155. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  27156. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  27157. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27158. self._serial.open()
  27159. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27160. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27161. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27162. 2020-08-04 12:45:26,315 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  27163. Traceback (most recent call last):
  27164. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27165. self._serial.open()
  27166. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27167. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27168. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27169. 2020-08-04 12:45:26,336 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][665] Timeout after 1.28205128205 second(s) waiting for interrupt
  27170. 2020-08-04 12:45:27,320 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  27171. Traceback (most recent call last):
  27172. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27173. self._serial.open()
  27174. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27175. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27176. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27177. 2020-08-04 12:45:28,324 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  27178. Traceback (most recent call last):
  27179. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27180. self._serial.open()
  27181. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27182. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27183. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27184. 2020-08-04 12:45:28,340 [messaging :742 ][ERROR ][625] Exception while processing event: {'tag': 'ec2x/req/80ed68ed-39f8-4d04-a2c0-326d98bb5856', 'data': {'_stamp': '2020-08-04T12:45:26.304949', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/80ed68ed-39f8-4d04-a2c0-326d98bb5856', 'kwargs': {'cooldown_delay': None}}}
  27185. Traceback (most recent call last):
  27186. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  27187. res = self.process(message)
  27188. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  27189. result = func(message, **settings)
  27190. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  27191. found, result = self._call_hook_for(message, "workflow", message)
  27192. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27193. return True, func(*args, **kwargs)
  27194. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  27195. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27196. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27197. return True, func(*args, **kwargs)
  27198. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27199. return func(*args, **kwargs)
  27200. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  27201. return _exec(cmd, **kwargs)
  27202. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  27203. conn.write_line(cmd)
  27204. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  27205. self.ensure_open()
  27206. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  27207. self.open()
  27208. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  27209. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  27210. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  27211. raise attempt.get()
  27212. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  27213. six.reraise(self.value[0], self.value[1], self.value[2])
  27214. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  27215. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  27216. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27217. self._serial.open()
  27218. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27219. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27220. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27221. 2020-08-04 12:45:28,397 [messaging :206 ][ERROR ][626] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  27222. Traceback (most recent call last):
  27223. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  27224. self._call_hook_for(message, "workflow", message)
  27225. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27226. return True, func(*args, **kwargs)
  27227. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  27228. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27229. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27230. return True, func(*args, **kwargs)
  27231. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27232. return func(*args, **kwargs)
  27233. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  27234. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  27235. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  27236. res = query("AT+QGPSLOC={:d}".format(mode))
  27237. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  27238. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  27239. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  27240. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  27241. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  27242. raise salt.exceptions.CommandExecutionError(message["error"])
  27243. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27244. 2020-08-04 12:45:28,944 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  27245. Traceback (most recent call last):
  27246. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27247. self._serial.open()
  27248. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27249. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27250. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27251. 2020-08-04 12:45:29,952 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  27252. Traceback (most recent call last):
  27253. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27254. self._serial.open()
  27255. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27256. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27257. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27258. 2020-08-04 12:45:30,956 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  27259. Traceback (most recent call last):
  27260. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27261. self._serial.open()
  27262. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27263. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27264. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27265. 2020-08-04 12:45:31,485 [messaging :206 ][ERROR ][625] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  27266. Traceback (most recent call last):
  27267. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  27268. self._call_hook_for(message, "workflow", message)
  27269. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27270. return True, func(*args, **kwargs)
  27271. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  27272. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27273. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27274. return True, func(*args, **kwargs)
  27275. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27276. return func(*args, **kwargs)
  27277. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  27278. res = _exec("AT+CCLK?")
  27279. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  27280. conn.write_line(cmd)
  27281. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  27282. self.ensure_open()
  27283. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  27284. self.open()
  27285. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  27286. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  27287. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  27288. raise attempt.get()
  27289. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  27290. six.reraise(self.value[0], self.value[1], self.value[2])
  27291. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  27292. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  27293. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27294. self._serial.open()
  27295. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27296. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27297. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27298. 2020-08-04 12:45:33,420 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  27299. Traceback (most recent call last):
  27300. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27301. self._serial.open()
  27302. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27303. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27304. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27305. 2020-08-04 12:45:34,428 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  27306. Traceback (most recent call last):
  27307. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27308. self._serial.open()
  27309. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27310. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27311. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27312. 2020-08-04 12:45:35,368 [obd.obd :107 ][ERROR ][664] Failed to use explicit port '/dev/serial0'
  27313. Traceback (most recent call last):
  27314. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  27315. self.interface.open(baudrate, protocol=protocol)
  27316. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  27317. self.set_protocol(prot.pop("id", None), **prot)
  27318. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  27319. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  27320. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  27321. self._protocol = self._auto_protocol(**kwargs)
  27322. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  27323. res_0100 = self._verify_protocol("auto", test=not verify)
  27324. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  27325. for line in self.query("0100", parse=False, read_timeout=10):
  27326. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  27327. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  27328. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  27329. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  27330. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  27331. data = self._port.read(self._port.in_waiting or 1)
  27332. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  27333. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  27334. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  27335. sys.exit(salt.defaults.exitcodes.EX_OK)
  27336. SystemExit: 0
  27337. 2020-08-04 12:45:35,411 [obd.obd :120 ][WARNING ][664] Cannot load commands - no connection to bus
  27338. 2020-08-04 12:45:35,445 [obd.interfaces.elm327:730 ][ERROR ][664] Failed to relay command 'STSLCS' to interface
  27339. Traceback (most recent call last):
  27340. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  27341. lines = self.send(cmd, raw_response=raw_response)
  27342. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  27343. raise ELM327Error(self.ERRORS[line], code=line)
  27344. ELM327Error: Operation interrupted by a received RS232 character
  27345. 2020-08-04 12:45:35,448 [messaging :742 ][ERROR ][664] Exception while processing event: {'tag': 'obd/req/6470f46b-ae83-419f-9e25-1da74283c42a', 'data': {'_stamp': '2020-08-04T12:45:29.921611', 'handler': 'execute', '_event_tag': 'obd/req/6470f46b-ae83-419f-9e25-1da74283c42a', 'args': ['STSLCS']}}
  27346. Traceback (most recent call last):
  27347. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  27348. res = self.process(message)
  27349. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  27350. result = func(message, **settings)
  27351. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  27352. found, result = self._call_hook_for(message, "workflow", message)
  27353. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27354. return True, func(*args, **kwargs)
  27355. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  27356. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27357. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27358. return True, func(*args, **kwargs)
  27359. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27360. return func(*args, **kwargs)
  27361. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  27362. res = conn.execute(cmd)
  27363. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  27364. return func(self, *args, **kwargs)
  27365. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  27366. return self._obd.execute(cmd, **kwargs)
  27367. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  27368. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  27369. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  27370. lines = self.send(cmd, raw_response=raw_response)
  27371. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  27372. raise ELM327Error(self.ERRORS[line], code=line)
  27373. ELM327Error: Operation interrupted by a received RS232 character
  27374. 2020-08-04 12:45:35,535 [messaging :753 ][WARNING ][625] No reply to send back for event: {'tag': 'ec2x/req/e63257b6-217f-4983-8518-ec20de5fb694', 'data': {'_stamp': '2020-08-04T12:45:33.411545', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/e63257b6-217f-4983-8518-ec20de5fb694', 'kwargs': {'cooldown_delay': None}}}
  27375. 2020-08-04 12:45:36,261 [salt.utils.parsers:1050][WARNING ][425] Minion received a SIGTERM. Exiting.
  27376. 2020-08-04 12:45:36,801 [messaging :871 ][WARNING ][839] No reply message with tag 'obd/res/6470f46b-ae83-419f-9e25-1da74283c42a' received within timeout of 30 secs
  27377. 2020-08-04 12:45:36,805 [salt.state :292 ][ERROR ][839] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  27378. 2020-08-04 12:45:52,868 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  27379. 2020-08-04 12:45:52,877 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  27380. 2020-08-04 12:45:52,881 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  27381. 2020-08-04 12:45:53,516 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  27382. Traceback (most recent call last):
  27383. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27384. self._serial.open()
  27385. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27386. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27387. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27388. 2020-08-04 12:45:54,535 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  27389. Traceback (most recent call last):
  27390. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27391. self._serial.open()
  27392. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27393. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27394. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27395. 2020-08-04 12:45:54,921 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  27396. 2020-08-04 12:45:55,424 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  27397. 2020-08-04 12:45:55,540 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  27398. Traceback (most recent call last):
  27399. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27400. self._serial.open()
  27401. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27402. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27403. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27404. 2020-08-04 12:45:55,927 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  27405. 2020-08-04 12:45:55,930 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  27406. 2020-08-04 12:45:56,152 [messaging :208 ][ERROR ][617] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  27407. Traceback (most recent call last):
  27408. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  27409. self._call_hook_for(message, "workflow", message)
  27410. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27411. return True, func(*args, **kwargs)
  27412. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  27413. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27414. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27415. return True, func(*args, **kwargs)
  27416. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27417. return func(*args, **kwargs)
  27418. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  27419. res = _exec("AT+CCLK?")
  27420. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  27421. conn.write_line(cmd)
  27422. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  27423. self.ensure_open()
  27424. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  27425. self.open()
  27426. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  27427. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  27428. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  27429. raise attempt.get()
  27430. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  27431. six.reraise(self.value[0], self.value[1], self.value[2])
  27432. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  27433. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  27434. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27435. self._serial.open()
  27436. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27437. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27438. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27439. 2020-08-04 12:45:56,434 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  27440. 2020-08-04 12:45:56,939 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  27441. 2020-08-04 12:45:57,442 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  27442. 2020-08-04 12:45:57,444 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  27443. 2020-08-04 12:45:57,947 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  27444. 2020-08-04 12:45:58,452 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  27445. 2020-08-04 12:45:58,957 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  27446. 2020-08-04 12:45:58,962 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  27447. 2020-08-04 12:45:58,967 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  27448. 2020-08-04 12:45:59,472 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  27449. 2020-08-04 12:45:59,977 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  27450. 2020-08-04 12:45:59,982 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  27451. 2020-08-04 12:46:00,307 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  27452. Traceback (most recent call last):
  27453. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27454. self._serial.open()
  27455. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27456. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27457. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27458. 2020-08-04 12:46:00,488 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  27459. 2020-08-04 12:46:00,993 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  27460. 2020-08-04 12:46:01,311 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  27461. Traceback (most recent call last):
  27462. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27463. self._serial.open()
  27464. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27465. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27466. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27467. 2020-08-04 12:46:01,497 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  27468. 2020-08-04 12:46:01,499 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  27469. 2020-08-04 12:46:02,003 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  27470. 2020-08-04 12:46:02,315 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  27471. Traceback (most recent call last):
  27472. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27473. self._serial.open()
  27474. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27475. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27476. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27477. 2020-08-04 12:46:02,333 [messaging :742 ][ERROR ][617] Exception while processing event: {'tag': 'ec2x/req/9bbf1297-2806-40f5-8848-d772dadbab51', 'data': {'_stamp': '2020-08-04T12:45:52.943167', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/9bbf1297-2806-40f5-8848-d772dadbab51', 'kwargs': {'cooldown_delay': None}}}
  27478. Traceback (most recent call last):
  27479. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  27480. res = self.process(message)
  27481. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  27482. result = func(message, **settings)
  27483. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  27484. found, result = self._call_hook_for(message, "workflow", message)
  27485. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27486. return True, func(*args, **kwargs)
  27487. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  27488. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27489. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27490. return True, func(*args, **kwargs)
  27491. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27492. return func(*args, **kwargs)
  27493. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  27494. return _exec(cmd, **kwargs)
  27495. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  27496. conn.write_line(cmd)
  27497. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  27498. self.ensure_open()
  27499. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  27500. self.open()
  27501. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  27502. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  27503. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  27504. raise attempt.get()
  27505. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  27506. six.reraise(self.value[0], self.value[1], self.value[2])
  27507. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  27508. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  27509. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27510. self._serial.open()
  27511. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27512. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27513. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27514. 2020-08-04 12:46:02,508 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  27515. 2020-08-04 12:46:02,960 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  27516. Traceback (most recent call last):
  27517. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27518. self._serial.open()
  27519. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27520. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27521. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27522. 2020-08-04 12:46:03,011 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  27523. 2020-08-04 12:46:03,013 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  27524. 2020-08-04 12:46:03,016 [messaging :208 ][ERROR ][620] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  27525. Traceback (most recent call last):
  27526. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  27527. self._call_hook_for(message, "workflow", message)
  27528. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27529. return True, func(*args, **kwargs)
  27530. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  27531. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27532. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27533. return True, func(*args, **kwargs)
  27534. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27535. return func(*args, **kwargs)
  27536. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  27537. conn.heartbeat()
  27538. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  27539. self.noop()
  27540. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  27541. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  27542. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  27543. raise attempt.get()
  27544. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  27545. six.reraise(self.value[0], self.value[1], self.value[2])
  27546. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  27547. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  27548. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  27549. self._begin_message()
  27550. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  27551. self.recv(ack=ACK_MESSAGE_BEGIN)
  27552. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  27553. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  27554. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  27555. raise attempt.get()
  27556. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  27557. six.reraise(self.value[0], self.value[1], self.value[2])
  27558. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  27559. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  27560. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  27561. raise Exception(msg)
  27562. Exception: Expected ack '12' but got '255'
  27563. 2020-08-04 12:46:03,965 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  27564. Traceback (most recent call last):
  27565. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27566. self._serial.open()
  27567. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27568. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27569. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27570. 2020-08-04 12:46:04,534 [messaging :208 ][ERROR ][618] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  27571. Traceback (most recent call last):
  27572. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  27573. self._call_hook_for(message, "workflow", message)
  27574. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27575. return True, func(*args, **kwargs)
  27576. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  27577. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27578. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27579. return True, func(*args, **kwargs)
  27580. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27581. return func(*args, **kwargs)
  27582. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  27583. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  27584. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  27585. res = query("AT+QGPSLOC={:d}".format(mode))
  27586. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  27587. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  27588. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  27589. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  27590. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  27591. raise salt.exceptions.CommandExecutionError(message["error"])
  27592. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27593. 2020-08-04 12:46:04,969 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  27594. Traceback (most recent call last):
  27595. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27596. self._serial.open()
  27597. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27598. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27599. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27600. 2020-08-04 12:46:05,487 [messaging :206 ][ERROR ][617] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  27601. Traceback (most recent call last):
  27602. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  27603. self._call_hook_for(message, "workflow", message)
  27604. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27605. return True, func(*args, **kwargs)
  27606. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  27607. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27608. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27609. return True, func(*args, **kwargs)
  27610. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27611. return func(*args, **kwargs)
  27612. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  27613. res = _exec("AT+CCLK?")
  27614. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  27615. conn.write_line(cmd)
  27616. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  27617. self.ensure_open()
  27618. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  27619. self.open()
  27620. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  27621. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  27622. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  27623. raise attempt.get()
  27624. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  27625. six.reraise(self.value[0], self.value[1], self.value[2])
  27626. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  27627. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  27628. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27629. self._serial.open()
  27630. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27631. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27632. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27633. 2020-08-04 12:46:20,974 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][657] Timeout after 1.28205128205 second(s) waiting for interrupt
  27634. 2020-08-04 12:46:20,990 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  27635. Traceback (most recent call last):
  27636. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27637. self._serial.open()
  27638. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27639. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27640. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27641. 2020-08-04 12:46:21,995 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  27642. Traceback (most recent call last):
  27643. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27644. self._serial.open()
  27645. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27646. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27647. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27648. 2020-08-04 12:46:22,999 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  27649. Traceback (most recent call last):
  27650. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27651. self._serial.open()
  27652. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27653. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27654. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27655. 2020-08-04 12:46:23,024 [messaging :742 ][ERROR ][617] Exception while processing event: {'tag': 'ec2x/req/f9dc33cb-e607-475a-aaa3-716c0a035031', 'data': {'_stamp': '2020-08-04T12:46:20.982498', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/f9dc33cb-e607-475a-aaa3-716c0a035031', 'kwargs': {'cooldown_delay': None}}}
  27656. Traceback (most recent call last):
  27657. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  27658. res = self.process(message)
  27659. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  27660. result = func(message, **settings)
  27661. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  27662. found, result = self._call_hook_for(message, "workflow", message)
  27663. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27664. return True, func(*args, **kwargs)
  27665. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  27666. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27667. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27668. return True, func(*args, **kwargs)
  27669. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27670. return func(*args, **kwargs)
  27671. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  27672. return _exec(cmd, **kwargs)
  27673. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  27674. conn.write_line(cmd)
  27675. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  27676. self.ensure_open()
  27677. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  27678. self.open()
  27679. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  27680. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  27681. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  27682. raise attempt.get()
  27683. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  27684. six.reraise(self.value[0], self.value[1], self.value[2])
  27685. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  27686. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  27687. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27688. self._serial.open()
  27689. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27690. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27691. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27692. 2020-08-04 12:46:23,074 [messaging :206 ][ERROR ][618] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  27693. Traceback (most recent call last):
  27694. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  27695. self._call_hook_for(message, "workflow", message)
  27696. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27697. return True, func(*args, **kwargs)
  27698. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  27699. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27700. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27701. return True, func(*args, **kwargs)
  27702. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27703. return func(*args, **kwargs)
  27704. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  27705. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  27706. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  27707. res = query("AT+QGPSLOC={:d}".format(mode))
  27708. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  27709. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  27710. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  27711. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  27712. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  27713. raise salt.exceptions.CommandExecutionError(message["error"])
  27714. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27715. 2020-08-04 12:46:23,638 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  27716. Traceback (most recent call last):
  27717. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27718. self._serial.open()
  27719. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27720. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27721. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27722. 2020-08-04 12:46:24,653 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  27723. Traceback (most recent call last):
  27724. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27725. self._serial.open()
  27726. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27727. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27728. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27729. 2020-08-04 12:46:25,662 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  27730. Traceback (most recent call last):
  27731. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27732. self._serial.open()
  27733. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27734. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27735. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27736. 2020-08-04 12:46:26,183 [messaging :206 ][ERROR ][617] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  27737. Traceback (most recent call last):
  27738. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  27739. self._call_hook_for(message, "workflow", message)
  27740. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27741. return True, func(*args, **kwargs)
  27742. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  27743. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27744. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27745. return True, func(*args, **kwargs)
  27746. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27747. return func(*args, **kwargs)
  27748. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  27749. res = _exec("AT+CCLK?")
  27750. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  27751. conn.write_line(cmd)
  27752. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  27753. self.ensure_open()
  27754. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  27755. self.open()
  27756. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  27757. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  27758. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  27759. raise attempt.get()
  27760. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  27761. six.reraise(self.value[0], self.value[1], self.value[2])
  27762. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  27763. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  27764. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27765. self._serial.open()
  27766. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27767. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27768. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27769. 2020-08-04 12:46:28,095 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  27770. Traceback (most recent call last):
  27771. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27772. self._serial.open()
  27773. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27774. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27775. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27776. 2020-08-04 12:46:29,108 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  27777. Traceback (most recent call last):
  27778. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27779. self._serial.open()
  27780. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27781. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27782. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27783. 2020-08-04 12:46:30,203 [obd.obd :107 ][ERROR ][656] Failed to use explicit port '/dev/serial0'
  27784. Traceback (most recent call last):
  27785. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  27786. self.interface.open(baudrate, protocol=protocol)
  27787. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  27788. self.set_protocol(prot.pop("id", None), **prot)
  27789. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  27790. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  27791. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  27792. self._protocol = self._auto_protocol(**kwargs)
  27793. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  27794. res_0100 = self._verify_protocol("auto", test=not verify)
  27795. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  27796. for line in self.query("0100", parse=False, read_timeout=10):
  27797. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  27798. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  27799. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  27800. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  27801. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  27802. data = self._port.read(self._port.in_waiting or 1)
  27803. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  27804. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  27805. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  27806. sys.exit(salt.defaults.exitcodes.EX_OK)
  27807. SystemExit: 0
  27808. 2020-08-04 12:46:30,263 [obd.obd :120 ][WARNING ][656] Cannot load commands - no connection to bus
  27809. 2020-08-04 12:46:30,299 [obd.interfaces.elm327:730 ][ERROR ][656] Failed to relay command 'STSLCS' to interface
  27810. Traceback (most recent call last):
  27811. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  27812. lines = self.send(cmd, raw_response=raw_response)
  27813. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  27814. raise ELM327Error(self.ERRORS[line], code=line)
  27815. ELM327Error: Operation interrupted by a received RS232 character
  27816. 2020-08-04 12:46:30,303 [messaging :742 ][ERROR ][656] Exception while processing event: {'tag': 'obd/req/48cdcf3b-4c44-44b5-b7f3-789e42a89e00', 'data': {'_stamp': '2020-08-04T12:46:24.722220', 'handler': 'execute', '_event_tag': 'obd/req/48cdcf3b-4c44-44b5-b7f3-789e42a89e00', 'args': ['STSLCS']}}
  27817. Traceback (most recent call last):
  27818. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  27819. res = self.process(message)
  27820. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  27821. result = func(message, **settings)
  27822. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  27823. found, result = self._call_hook_for(message, "workflow", message)
  27824. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27825. return True, func(*args, **kwargs)
  27826. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  27827. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27828. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27829. return True, func(*args, **kwargs)
  27830. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27831. return func(*args, **kwargs)
  27832. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  27833. res = conn.execute(cmd)
  27834. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  27835. return func(self, *args, **kwargs)
  27836. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  27837. return self._obd.execute(cmd, **kwargs)
  27838. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  27839. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  27840. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  27841. lines = self.send(cmd, raw_response=raw_response)
  27842. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  27843. raise ELM327Error(self.ERRORS[line], code=line)
  27844. ELM327Error: Operation interrupted by a received RS232 character
  27845. 2020-08-04 12:46:30,335 [messaging :753 ][WARNING ][617] No reply to send back for event: {'tag': 'ec2x/req/f37b7fb4-b166-4783-ac12-49d043ea1bf0', 'data': {'_stamp': '2020-08-04T12:46:28.087921', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/f37b7fb4-b166-4783-ac12-49d043ea1bf0', 'kwargs': {'cooldown_delay': None}}}
  27846. 2020-08-04 12:46:31,042 [salt.utils.parsers:1050][WARNING ][417] Minion received a SIGTERM. Exiting.
  27847. 2020-08-04 12:46:31,582 [messaging :871 ][WARNING ][831] No reply message with tag 'obd/res/48cdcf3b-4c44-44b5-b7f3-789e42a89e00' received within timeout of 30 secs
  27848. 2020-08-04 12:46:31,585 [salt.state :292 ][ERROR ][831] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  27849. 2020-08-04 12:46:48,116 [gpio_spi_conn :42 ][WARNING ][617] Unable to clear buffer - got unexpected value: 255
  27850. 2020-08-04 12:46:48,146 [gpio_spi_conn :42 ][WARNING ][617] Unable to clear buffer - got unexpected value: 255
  27851. 2020-08-04 12:46:48,155 [gpio_spi_conn :42 ][WARNING ][617] Unable to clear buffer - got unexpected value: 255
  27852. 2020-08-04 12:46:48,827 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  27853. Traceback (most recent call last):
  27854. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27855. self._serial.open()
  27856. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27857. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27858. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27859. 2020-08-04 12:46:49,839 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  27860. Traceback (most recent call last):
  27861. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27862. self._serial.open()
  27863. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27864. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27865. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27866. 2020-08-04 12:46:50,178 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  27867. 2020-08-04 12:46:50,681 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  27868. 2020-08-04 12:46:50,843 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  27869. Traceback (most recent call last):
  27870. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27871. self._serial.open()
  27872. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27873. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27874. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27875. 2020-08-04 12:46:51,186 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  27876. 2020-08-04 12:46:51,188 [spm_conn :139 ][WARNING ][617] Unable to get status: Expected ack '12' but got '255'
  27877. 2020-08-04 12:46:51,514 [messaging :208 ][ERROR ][614] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  27878. Traceback (most recent call last):
  27879. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  27880. self._call_hook_for(message, "workflow", message)
  27881. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27882. return True, func(*args, **kwargs)
  27883. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  27884. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27885. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27886. return True, func(*args, **kwargs)
  27887. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27888. return func(*args, **kwargs)
  27889. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  27890. res = _exec("AT+CCLK?")
  27891. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  27892. conn.write_line(cmd)
  27893. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  27894. self.ensure_open()
  27895. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  27896. self.open()
  27897. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  27898. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  27899. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  27900. raise attempt.get()
  27901. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  27902. six.reraise(self.value[0], self.value[1], self.value[2])
  27903. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  27904. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  27905. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27906. self._serial.open()
  27907. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27908. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27909. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27910. 2020-08-04 12:46:51,692 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  27911. 2020-08-04 12:47:06,766 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][654] Timeout after 1.28205128205 second(s) waiting for interrupt
  27912. 2020-08-04 12:47:06,820 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  27913. Traceback (most recent call last):
  27914. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27915. self._serial.open()
  27916. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27917. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27918. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27919. 2020-08-04 12:47:07,043 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  27920. 2020-08-04 12:47:07,546 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  27921. 2020-08-04 12:47:07,549 [spm_conn :139 ][WARNING ][617] Unable to get status: Expected ack '12' but got '255'
  27922. 2020-08-04 12:47:07,825 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  27923. Traceback (most recent call last):
  27924. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27925. self._serial.open()
  27926. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27927. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27928. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27929. 2020-08-04 12:47:08,053 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  27930. 2020-08-04 12:47:08,556 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  27931. 2020-08-04 12:47:08,829 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  27932. Traceback (most recent call last):
  27933. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27934. self._serial.open()
  27935. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27936. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27937. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27938. 2020-08-04 12:47:08,832 [messaging :206 ][ERROR ][614] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  27939. Traceback (most recent call last):
  27940. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  27941. self._call_hook_for(message, "workflow", message)
  27942. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27943. return True, func(*args, **kwargs)
  27944. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  27945. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  27946. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  27947. return True, func(*args, **kwargs)
  27948. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  27949. return func(*args, **kwargs)
  27950. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  27951. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  27952. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  27953. conn.write_line(cmd)
  27954. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  27955. self.ensure_open()
  27956. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  27957. self.open()
  27958. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  27959. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  27960. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  27961. raise attempt.get()
  27962. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  27963. six.reraise(self.value[0], self.value[1], self.value[2])
  27964. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  27965. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  27966. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27967. self._serial.open()
  27968. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27969. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27970. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27971. 2020-08-04 12:47:09,061 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  27972. 2020-08-04 12:47:09,063 [spm_conn :139 ][WARNING ][617] Unable to get status: Expected ack '12' but got '255'
  27973. 2020-08-04 12:47:09,069 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  27974. 2020-08-04 12:47:09,572 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  27975. 2020-08-04 12:47:10,077 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  27976. 2020-08-04 12:47:10,082 [spm_conn :82 ][WARNING ][617] Unable to send noop: Expected ack '12' but got '255'
  27977. 2020-08-04 12:47:10,463 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  27978. Traceback (most recent call last):
  27979. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27980. self._serial.open()
  27981. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27982. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27983. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27984. 2020-08-04 12:47:10,586 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  27985. 2020-08-04 12:47:11,092 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  27986. 2020-08-04 12:47:11,467 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  27987. Traceback (most recent call last):
  27988. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27989. self._serial.open()
  27990. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  27991. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  27992. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  27993. 2020-08-04 12:47:11,597 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  27994. 2020-08-04 12:47:11,600 [spm_conn :82 ][WARNING ][617] Unable to send noop: Expected ack '12' but got '255'
  27995. 2020-08-04 12:47:12,108 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  27996. 2020-08-04 12:47:12,471 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  27997. Traceback (most recent call last):
  27998. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  27999. self._serial.open()
  28000. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28001. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28002. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28003. 2020-08-04 12:47:12,473 [messaging :742 ][ERROR ][614] Exception while processing event: {'tag': 'ec2x/req/6bb90889-aecd-43b7-926b-b34b41933901', 'data': {'_stamp': '2020-08-04T12:46:48.163474', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/6bb90889-aecd-43b7-926b-b34b41933901', 'kwargs': {'cooldown_delay': None}}}
  28004. Traceback (most recent call last):
  28005. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  28006. res = self.process(message)
  28007. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  28008. result = func(message, **settings)
  28009. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  28010. found, result = self._call_hook_for(message, "workflow", message)
  28011. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28012. return True, func(*args, **kwargs)
  28013. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  28014. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28015. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28016. return True, func(*args, **kwargs)
  28017. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28018. return func(*args, **kwargs)
  28019. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  28020. return _exec(cmd, **kwargs)
  28021. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  28022. conn.write_line(cmd)
  28023. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  28024. self.ensure_open()
  28025. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  28026. self.open()
  28027. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  28028. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  28029. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  28030. raise attempt.get()
  28031. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  28032. six.reraise(self.value[0], self.value[1], self.value[2])
  28033. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  28034. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  28035. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28036. self._serial.open()
  28037. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28038. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28039. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28040. 2020-08-04 12:47:12,614 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28041. 2020-08-04 12:47:13,117 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28042. 2020-08-04 12:47:13,122 [spm_conn :82 ][WARNING ][617] Unable to send noop: Expected ack '12' but got '255'
  28043. 2020-08-04 12:47:13,128 [messaging :208 ][ERROR ][617] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  28044. Traceback (most recent call last):
  28045. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  28046. self._call_hook_for(message, "workflow", message)
  28047. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28048. return True, func(*args, **kwargs)
  28049. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  28050. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28051. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28052. return True, func(*args, **kwargs)
  28053. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28054. return func(*args, **kwargs)
  28055. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  28056. conn.heartbeat()
  28057. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  28058. self.noop()
  28059. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  28060. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  28061. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  28062. raise attempt.get()
  28063. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  28064. six.reraise(self.value[0], self.value[1], self.value[2])
  28065. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  28066. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  28067. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  28068. self._begin_message()
  28069. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  28070. self.recv(ack=ACK_MESSAGE_BEGIN)
  28071. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  28072. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  28073. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  28074. raise attempt.get()
  28075. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  28076. six.reraise(self.value[0], self.value[1], self.value[2])
  28077. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  28078. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  28079. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  28080. raise Exception(msg)
  28081. Exception: Expected ack '12' but got '255'
  28082. 2020-08-04 12:47:14,609 [messaging :208 ][ERROR ][615] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  28083. Traceback (most recent call last):
  28084. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  28085. self._call_hook_for(message, "workflow", message)
  28086. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28087. return True, func(*args, **kwargs)
  28088. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  28089. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28090. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28091. return True, func(*args, **kwargs)
  28092. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28093. return func(*args, **kwargs)
  28094. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  28095. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  28096. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  28097. res = query("AT+QGPSLOC={:d}".format(mode))
  28098. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  28099. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  28100. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  28101. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  28102. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  28103. raise salt.exceptions.CommandExecutionError(message["error"])
  28104. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28105. 2020-08-04 12:47:19,669 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28106. Traceback (most recent call last):
  28107. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28108. self._serial.open()
  28109. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28110. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28111. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28112. 2020-08-04 12:47:20,673 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28113. Traceback (most recent call last):
  28114. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28115. self._serial.open()
  28116. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28117. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28118. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28119. 2020-08-04 12:47:21,678 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28120. Traceback (most recent call last):
  28121. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28122. self._serial.open()
  28123. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28124. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28125. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28126. 2020-08-04 12:47:21,681 [messaging :742 ][ERROR ][614] Exception while processing event: {'tag': 'ec2x/req/19d0caf4-3f5c-44e5-82be-dff03e4761dd', 'data': {'_stamp': '2020-08-04T12:47:19.662404', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/19d0caf4-3f5c-44e5-82be-dff03e4761dd', 'kwargs': {'cooldown_delay': None}}}
  28127. Traceback (most recent call last):
  28128. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  28129. res = self.process(message)
  28130. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  28131. result = func(message, **settings)
  28132. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  28133. found, result = self._call_hook_for(message, "workflow", message)
  28134. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28135. return True, func(*args, **kwargs)
  28136. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  28137. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28138. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28139. return True, func(*args, **kwargs)
  28140. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28141. return func(*args, **kwargs)
  28142. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  28143. return _exec(cmd, **kwargs)
  28144. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  28145. conn.write_line(cmd)
  28146. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  28147. self.ensure_open()
  28148. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  28149. self.open()
  28150. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  28151. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  28152. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  28153. raise attempt.get()
  28154. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  28155. six.reraise(self.value[0], self.value[1], self.value[2])
  28156. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  28157. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  28158. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28159. self._serial.open()
  28160. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28161. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28162. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28163. 2020-08-04 12:47:21,725 [messaging :206 ][ERROR ][615] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  28164. Traceback (most recent call last):
  28165. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  28166. self._call_hook_for(message, "workflow", message)
  28167. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28168. return True, func(*args, **kwargs)
  28169. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  28170. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28171. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28172. return True, func(*args, **kwargs)
  28173. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28174. return func(*args, **kwargs)
  28175. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  28176. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  28177. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  28178. res = query("AT+QGPSLOC={:d}".format(mode))
  28179. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  28180. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  28181. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  28182. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  28183. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  28184. raise salt.exceptions.CommandExecutionError(message["error"])
  28185. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28186. 2020-08-04 12:47:25,032 [obd.obd :107 ][ERROR ][653] Failed to use explicit port '/dev/serial0'
  28187. Traceback (most recent call last):
  28188. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  28189. self.interface.open(baudrate, protocol=protocol)
  28190. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  28191. self.set_protocol(prot.pop("id", None), **prot)
  28192. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  28193. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  28194. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  28195. self._protocol = self._auto_protocol(**kwargs)
  28196. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  28197. res_0100 = self._verify_protocol("auto", test=not verify)
  28198. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  28199. for line in self.query("0100", parse=False, read_timeout=10):
  28200. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  28201. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  28202. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  28203. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  28204. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  28205. data = self._port.read(self._port.in_waiting or 1)
  28206. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  28207. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  28208. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  28209. sys.exit(salt.defaults.exitcodes.EX_OK)
  28210. SystemExit: 0
  28211. 2020-08-04 12:47:25,083 [obd.obd :120 ][WARNING ][653] Cannot load commands - no connection to bus
  28212. 2020-08-04 12:47:25,112 [obd.interfaces.elm327:730 ][ERROR ][653] Failed to relay command 'STSLCS' to interface
  28213. Traceback (most recent call last):
  28214. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  28215. lines = self.send(cmd, raw_response=raw_response)
  28216. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  28217. raise ELM327Error(self.ERRORS[line], code=line)
  28218. ELM327Error: Operation interrupted by a received RS232 character
  28219. 2020-08-04 12:47:25,127 [messaging :742 ][ERROR ][653] Exception while processing event: {'tag': 'obd/req/c4e0ca5c-3558-4214-8b59-99c656b83241', 'data': {'_stamp': '2020-08-04T12:47:19.532467', 'handler': 'execute', '_event_tag': 'obd/req/c4e0ca5c-3558-4214-8b59-99c656b83241', 'args': ['STSLCS']}}
  28220. Traceback (most recent call last):
  28221. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  28222. res = self.process(message)
  28223. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  28224. result = func(message, **settings)
  28225. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  28226. found, result = self._call_hook_for(message, "workflow", message)
  28227. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28228. return True, func(*args, **kwargs)
  28229. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  28230. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28231. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28232. return True, func(*args, **kwargs)
  28233. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28234. return func(*args, **kwargs)
  28235. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  28236. res = conn.execute(cmd)
  28237. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  28238. return func(self, *args, **kwargs)
  28239. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  28240. return self._obd.execute(cmd, **kwargs)
  28241. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  28242. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  28243. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  28244. lines = self.send(cmd, raw_response=raw_response)
  28245. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  28246. raise ELM327Error(self.ERRORS[line], code=line)
  28247. ELM327Error: Operation interrupted by a received RS232 character
  28248. 2020-08-04 12:47:25,882 [salt.utils.parsers:1050][WARNING ][414] Minion received a SIGTERM. Exiting.
  28249. 2020-08-04 12:47:26,422 [messaging :871 ][WARNING ][814] No reply message with tag 'obd/res/c4e0ca5c-3558-4214-8b59-99c656b83241' received within timeout of 30 secs
  28250. 2020-08-04 12:47:26,426 [salt.state :292 ][ERROR ][814] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  28251. 2020-08-04 12:47:43,124 [gpio_spi_conn :42 ][WARNING ][617] Unable to clear buffer - got unexpected value: 255
  28252. 2020-08-04 12:47:43,145 [gpio_spi_conn :42 ][WARNING ][617] Unable to clear buffer - got unexpected value: 255
  28253. 2020-08-04 12:47:43,150 [gpio_spi_conn :42 ][WARNING ][617] Unable to clear buffer - got unexpected value: 255
  28254. 2020-08-04 12:47:43,782 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28255. Traceback (most recent call last):
  28256. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28257. self._serial.open()
  28258. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28259. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28260. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28261. 2020-08-04 12:47:44,795 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28262. Traceback (most recent call last):
  28263. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28264. self._serial.open()
  28265. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28266. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28267. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28268. 2020-08-04 12:47:45,179 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28269. 2020-08-04 12:47:45,682 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28270. 2020-08-04 12:47:45,799 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28271. Traceback (most recent call last):
  28272. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28273. self._serial.open()
  28274. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28275. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28276. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28277. 2020-08-04 12:47:46,185 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28278. 2020-08-04 12:47:46,188 [spm_conn :139 ][WARNING ][617] Unable to get status: Expected ack '12' but got '255'
  28279. 2020-08-04 12:47:46,425 [messaging :208 ][ERROR ][614] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  28280. Traceback (most recent call last):
  28281. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  28282. self._call_hook_for(message, "workflow", message)
  28283. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28284. return True, func(*args, **kwargs)
  28285. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  28286. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28287. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28288. return True, func(*args, **kwargs)
  28289. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28290. return func(*args, **kwargs)
  28291. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  28292. res = _exec("AT+CCLK?")
  28293. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  28294. conn.write_line(cmd)
  28295. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  28296. self.ensure_open()
  28297. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  28298. self.open()
  28299. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  28300. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  28301. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  28302. raise attempt.get()
  28303. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  28304. six.reraise(self.value[0], self.value[1], self.value[2])
  28305. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  28306. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  28307. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28308. self._serial.open()
  28309. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28310. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28311. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28312. 2020-08-04 12:47:46,691 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28313. 2020-08-04 12:47:47,195 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28314. 2020-08-04 12:47:47,699 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28315. 2020-08-04 12:47:47,702 [spm_conn :139 ][WARNING ][617] Unable to get status: Expected ack '12' but got '255'
  28316. 2020-08-04 12:47:48,206 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28317. 2020-08-04 12:47:48,710 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28318. 2020-08-04 12:47:49,214 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28319. 2020-08-04 12:47:49,216 [spm_conn :139 ][WARNING ][617] Unable to get status: Expected ack '12' but got '255'
  28320. 2020-08-04 12:47:49,221 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28321. 2020-08-04 12:47:49,724 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28322. 2020-08-04 12:47:50,227 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28323. 2020-08-04 12:47:50,230 [spm_conn :82 ][WARNING ][617] Unable to send noop: Expected ack '12' but got '255'
  28324. 2020-08-04 12:47:50,623 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28325. Traceback (most recent call last):
  28326. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28327. self._serial.open()
  28328. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28329. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28330. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28331. 2020-08-04 12:47:50,739 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28332. 2020-08-04 12:47:51,243 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28333. 2020-08-04 12:47:51,644 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28334. Traceback (most recent call last):
  28335. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28336. self._serial.open()
  28337. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28338. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28339. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28340. 2020-08-04 12:47:51,745 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28341. 2020-08-04 12:47:51,748 [spm_conn :82 ][WARNING ][617] Unable to send noop: Expected ack '12' but got '255'
  28342. 2020-08-04 12:47:52,252 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28343. 2020-08-04 12:47:52,658 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28344. Traceback (most recent call last):
  28345. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28346. self._serial.open()
  28347. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28348. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28349. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28350. 2020-08-04 12:47:52,671 [messaging :742 ][ERROR ][614] Exception while processing event: {'tag': 'ec2x/req/272685e2-6889-47f6-8181-eb5dfba68151', 'data': {'_stamp': '2020-08-04T12:47:43.213646', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/272685e2-6889-47f6-8181-eb5dfba68151', 'kwargs': {'cooldown_delay': None}}}
  28351. Traceback (most recent call last):
  28352. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  28353. res = self.process(message)
  28354. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  28355. result = func(message, **settings)
  28356. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  28357. found, result = self._call_hook_for(message, "workflow", message)
  28358. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28359. return True, func(*args, **kwargs)
  28360. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  28361. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28362. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28363. return True, func(*args, **kwargs)
  28364. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28365. return func(*args, **kwargs)
  28366. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  28367. return _exec(cmd, **kwargs)
  28368. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  28369. conn.write_line(cmd)
  28370. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  28371. self.ensure_open()
  28372. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  28373. self.open()
  28374. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  28375. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  28376. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  28377. raise attempt.get()
  28378. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  28379. six.reraise(self.value[0], self.value[1], self.value[2])
  28380. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  28381. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  28382. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28383. self._serial.open()
  28384. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28385. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28386. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28387. 2020-08-04 12:47:52,755 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28388. 2020-08-04 12:47:53,258 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  28389. 2020-08-04 12:47:53,261 [spm_conn :82 ][WARNING ][617] Unable to send noop: Expected ack '12' but got '255'
  28390. 2020-08-04 12:47:53,267 [messaging :208 ][ERROR ][617] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  28391. Traceback (most recent call last):
  28392. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  28393. self._call_hook_for(message, "workflow", message)
  28394. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28395. return True, func(*args, **kwargs)
  28396. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  28397. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28398. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28399. return True, func(*args, **kwargs)
  28400. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28401. return func(*args, **kwargs)
  28402. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  28403. conn.heartbeat()
  28404. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  28405. self.noop()
  28406. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  28407. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  28408. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  28409. raise attempt.get()
  28410. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  28411. six.reraise(self.value[0], self.value[1], self.value[2])
  28412. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  28413. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  28414. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  28415. self._begin_message()
  28416. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  28417. self.recv(ack=ACK_MESSAGE_BEGIN)
  28418. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  28419. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  28420. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  28421. raise attempt.get()
  28422. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  28423. six.reraise(self.value[0], self.value[1], self.value[2])
  28424. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  28425. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  28426. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  28427. raise Exception(msg)
  28428. Exception: Expected ack '12' but got '255'
  28429. 2020-08-04 12:47:53,310 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28430. Traceback (most recent call last):
  28431. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28432. self._serial.open()
  28433. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28434. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28435. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28436. 2020-08-04 12:47:54,315 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28437. Traceback (most recent call last):
  28438. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28439. self._serial.open()
  28440. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28441. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28442. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28443. 2020-08-04 12:47:54,878 [messaging :208 ][ERROR ][615] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  28444. Traceback (most recent call last):
  28445. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  28446. self._call_hook_for(message, "workflow", message)
  28447. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28448. return True, func(*args, **kwargs)
  28449. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  28450. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28451. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28452. return True, func(*args, **kwargs)
  28453. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28454. return func(*args, **kwargs)
  28455. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  28456. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  28457. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  28458. res = query("AT+QGPSLOC={:d}".format(mode))
  28459. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  28460. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  28461. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  28462. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  28463. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  28464. raise salt.exceptions.CommandExecutionError(message["error"])
  28465. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28466. 2020-08-04 12:47:55,319 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28467. Traceback (most recent call last):
  28468. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28469. self._serial.open()
  28470. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28471. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28472. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28473. 2020-08-04 12:47:55,859 [messaging :206 ][ERROR ][614] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  28474. Traceback (most recent call last):
  28475. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  28476. self._call_hook_for(message, "workflow", message)
  28477. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28478. return True, func(*args, **kwargs)
  28479. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  28480. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28481. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28482. return True, func(*args, **kwargs)
  28483. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28484. return func(*args, **kwargs)
  28485. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  28486. res = _exec("AT+CCLK?")
  28487. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  28488. conn.write_line(cmd)
  28489. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  28490. self.ensure_open()
  28491. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  28492. self.open()
  28493. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  28494. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  28495. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  28496. raise attempt.get()
  28497. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  28498. six.reraise(self.value[0], self.value[1], self.value[2])
  28499. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  28500. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  28501. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28502. self._serial.open()
  28503. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28504. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28505. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28506. 2020-08-04 12:48:10,886 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][654] Timeout after 1.28205128205 second(s) waiting for interrupt
  28507. 2020-08-04 12:48:10,905 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28508. Traceback (most recent call last):
  28509. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28510. self._serial.open()
  28511. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28512. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28513. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28514. 2020-08-04 12:48:11,911 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28515. Traceback (most recent call last):
  28516. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28517. self._serial.open()
  28518. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28519. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28520. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28521. 2020-08-04 12:48:12,914 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28522. Traceback (most recent call last):
  28523. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28524. self._serial.open()
  28525. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28526. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28527. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28528. 2020-08-04 12:48:12,929 [messaging :742 ][ERROR ][614] Exception while processing event: {'tag': 'ec2x/req/e999b062-e579-4015-8efa-65cd3762e817', 'data': {'_stamp': '2020-08-04T12:48:10.879696', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/e999b062-e579-4015-8efa-65cd3762e817', 'kwargs': {'cooldown_delay': None}}}
  28529. Traceback (most recent call last):
  28530. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  28531. res = self.process(message)
  28532. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  28533. result = func(message, **settings)
  28534. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  28535. found, result = self._call_hook_for(message, "workflow", message)
  28536. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28537. return True, func(*args, **kwargs)
  28538. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  28539. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28540. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28541. return True, func(*args, **kwargs)
  28542. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28543. return func(*args, **kwargs)
  28544. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  28545. return _exec(cmd, **kwargs)
  28546. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  28547. conn.write_line(cmd)
  28548. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  28549. self.ensure_open()
  28550. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  28551. self.open()
  28552. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  28553. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  28554. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  28555. raise attempt.get()
  28556. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  28557. six.reraise(self.value[0], self.value[1], self.value[2])
  28558. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  28559. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  28560. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28561. self._serial.open()
  28562. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28563. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28564. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28565. 2020-08-04 12:48:12,983 [messaging :206 ][ERROR ][615] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  28566. Traceback (most recent call last):
  28567. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  28568. self._call_hook_for(message, "workflow", message)
  28569. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28570. return True, func(*args, **kwargs)
  28571. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  28572. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28573. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28574. return True, func(*args, **kwargs)
  28575. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28576. return func(*args, **kwargs)
  28577. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  28578. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  28579. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  28580. res = query("AT+QGPSLOC={:d}".format(mode))
  28581. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  28582. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  28583. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  28584. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  28585. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  28586. raise salt.exceptions.CommandExecutionError(message["error"])
  28587. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28588. 2020-08-04 12:48:13,592 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28589. Traceback (most recent call last):
  28590. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28591. self._serial.open()
  28592. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28593. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28594. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28595. 2020-08-04 12:48:14,617 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28596. Traceback (most recent call last):
  28597. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28598. self._serial.open()
  28599. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28600. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28601. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28602. 2020-08-04 12:48:15,622 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28603. Traceback (most recent call last):
  28604. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28605. self._serial.open()
  28606. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28607. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28608. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28609. 2020-08-04 12:48:16,147 [messaging :206 ][ERROR ][614] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  28610. Traceback (most recent call last):
  28611. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  28612. self._call_hook_for(message, "workflow", message)
  28613. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28614. return True, func(*args, **kwargs)
  28615. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  28616. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28617. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28618. return True, func(*args, **kwargs)
  28619. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28620. return func(*args, **kwargs)
  28621. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  28622. res = _exec("AT+CCLK?")
  28623. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  28624. conn.write_line(cmd)
  28625. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  28626. self.ensure_open()
  28627. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  28628. self.open()
  28629. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  28630. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  28631. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  28632. raise attempt.get()
  28633. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  28634. six.reraise(self.value[0], self.value[1], self.value[2])
  28635. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  28636. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  28637. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28638. self._serial.open()
  28639. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28640. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28641. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28642. 2020-08-04 12:48:18,014 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28643. Traceback (most recent call last):
  28644. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28645. self._serial.open()
  28646. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28647. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28648. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28649. 2020-08-04 12:48:19,018 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  28650. Traceback (most recent call last):
  28651. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28652. self._serial.open()
  28653. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28654. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28655. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28656. 2020-08-04 12:48:20,113 [obd.obd :107 ][ERROR ][653] Failed to use explicit port '/dev/serial0'
  28657. Traceback (most recent call last):
  28658. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  28659. self.interface.open(baudrate, protocol=protocol)
  28660. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  28661. self.set_protocol(prot.pop("id", None), **prot)
  28662. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  28663. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  28664. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  28665. self._protocol = self._auto_protocol(**kwargs)
  28666. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  28667. res_0100 = self._verify_protocol("auto", test=not verify)
  28668. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  28669. for line in self.query("0100", parse=False, read_timeout=10):
  28670. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  28671. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  28672. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  28673. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  28674. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  28675. data = self._port.read(self._port.in_waiting or 1)
  28676. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  28677. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  28678. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  28679. sys.exit(salt.defaults.exitcodes.EX_OK)
  28680. SystemExit: 0
  28681. 2020-08-04 12:48:20,186 [obd.obd :120 ][WARNING ][653] Cannot load commands - no connection to bus
  28682. 2020-08-04 12:48:20,194 [messaging :753 ][WARNING ][614] No reply to send back for event: {'tag': 'ec2x/req/a195d1b1-0369-43ef-a15c-72767d3093d1', 'data': {'_stamp': '2020-08-04T12:48:18.006805', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/a195d1b1-0369-43ef-a15c-72767d3093d1', 'kwargs': {'cooldown_delay': None}}}
  28683. 2020-08-04 12:48:20,215 [obd.interfaces.elm327:730 ][ERROR ][653] Failed to relay command 'STSLCS' to interface
  28684. Traceback (most recent call last):
  28685. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  28686. lines = self.send(cmd, raw_response=raw_response)
  28687. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  28688. raise ELM327Error(self.ERRORS[line], code=line)
  28689. ELM327Error: Operation interrupted by a received RS232 character
  28690. 2020-08-04 12:48:20,219 [messaging :742 ][ERROR ][653] Exception while processing event: {'tag': 'obd/req/cdce455f-8812-413b-8cee-b5485e09e93e', 'data': {'_stamp': '2020-08-04T12:48:14.590564', 'handler': 'execute', '_event_tag': 'obd/req/cdce455f-8812-413b-8cee-b5485e09e93e', 'args': ['STSLCS']}}
  28691. Traceback (most recent call last):
  28692. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  28693. res = self.process(message)
  28694. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  28695. result = func(message, **settings)
  28696. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  28697. found, result = self._call_hook_for(message, "workflow", message)
  28698. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28699. return True, func(*args, **kwargs)
  28700. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  28701. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28702. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28703. return True, func(*args, **kwargs)
  28704. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28705. return func(*args, **kwargs)
  28706. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  28707. res = conn.execute(cmd)
  28708. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  28709. return func(self, *args, **kwargs)
  28710. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  28711. return self._obd.execute(cmd, **kwargs)
  28712. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  28713. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  28714. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  28715. lines = self.send(cmd, raw_response=raw_response)
  28716. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  28717. raise ELM327Error(self.ERRORS[line], code=line)
  28718. ELM327Error: Operation interrupted by a received RS232 character
  28719. 2020-08-04 12:48:21,005 [salt.utils.parsers:1050][WARNING ][414] Minion received a SIGTERM. Exiting.
  28720. 2020-08-04 12:48:21,545 [messaging :871 ][WARNING ][828] No reply message with tag 'obd/res/cdce455f-8812-413b-8cee-b5485e09e93e' received within timeout of 30 secs
  28721. 2020-08-04 12:48:21,550 [salt.state :292 ][ERROR ][828] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  28722. 2020-08-04 12:48:38,262 [gpio_spi_conn :42 ][WARNING ][625] Unable to clear buffer - got unexpected value: 255
  28723. 2020-08-04 12:48:38,280 [gpio_spi_conn :42 ][WARNING ][625] Unable to clear buffer - got unexpected value: 255
  28724. 2020-08-04 12:48:38,288 [gpio_spi_conn :42 ][WARNING ][625] Unable to clear buffer - got unexpected value: 255
  28725. 2020-08-04 12:48:38,916 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  28726. Traceback (most recent call last):
  28727. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28728. self._serial.open()
  28729. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28730. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28731. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28732. 2020-08-04 12:48:39,932 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  28733. Traceback (most recent call last):
  28734. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28735. self._serial.open()
  28736. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28737. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28738. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28739. 2020-08-04 12:48:40,323 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  28740. 2020-08-04 12:48:40,826 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  28741. 2020-08-04 12:48:40,937 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  28742. Traceback (most recent call last):
  28743. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28744. self._serial.open()
  28745. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28746. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28747. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28748. 2020-08-04 12:48:41,329 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  28749. 2020-08-04 12:48:41,331 [spm_conn :139 ][WARNING ][625] Unable to get status: Expected ack '12' but got '255'
  28750. 2020-08-04 12:48:41,572 [messaging :208 ][ERROR ][622] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  28751. Traceback (most recent call last):
  28752. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  28753. self._call_hook_for(message, "workflow", message)
  28754. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28755. return True, func(*args, **kwargs)
  28756. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  28757. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28758. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28759. return True, func(*args, **kwargs)
  28760. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28761. return func(*args, **kwargs)
  28762. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  28763. res = _exec("AT+CCLK?")
  28764. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  28765. conn.write_line(cmd)
  28766. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  28767. self.ensure_open()
  28768. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  28769. self.open()
  28770. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  28771. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  28772. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  28773. raise attempt.get()
  28774. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  28775. six.reraise(self.value[0], self.value[1], self.value[2])
  28776. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  28777. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  28778. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28779. self._serial.open()
  28780. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28781. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28782. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28783. 2020-08-04 12:48:41,835 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  28784. 2020-08-04 12:48:56,808 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][668] Timeout after 1.28205128205 second(s) waiting for interrupt
  28785. 2020-08-04 12:48:56,884 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  28786. Traceback (most recent call last):
  28787. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28788. self._serial.open()
  28789. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28790. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28791. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28792. 2020-08-04 12:48:57,178 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  28793. 2020-08-04 12:48:57,682 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  28794. 2020-08-04 12:48:57,684 [spm_conn :139 ][WARNING ][625] Unable to get status: Expected ack '12' but got '255'
  28795. 2020-08-04 12:48:57,889 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  28796. Traceback (most recent call last):
  28797. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28798. self._serial.open()
  28799. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28800. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28801. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28802. 2020-08-04 12:48:58,188 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  28803. 2020-08-04 12:48:58,691 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  28804. 2020-08-04 12:48:58,894 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  28805. Traceback (most recent call last):
  28806. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28807. self._serial.open()
  28808. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28809. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28810. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28811. 2020-08-04 12:48:58,897 [messaging :206 ][ERROR ][622] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  28812. Traceback (most recent call last):
  28813. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  28814. self._call_hook_for(message, "workflow", message)
  28815. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28816. return True, func(*args, **kwargs)
  28817. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  28818. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28819. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28820. return True, func(*args, **kwargs)
  28821. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28822. return func(*args, **kwargs)
  28823. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  28824. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  28825. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  28826. conn.write_line(cmd)
  28827. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  28828. self.ensure_open()
  28829. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  28830. self.open()
  28831. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  28832. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  28833. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  28834. raise attempt.get()
  28835. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  28836. six.reraise(self.value[0], self.value[1], self.value[2])
  28837. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  28838. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  28839. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28840. self._serial.open()
  28841. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28842. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28843. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28844. 2020-08-04 12:48:59,195 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  28845. 2020-08-04 12:48:59,197 [spm_conn :139 ][WARNING ][625] Unable to get status: Expected ack '12' but got '255'
  28846. 2020-08-04 12:48:59,202 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  28847. 2020-08-04 12:48:59,705 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  28848. 2020-08-04 12:49:00,208 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  28849. 2020-08-04 12:49:00,210 [spm_conn :82 ][WARNING ][625] Unable to send noop: Expected ack '12' but got '255'
  28850. 2020-08-04 12:49:00,699 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  28851. Traceback (most recent call last):
  28852. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28853. self._serial.open()
  28854. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28855. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28856. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28857. 2020-08-04 12:49:00,720 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  28858. 2020-08-04 12:49:01,223 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  28859. 2020-08-04 12:49:01,726 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  28860. 2020-08-04 12:49:01,730 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  28861. Traceback (most recent call last):
  28862. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28863. self._serial.open()
  28864. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28865. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28866. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28867. 2020-08-04 12:49:01,729 [spm_conn :82 ][WARNING ][625] Unable to send noop: Expected ack '12' but got '255'
  28868. 2020-08-04 12:49:02,236 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  28869. 2020-08-04 12:49:02,735 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  28870. Traceback (most recent call last):
  28871. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28872. self._serial.open()
  28873. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28874. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28875. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28876. 2020-08-04 12:49:02,739 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  28877. 2020-08-04 12:49:02,747 [messaging :742 ][ERROR ][622] Exception while processing event: {'tag': 'ec2x/req/2fc96f5c-0ebe-4de2-96d9-bab0ae2c1c75', 'data': {'_stamp': '2020-08-04T12:48:38.314226', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/2fc96f5c-0ebe-4de2-96d9-bab0ae2c1c75', 'kwargs': {'cooldown_delay': None}}}
  28878. Traceback (most recent call last):
  28879. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  28880. res = self.process(message)
  28881. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  28882. result = func(message, **settings)
  28883. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  28884. found, result = self._call_hook_for(message, "workflow", message)
  28885. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28886. return True, func(*args, **kwargs)
  28887. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  28888. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28889. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28890. return True, func(*args, **kwargs)
  28891. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28892. return func(*args, **kwargs)
  28893. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  28894. return _exec(cmd, **kwargs)
  28895. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  28896. conn.write_line(cmd)
  28897. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  28898. self.ensure_open()
  28899. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  28900. self.open()
  28901. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  28902. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  28903. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  28904. raise attempt.get()
  28905. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  28906. six.reraise(self.value[0], self.value[1], self.value[2])
  28907. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  28908. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  28909. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28910. self._serial.open()
  28911. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28912. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28913. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28914. 2020-08-04 12:49:03,250 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  28915. 2020-08-04 12:49:03,252 [spm_conn :82 ][WARNING ][625] Unable to send noop: Expected ack '12' but got '255'
  28916. 2020-08-04 12:49:03,255 [messaging :208 ][ERROR ][625] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  28917. Traceback (most recent call last):
  28918. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  28919. self._call_hook_for(message, "workflow", message)
  28920. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28921. return True, func(*args, **kwargs)
  28922. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  28923. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28924. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28925. return True, func(*args, **kwargs)
  28926. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28927. return func(*args, **kwargs)
  28928. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  28929. conn.heartbeat()
  28930. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  28931. self.noop()
  28932. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  28933. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  28934. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  28935. raise attempt.get()
  28936. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  28937. six.reraise(self.value[0], self.value[1], self.value[2])
  28938. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  28939. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  28940. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  28941. self._begin_message()
  28942. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  28943. self.recv(ack=ACK_MESSAGE_BEGIN)
  28944. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  28945. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  28946. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  28947. raise attempt.get()
  28948. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  28949. six.reraise(self.value[0], self.value[1], self.value[2])
  28950. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  28951. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  28952. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  28953. raise Exception(msg)
  28954. Exception: Expected ack '12' but got '255'
  28955. 2020-08-04 12:49:04,837 [messaging :208 ][ERROR ][623] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  28956. Traceback (most recent call last):
  28957. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  28958. self._call_hook_for(message, "workflow", message)
  28959. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28960. return True, func(*args, **kwargs)
  28961. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  28962. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  28963. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  28964. return True, func(*args, **kwargs)
  28965. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  28966. return func(*args, **kwargs)
  28967. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  28968. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  28969. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  28970. res = query("AT+QGPSLOC={:d}".format(mode))
  28971. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  28972. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  28973. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  28974. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  28975. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  28976. raise salt.exceptions.CommandExecutionError(message["error"])
  28977. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28978. 2020-08-04 12:49:09,892 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  28979. Traceback (most recent call last):
  28980. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28981. self._serial.open()
  28982. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28983. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28984. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28985. 2020-08-04 12:49:10,900 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  28986. Traceback (most recent call last):
  28987. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28988. self._serial.open()
  28989. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28990. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28991. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28992. 2020-08-04 12:49:11,904 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  28993. Traceback (most recent call last):
  28994. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  28995. self._serial.open()
  28996. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  28997. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  28998. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  28999. 2020-08-04 12:49:11,907 [messaging :742 ][ERROR ][622] Exception while processing event: {'tag': 'ec2x/req/46d9bb57-5117-472e-85ff-a3c754d36879', 'data': {'_stamp': '2020-08-04T12:49:09.884843', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/46d9bb57-5117-472e-85ff-a3c754d36879', 'kwargs': {'cooldown_delay': None}}}
  29000. Traceback (most recent call last):
  29001. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  29002. res = self.process(message)
  29003. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  29004. result = func(message, **settings)
  29005. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  29006. found, result = self._call_hook_for(message, "workflow", message)
  29007. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29008. return True, func(*args, **kwargs)
  29009. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  29010. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29011. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29012. return True, func(*args, **kwargs)
  29013. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29014. return func(*args, **kwargs)
  29015. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  29016. return _exec(cmd, **kwargs)
  29017. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  29018. conn.write_line(cmd)
  29019. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  29020. self.ensure_open()
  29021. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  29022. self.open()
  29023. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  29024. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  29025. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  29026. raise attempt.get()
  29027. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  29028. six.reraise(self.value[0], self.value[1], self.value[2])
  29029. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  29030. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  29031. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29032. self._serial.open()
  29033. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29034. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29035. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29036. 2020-08-04 12:49:11,937 [messaging :206 ][ERROR ][623] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  29037. Traceback (most recent call last):
  29038. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  29039. self._call_hook_for(message, "workflow", message)
  29040. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29041. return True, func(*args, **kwargs)
  29042. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  29043. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29044. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29045. return True, func(*args, **kwargs)
  29046. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29047. return func(*args, **kwargs)
  29048. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  29049. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  29050. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  29051. res = query("AT+QGPSLOC={:d}".format(mode))
  29052. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  29053. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  29054. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  29055. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  29056. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  29057. raise salt.exceptions.CommandExecutionError(message["error"])
  29058. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29059. 2020-08-04 12:49:15,362 [obd.obd :107 ][ERROR ][661] Failed to use explicit port '/dev/serial0'
  29060. Traceback (most recent call last):
  29061. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  29062. self.interface.open(baudrate, protocol=protocol)
  29063. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  29064. self.set_protocol(prot.pop("id", None), **prot)
  29065. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  29066. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  29067. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  29068. self._protocol = self._auto_protocol(**kwargs)
  29069. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  29070. res_0100 = self._verify_protocol("auto", test=not verify)
  29071. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  29072. for line in self.query("0100", parse=False, read_timeout=10):
  29073. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  29074. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  29075. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  29076. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  29077. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  29078. data = self._port.read(self._port.in_waiting or 1)
  29079. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  29080. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  29081. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  29082. sys.exit(salt.defaults.exitcodes.EX_OK)
  29083. SystemExit: 0
  29084. 2020-08-04 12:49:15,404 [obd.obd :120 ][WARNING ][661] Cannot load commands - no connection to bus
  29085. 2020-08-04 12:49:15,437 [obd.interfaces.elm327:730 ][ERROR ][661] Failed to relay command 'STSLCS' to interface
  29086. Traceback (most recent call last):
  29087. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  29088. lines = self.send(cmd, raw_response=raw_response)
  29089. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  29090. raise ELM327Error(self.ERRORS[line], code=line)
  29091. ELM327Error: Operation interrupted by a received RS232 character
  29092. 2020-08-04 12:49:15,441 [messaging :742 ][ERROR ][661] Exception while processing event: {'tag': 'obd/req/f2d382eb-79ec-4646-b044-fa2329570a10', 'data': {'_stamp': '2020-08-04T12:49:09.818253', 'handler': 'execute', '_event_tag': 'obd/req/f2d382eb-79ec-4646-b044-fa2329570a10', 'args': ['STSLCS']}}
  29093. Traceback (most recent call last):
  29094. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  29095. res = self.process(message)
  29096. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  29097. result = func(message, **settings)
  29098. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  29099. found, result = self._call_hook_for(message, "workflow", message)
  29100. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29101. return True, func(*args, **kwargs)
  29102. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  29103. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29104. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29105. return True, func(*args, **kwargs)
  29106. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29107. return func(*args, **kwargs)
  29108. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  29109. res = conn.execute(cmd)
  29110. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  29111. return func(self, *args, **kwargs)
  29112. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  29113. return self._obd.execute(cmd, **kwargs)
  29114. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  29115. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  29116. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  29117. lines = self.send(cmd, raw_response=raw_response)
  29118. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  29119. raise ELM327Error(self.ERRORS[line], code=line)
  29120. ELM327Error: Operation interrupted by a received RS232 character
  29121. 2020-08-04 12:49:16,178 [salt.utils.parsers:1050][WARNING ][421] Minion received a SIGTERM. Exiting.
  29122. 2020-08-04 12:49:16,718 [messaging :871 ][WARNING ][822] No reply message with tag 'obd/res/f2d382eb-79ec-4646-b044-fa2329570a10' received within timeout of 30 secs
  29123. 2020-08-04 12:49:16,722 [salt.state :292 ][ERROR ][822] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  29124. 2020-08-04 12:49:32,903 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  29125. 2020-08-04 12:49:32,914 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  29126. 2020-08-04 12:49:32,922 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  29127. 2020-08-04 12:49:33,559 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  29128. Traceback (most recent call last):
  29129. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29130. self._serial.open()
  29131. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29132. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29133. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29134. 2020-08-04 12:49:34,576 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  29135. Traceback (most recent call last):
  29136. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29137. self._serial.open()
  29138. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29139. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29140. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29141. 2020-08-04 12:49:34,951 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  29142. 2020-08-04 12:49:35,454 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  29143. 2020-08-04 12:49:35,580 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  29144. Traceback (most recent call last):
  29145. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29146. self._serial.open()
  29147. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29148. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29149. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29150. 2020-08-04 12:49:35,957 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  29151. 2020-08-04 12:49:35,959 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  29152. 2020-08-04 12:49:36,229 [messaging :208 ][ERROR ][618] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  29153. Traceback (most recent call last):
  29154. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  29155. self._call_hook_for(message, "workflow", message)
  29156. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29157. return True, func(*args, **kwargs)
  29158. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  29159. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29160. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29161. return True, func(*args, **kwargs)
  29162. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29163. return func(*args, **kwargs)
  29164. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  29165. res = _exec("AT+CCLK?")
  29166. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  29167. conn.write_line(cmd)
  29168. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  29169. self.ensure_open()
  29170. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  29171. self.open()
  29172. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  29173. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  29174. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  29175. raise attempt.get()
  29176. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  29177. six.reraise(self.value[0], self.value[1], self.value[2])
  29178. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  29179. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  29180. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29181. self._serial.open()
  29182. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29183. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29184. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29185. 2020-08-04 12:49:36,462 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  29186. 2020-08-04 12:49:51,685 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][708] Timeout after 1.28205128205 second(s) waiting for interrupt
  29187. 2020-08-04 12:49:51,751 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  29188. Traceback (most recent call last):
  29189. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29190. self._serial.open()
  29191. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29192. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29193. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29194. 2020-08-04 12:49:51,922 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  29195. 2020-08-04 12:49:52,425 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  29196. 2020-08-04 12:49:52,428 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  29197. 2020-08-04 12:49:52,756 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  29198. Traceback (most recent call last):
  29199. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29200. self._serial.open()
  29201. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29202. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29203. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29204. 2020-08-04 12:49:52,932 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  29205. 2020-08-04 12:49:53,435 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  29206. 2020-08-04 12:49:53,760 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  29207. Traceback (most recent call last):
  29208. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29209. self._serial.open()
  29210. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29211. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29212. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29213. 2020-08-04 12:49:53,764 [messaging :206 ][ERROR ][618] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  29214. Traceback (most recent call last):
  29215. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  29216. self._call_hook_for(message, "workflow", message)
  29217. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29218. return True, func(*args, **kwargs)
  29219. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  29220. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29221. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29222. return True, func(*args, **kwargs)
  29223. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29224. return func(*args, **kwargs)
  29225. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  29226. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  29227. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  29228. conn.write_line(cmd)
  29229. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  29230. self.ensure_open()
  29231. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  29232. self.open()
  29233. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  29234. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  29235. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  29236. raise attempt.get()
  29237. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  29238. six.reraise(self.value[0], self.value[1], self.value[2])
  29239. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  29240. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  29241. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29242. self._serial.open()
  29243. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29244. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29245. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29246. 2020-08-04 12:49:53,941 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  29247. 2020-08-04 12:49:53,943 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  29248. 2020-08-04 12:49:53,950 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  29249. 2020-08-04 12:49:54,455 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  29250. 2020-08-04 12:49:54,960 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  29251. 2020-08-04 12:49:54,964 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  29252. 2020-08-04 12:49:55,375 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  29253. Traceback (most recent call last):
  29254. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29255. self._serial.open()
  29256. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29257. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29258. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29259. 2020-08-04 12:49:55,469 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  29260. 2020-08-04 12:49:55,974 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  29261. 2020-08-04 12:49:56,379 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  29262. Traceback (most recent call last):
  29263. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29264. self._serial.open()
  29265. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29266. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29267. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29268. 2020-08-04 12:49:56,478 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  29269. 2020-08-04 12:49:56,480 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  29270. 2020-08-04 12:49:56,984 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  29271. 2020-08-04 12:49:57,383 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  29272. Traceback (most recent call last):
  29273. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29274. self._serial.open()
  29275. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29276. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29277. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29278. 2020-08-04 12:49:57,394 [messaging :742 ][ERROR ][618] Exception while processing event: {'tag': 'ec2x/req/77b82e5e-cb2d-4eb3-b674-f07569bae725', 'data': {'_stamp': '2020-08-04T12:49:32.970168', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/77b82e5e-cb2d-4eb3-b674-f07569bae725', 'kwargs': {'cooldown_delay': None}}}
  29279. Traceback (most recent call last):
  29280. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  29281. res = self.process(message)
  29282. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  29283. result = func(message, **settings)
  29284. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  29285. found, result = self._call_hook_for(message, "workflow", message)
  29286. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29287. return True, func(*args, **kwargs)
  29288. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  29289. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29290. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29291. return True, func(*args, **kwargs)
  29292. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29293. return func(*args, **kwargs)
  29294. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  29295. return _exec(cmd, **kwargs)
  29296. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  29297. conn.write_line(cmd)
  29298. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  29299. self.ensure_open()
  29300. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  29301. self.open()
  29302. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  29303. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  29304. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  29305. raise attempt.get()
  29306. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  29307. six.reraise(self.value[0], self.value[1], self.value[2])
  29308. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  29309. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  29310. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29311. self._serial.open()
  29312. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29313. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29314. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29315. 2020-08-04 12:49:57,488 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  29316. 2020-08-04 12:49:57,991 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  29317. 2020-08-04 12:49:57,994 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  29318. 2020-08-04 12:49:57,997 [messaging :208 ][ERROR ][621] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  29319. Traceback (most recent call last):
  29320. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  29321. self._call_hook_for(message, "workflow", message)
  29322. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29323. return True, func(*args, **kwargs)
  29324. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  29325. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29326. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29327. return True, func(*args, **kwargs)
  29328. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29329. return func(*args, **kwargs)
  29330. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  29331. conn.heartbeat()
  29332. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  29333. self.noop()
  29334. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  29335. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  29336. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  29337. raise attempt.get()
  29338. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  29339. six.reraise(self.value[0], self.value[1], self.value[2])
  29340. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  29341. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  29342. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  29343. self._begin_message()
  29344. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  29345. self.recv(ack=ACK_MESSAGE_BEGIN)
  29346. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  29347. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  29348. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  29349. raise attempt.get()
  29350. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  29351. six.reraise(self.value[0], self.value[1], self.value[2])
  29352. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  29353. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  29354. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  29355. raise Exception(msg)
  29356. Exception: Expected ack '12' but got '255'
  29357. 2020-08-04 12:49:59,486 [messaging :208 ][ERROR ][619] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  29358. Traceback (most recent call last):
  29359. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  29360. self._call_hook_for(message, "workflow", message)
  29361. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29362. return True, func(*args, **kwargs)
  29363. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  29364. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29365. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29366. return True, func(*args, **kwargs)
  29367. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29368. return func(*args, **kwargs)
  29369. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  29370. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  29371. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  29372. res = query("AT+QGPSLOC={:d}".format(mode))
  29373. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  29374. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  29375. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  29376. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  29377. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  29378. raise salt.exceptions.CommandExecutionError(message["error"])
  29379. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29380. 2020-08-04 12:50:04,559 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  29381. Traceback (most recent call last):
  29382. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29383. self._serial.open()
  29384. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29385. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29386. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29387. 2020-08-04 12:50:05,563 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  29388. Traceback (most recent call last):
  29389. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29390. self._serial.open()
  29391. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29392. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29393. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29394. 2020-08-04 12:50:06,567 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  29395. Traceback (most recent call last):
  29396. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29397. self._serial.open()
  29398. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29399. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29400. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29401. 2020-08-04 12:50:06,570 [messaging :742 ][ERROR ][618] Exception while processing event: {'tag': 'ec2x/req/4d5684a4-6ecf-4c4a-b9e0-d4e9088e38e8', 'data': {'_stamp': '2020-08-04T12:50:04.552401', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/4d5684a4-6ecf-4c4a-b9e0-d4e9088e38e8', 'kwargs': {'cooldown_delay': None}}}
  29402. Traceback (most recent call last):
  29403. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  29404. res = self.process(message)
  29405. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  29406. result = func(message, **settings)
  29407. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  29408. found, result = self._call_hook_for(message, "workflow", message)
  29409. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29410. return True, func(*args, **kwargs)
  29411. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  29412. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29413. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29414. return True, func(*args, **kwargs)
  29415. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29416. return func(*args, **kwargs)
  29417. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  29418. return _exec(cmd, **kwargs)
  29419. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  29420. conn.write_line(cmd)
  29421. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  29422. self.ensure_open()
  29423. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  29424. self.open()
  29425. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  29426. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  29427. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  29428. raise attempt.get()
  29429. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  29430. six.reraise(self.value[0], self.value[1], self.value[2])
  29431. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  29432. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  29433. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29434. self._serial.open()
  29435. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29436. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29437. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29438. 2020-08-04 12:50:06,602 [messaging :206 ][ERROR ][619] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  29439. Traceback (most recent call last):
  29440. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  29441. self._call_hook_for(message, "workflow", message)
  29442. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29443. return True, func(*args, **kwargs)
  29444. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  29445. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29446. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29447. return True, func(*args, **kwargs)
  29448. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29449. return func(*args, **kwargs)
  29450. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  29451. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  29452. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  29453. res = query("AT+QGPSLOC={:d}".format(mode))
  29454. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  29455. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  29456. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  29457. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  29458. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  29459. raise salt.exceptions.CommandExecutionError(message["error"])
  29460. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29461. 2020-08-04 12:50:09,939 [obd.obd :107 ][ERROR ][707] Failed to use explicit port '/dev/serial0'
  29462. Traceback (most recent call last):
  29463. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  29464. self.interface.open(baudrate, protocol=protocol)
  29465. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  29466. self.set_protocol(prot.pop("id", None), **prot)
  29467. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  29468. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  29469. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  29470. self._protocol = self._auto_protocol(**kwargs)
  29471. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  29472. res_0100 = self._verify_protocol("auto", test=not verify)
  29473. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  29474. for line in self.query("0100", parse=False, read_timeout=10):
  29475. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  29476. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  29477. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  29478. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  29479. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  29480. data = self._port.read(self._port.in_waiting or 1)
  29481. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  29482. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  29483. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  29484. sys.exit(salt.defaults.exitcodes.EX_OK)
  29485. SystemExit: 0
  29486. 2020-08-04 12:50:09,974 [obd.obd :120 ][WARNING ][707] Cannot load commands - no connection to bus
  29487. 2020-08-04 12:50:10,006 [obd.interfaces.elm327:730 ][ERROR ][707] Failed to relay command 'STSLCS' to interface
  29488. Traceback (most recent call last):
  29489. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  29490. lines = self.send(cmd, raw_response=raw_response)
  29491. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  29492. raise ELM327Error(self.ERRORS[line], code=line)
  29493. ELM327Error: Operation interrupted by a received RS232 character
  29494. 2020-08-04 12:50:10,023 [messaging :742 ][ERROR ][707] Exception while processing event: {'tag': 'obd/req/01152601-cae1-42f9-ac49-9fe90abe6268', 'data': {'_stamp': '2020-08-04T12:50:04.419461', 'handler': 'execute', '_event_tag': 'obd/req/01152601-cae1-42f9-ac49-9fe90abe6268', 'args': ['STSLCS']}}
  29495. Traceback (most recent call last):
  29496. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  29497. res = self.process(message)
  29498. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  29499. result = func(message, **settings)
  29500. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  29501. found, result = self._call_hook_for(message, "workflow", message)
  29502. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29503. return True, func(*args, **kwargs)
  29504. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  29505. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29506. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29507. return True, func(*args, **kwargs)
  29508. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29509. return func(*args, **kwargs)
  29510. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  29511. res = conn.execute(cmd)
  29512. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  29513. return func(self, *args, **kwargs)
  29514. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  29515. return self._obd.execute(cmd, **kwargs)
  29516. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  29517. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  29518. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  29519. lines = self.send(cmd, raw_response=raw_response)
  29520. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  29521. raise ELM327Error(self.ERRORS[line], code=line)
  29522. ELM327Error: Operation interrupted by a received RS232 character
  29523. 2020-08-04 12:50:10,757 [salt.utils.parsers:1050][WARNING ][418] Minion received a SIGTERM. Exiting.
  29524. 2020-08-04 12:50:11,297 [messaging :871 ][WARNING ][818] No reply message with tag 'obd/res/01152601-cae1-42f9-ac49-9fe90abe6268' received within timeout of 30 secs
  29525. 2020-08-04 12:50:11,304 [salt.state :292 ][ERROR ][818] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  29526. 2020-08-04 12:50:28,261 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  29527. 2020-08-04 12:50:28,278 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  29528. 2020-08-04 12:50:28,283 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  29529. 2020-08-04 12:50:28,950 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  29530. Traceback (most recent call last):
  29531. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29532. self._serial.open()
  29533. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29534. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29535. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29536. 2020-08-04 12:50:29,965 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  29537. Traceback (most recent call last):
  29538. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29539. self._serial.open()
  29540. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29541. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29542. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29543. 2020-08-04 12:50:30,316 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  29544. 2020-08-04 12:50:30,820 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  29545. 2020-08-04 12:50:30,970 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  29546. Traceback (most recent call last):
  29547. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29548. self._serial.open()
  29549. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29550. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29551. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29552. 2020-08-04 12:50:31,323 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  29553. 2020-08-04 12:50:31,326 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  29554. 2020-08-04 12:50:31,632 [messaging :208 ][ERROR ][617] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  29555. Traceback (most recent call last):
  29556. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  29557. self._call_hook_for(message, "workflow", message)
  29558. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29559. return True, func(*args, **kwargs)
  29560. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  29561. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29562. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29563. return True, func(*args, **kwargs)
  29564. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29565. return func(*args, **kwargs)
  29566. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  29567. res = _exec("AT+CCLK?")
  29568. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  29569. conn.write_line(cmd)
  29570. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  29571. self.ensure_open()
  29572. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  29573. self.open()
  29574. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  29575. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  29576. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  29577. raise attempt.get()
  29578. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  29579. six.reraise(self.value[0], self.value[1], self.value[2])
  29580. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  29581. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  29582. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29583. self._serial.open()
  29584. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29585. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29586. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29587. 2020-08-04 12:50:31,830 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  29588. 2020-08-04 12:50:46,507 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][707] Timeout after 1.28205128205 second(s) waiting for interrupt
  29589. 2020-08-04 12:50:46,590 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  29590. Traceback (most recent call last):
  29591. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29592. self._serial.open()
  29593. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29594. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29595. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29596. 2020-08-04 12:50:46,831 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  29597. 2020-08-04 12:50:47,334 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  29598. 2020-08-04 12:50:47,336 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  29599. 2020-08-04 12:50:47,606 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  29600. Traceback (most recent call last):
  29601. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29602. self._serial.open()
  29603. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29604. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29605. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29606. 2020-08-04 12:50:47,840 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  29607. 2020-08-04 12:50:48,343 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  29608. 2020-08-04 12:50:48,610 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  29609. Traceback (most recent call last):
  29610. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29611. self._serial.open()
  29612. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29613. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29614. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29615. 2020-08-04 12:50:48,613 [messaging :206 ][ERROR ][617] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  29616. Traceback (most recent call last):
  29617. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  29618. self._call_hook_for(message, "workflow", message)
  29619. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29620. return True, func(*args, **kwargs)
  29621. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  29622. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29623. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29624. return True, func(*args, **kwargs)
  29625. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29626. return func(*args, **kwargs)
  29627. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  29628. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  29629. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  29630. conn.write_line(cmd)
  29631. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  29632. self.ensure_open()
  29633. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  29634. self.open()
  29635. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  29636. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  29637. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  29638. raise attempt.get()
  29639. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  29640. six.reraise(self.value[0], self.value[1], self.value[2])
  29641. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  29642. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  29643. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29644. self._serial.open()
  29645. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29646. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29647. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29648. 2020-08-04 12:50:48,846 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  29649. 2020-08-04 12:50:48,849 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  29650. 2020-08-04 12:50:48,852 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  29651. 2020-08-04 12:50:49,355 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  29652. 2020-08-04 12:50:49,858 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  29653. 2020-08-04 12:50:49,860 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  29654. 2020-08-04 12:50:50,344 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  29655. Traceback (most recent call last):
  29656. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29657. self._serial.open()
  29658. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29659. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29660. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29661. 2020-08-04 12:50:50,364 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  29662. 2020-08-04 12:50:50,868 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  29663. 2020-08-04 12:50:51,348 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  29664. Traceback (most recent call last):
  29665. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29666. self._serial.open()
  29667. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29668. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29669. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29670. 2020-08-04 12:50:51,371 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  29671. 2020-08-04 12:50:51,373 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  29672. 2020-08-04 12:50:51,876 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  29673. 2020-08-04 12:50:52,352 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  29674. Traceback (most recent call last):
  29675. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29676. self._serial.open()
  29677. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29678. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29679. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29680. 2020-08-04 12:50:52,363 [messaging :742 ][ERROR ][617] Exception while processing event: {'tag': 'ec2x/req/52e86f1f-1267-4534-bb22-0c4edca7c059', 'data': {'_stamp': '2020-08-04T12:50:28.329171', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/52e86f1f-1267-4534-bb22-0c4edca7c059', 'kwargs': {'cooldown_delay': None}}}
  29681. Traceback (most recent call last):
  29682. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  29683. res = self.process(message)
  29684. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  29685. result = func(message, **settings)
  29686. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  29687. found, result = self._call_hook_for(message, "workflow", message)
  29688. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29689. return True, func(*args, **kwargs)
  29690. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  29691. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29692. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29693. return True, func(*args, **kwargs)
  29694. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29695. return func(*args, **kwargs)
  29696. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  29697. return _exec(cmd, **kwargs)
  29698. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  29699. conn.write_line(cmd)
  29700. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  29701. self.ensure_open()
  29702. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  29703. self.open()
  29704. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  29705. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  29706. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  29707. raise attempt.get()
  29708. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  29709. six.reraise(self.value[0], self.value[1], self.value[2])
  29710. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  29711. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  29712. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29713. self._serial.open()
  29714. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29715. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29716. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29717. 2020-08-04 12:50:52,379 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  29718. 2020-08-04 12:50:52,882 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  29719. 2020-08-04 12:50:52,885 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  29720. 2020-08-04 12:50:52,887 [messaging :208 ][ERROR ][620] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  29721. Traceback (most recent call last):
  29722. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  29723. self._call_hook_for(message, "workflow", message)
  29724. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29725. return True, func(*args, **kwargs)
  29726. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  29727. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29728. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29729. return True, func(*args, **kwargs)
  29730. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29731. return func(*args, **kwargs)
  29732. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  29733. conn.heartbeat()
  29734. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  29735. self.noop()
  29736. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  29737. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  29738. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  29739. raise attempt.get()
  29740. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  29741. six.reraise(self.value[0], self.value[1], self.value[2])
  29742. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  29743. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  29744. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  29745. self._begin_message()
  29746. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  29747. self.recv(ack=ACK_MESSAGE_BEGIN)
  29748. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  29749. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  29750. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  29751. raise attempt.get()
  29752. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  29753. six.reraise(self.value[0], self.value[1], self.value[2])
  29754. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  29755. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  29756. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  29757. raise Exception(msg)
  29758. Exception: Expected ack '12' but got '255'
  29759. 2020-08-04 12:50:54,625 [messaging :208 ][ERROR ][618] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  29760. Traceback (most recent call last):
  29761. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  29762. self._call_hook_for(message, "workflow", message)
  29763. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29764. return True, func(*args, **kwargs)
  29765. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  29766. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29767. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29768. return True, func(*args, **kwargs)
  29769. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29770. return func(*args, **kwargs)
  29771. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  29772. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  29773. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  29774. res = query("AT+QGPSLOC={:d}".format(mode))
  29775. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  29776. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  29777. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  29778. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  29779. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  29780. raise salt.exceptions.CommandExecutionError(message["error"])
  29781. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29782. 2020-08-04 12:50:59,669 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  29783. Traceback (most recent call last):
  29784. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29785. self._serial.open()
  29786. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29787. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29788. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29789. 2020-08-04 12:51:00,673 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  29790. Traceback (most recent call last):
  29791. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29792. self._serial.open()
  29793. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29794. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29795. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29796. 2020-08-04 12:51:01,677 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  29797. Traceback (most recent call last):
  29798. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29799. self._serial.open()
  29800. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29801. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29802. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29803. 2020-08-04 12:51:01,680 [messaging :742 ][ERROR ][617] Exception while processing event: {'tag': 'ec2x/req/21a9a185-381f-4203-a07d-fd018ce6fc53', 'data': {'_stamp': '2020-08-04T12:50:59.662112', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/21a9a185-381f-4203-a07d-fd018ce6fc53', 'kwargs': {'cooldown_delay': None}}}
  29804. Traceback (most recent call last):
  29805. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  29806. res = self.process(message)
  29807. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  29808. result = func(message, **settings)
  29809. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  29810. found, result = self._call_hook_for(message, "workflow", message)
  29811. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29812. return True, func(*args, **kwargs)
  29813. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  29814. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29815. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29816. return True, func(*args, **kwargs)
  29817. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29818. return func(*args, **kwargs)
  29819. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  29820. return _exec(cmd, **kwargs)
  29821. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  29822. conn.write_line(cmd)
  29823. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  29824. self.ensure_open()
  29825. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  29826. self.open()
  29827. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  29828. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  29829. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  29830. raise attempt.get()
  29831. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  29832. six.reraise(self.value[0], self.value[1], self.value[2])
  29833. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  29834. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  29835. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29836. self._serial.open()
  29837. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29838. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29839. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29840. 2020-08-04 12:51:01,700 [messaging :206 ][ERROR ][618] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  29841. Traceback (most recent call last):
  29842. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  29843. self._call_hook_for(message, "workflow", message)
  29844. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29845. return True, func(*args, **kwargs)
  29846. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  29847. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29848. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29849. return True, func(*args, **kwargs)
  29850. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29851. return func(*args, **kwargs)
  29852. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  29853. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  29854. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  29855. res = query("AT+QGPSLOC={:d}".format(mode))
  29856. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  29857. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  29858. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  29859. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  29860. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  29861. raise salt.exceptions.CommandExecutionError(message["error"])
  29862. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29863. 2020-08-04 12:51:05,079 [obd.obd :107 ][ERROR ][706] Failed to use explicit port '/dev/serial0'
  29864. Traceback (most recent call last):
  29865. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  29866. self.interface.open(baudrate, protocol=protocol)
  29867. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  29868. self.set_protocol(prot.pop("id", None), **prot)
  29869. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  29870. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  29871. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  29872. self._protocol = self._auto_protocol(**kwargs)
  29873. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  29874. res_0100 = self._verify_protocol("auto", test=not verify)
  29875. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  29876. for line in self.query("0100", parse=False, read_timeout=10):
  29877. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  29878. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  29879. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  29880. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  29881. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  29882. data = self._port.read(self._port.in_waiting or 1)
  29883. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  29884. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  29885. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  29886. sys.exit(salt.defaults.exitcodes.EX_OK)
  29887. SystemExit: 0
  29888. 2020-08-04 12:51:05,131 [obd.obd :120 ][WARNING ][706] Cannot load commands - no connection to bus
  29889. 2020-08-04 12:51:05,179 [obd.interfaces.elm327:730 ][ERROR ][706] Failed to relay command 'STSLCS' to interface
  29890. Traceback (most recent call last):
  29891. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  29892. lines = self.send(cmd, raw_response=raw_response)
  29893. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  29894. raise ELM327Error(self.ERRORS[line], code=line)
  29895. ELM327Error: Operation interrupted by a received RS232 character
  29896. 2020-08-04 12:51:05,195 [messaging :742 ][ERROR ][706] Exception while processing event: {'tag': 'obd/req/d6a08097-2f4e-4512-a860-9ac0d9769401', 'data': {'_stamp': '2020-08-04T12:50:59.571753', 'handler': 'execute', '_event_tag': 'obd/req/d6a08097-2f4e-4512-a860-9ac0d9769401', 'args': ['STSLCS']}}
  29897. Traceback (most recent call last):
  29898. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  29899. res = self.process(message)
  29900. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  29901. result = func(message, **settings)
  29902. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  29903. found, result = self._call_hook_for(message, "workflow", message)
  29904. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29905. return True, func(*args, **kwargs)
  29906. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  29907. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29908. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29909. return True, func(*args, **kwargs)
  29910. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29911. return func(*args, **kwargs)
  29912. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  29913. res = conn.execute(cmd)
  29914. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  29915. return func(self, *args, **kwargs)
  29916. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  29917. return self._obd.execute(cmd, **kwargs)
  29918. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  29919. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  29920. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  29921. lines = self.send(cmd, raw_response=raw_response)
  29922. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  29923. raise ELM327Error(self.ERRORS[line], code=line)
  29924. ELM327Error: Operation interrupted by a received RS232 character
  29925. 2020-08-04 12:51:05,936 [salt.utils.parsers:1050][WARNING ][417] Minion received a SIGTERM. Exiting.
  29926. 2020-08-04 12:51:06,477 [messaging :871 ][WARNING ][817] No reply message with tag 'obd/res/d6a08097-2f4e-4512-a860-9ac0d9769401' received within timeout of 30 secs
  29927. 2020-08-04 12:51:06,480 [salt.state :292 ][ERROR ][817] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  29928. 2020-08-04 12:51:22,996 [gpio_spi_conn :42 ][WARNING ][628] Unable to clear buffer - got unexpected value: 255
  29929. 2020-08-04 12:51:23,018 [gpio_spi_conn :42 ][WARNING ][628] Unable to clear buffer - got unexpected value: 255
  29930. 2020-08-04 12:51:23,022 [gpio_spi_conn :42 ][WARNING ][628] Unable to clear buffer - got unexpected value: 255
  29931. 2020-08-04 12:51:23,649 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  29932. Traceback (most recent call last):
  29933. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29934. self._serial.open()
  29935. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29936. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29937. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29938. 2020-08-04 12:51:24,666 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  29939. Traceback (most recent call last):
  29940. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29941. self._serial.open()
  29942. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29943. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29944. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29945. 2020-08-04 12:51:25,063 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  29946. 2020-08-04 12:51:25,566 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  29947. 2020-08-04 12:51:25,670 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  29948. Traceback (most recent call last):
  29949. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29950. self._serial.open()
  29951. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29952. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29953. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29954. 2020-08-04 12:51:26,069 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  29955. 2020-08-04 12:51:26,071 [spm_conn :139 ][WARNING ][628] Unable to get status: Expected ack '12' but got '255'
  29956. 2020-08-04 12:51:26,233 [messaging :208 ][ERROR ][625] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  29957. Traceback (most recent call last):
  29958. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  29959. self._call_hook_for(message, "workflow", message)
  29960. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29961. return True, func(*args, **kwargs)
  29962. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  29963. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  29964. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  29965. return True, func(*args, **kwargs)
  29966. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  29967. return func(*args, **kwargs)
  29968. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  29969. res = _exec("AT+CCLK?")
  29970. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  29971. conn.write_line(cmd)
  29972. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  29973. self.ensure_open()
  29974. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  29975. self.open()
  29976. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  29977. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  29978. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  29979. raise attempt.get()
  29980. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  29981. six.reraise(self.value[0], self.value[1], self.value[2])
  29982. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  29983. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  29984. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29985. self._serial.open()
  29986. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29987. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29988. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29989. 2020-08-04 12:51:26,575 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  29990. 2020-08-04 12:51:41,482 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][716] Timeout after 1.28205128205 second(s) waiting for interrupt
  29991. 2020-08-04 12:51:41,551 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  29992. Traceback (most recent call last):
  29993. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  29994. self._serial.open()
  29995. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  29996. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  29997. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  29998. 2020-08-04 12:51:41,818 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  29999. 2020-08-04 12:51:42,322 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  30000. 2020-08-04 12:51:42,324 [spm_conn :139 ][WARNING ][628] Unable to get status: Expected ack '12' but got '255'
  30001. 2020-08-04 12:51:42,556 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  30002. Traceback (most recent call last):
  30003. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30004. self._serial.open()
  30005. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30006. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30007. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30008. 2020-08-04 12:51:42,828 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  30009. 2020-08-04 12:51:43,331 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  30010. 2020-08-04 12:51:43,560 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  30011. Traceback (most recent call last):
  30012. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30013. self._serial.open()
  30014. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30015. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30016. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30017. 2020-08-04 12:51:43,564 [messaging :206 ][ERROR ][625] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  30018. Traceback (most recent call last):
  30019. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  30020. self._call_hook_for(message, "workflow", message)
  30021. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30022. return True, func(*args, **kwargs)
  30023. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  30024. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30025. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30026. return True, func(*args, **kwargs)
  30027. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30028. return func(*args, **kwargs)
  30029. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  30030. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  30031. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  30032. conn.write_line(cmd)
  30033. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  30034. self.ensure_open()
  30035. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  30036. self.open()
  30037. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  30038. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  30039. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  30040. raise attempt.get()
  30041. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  30042. six.reraise(self.value[0], self.value[1], self.value[2])
  30043. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  30044. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  30045. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30046. self._serial.open()
  30047. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30048. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30049. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30050. 2020-08-04 12:51:43,835 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  30051. 2020-08-04 12:51:43,837 [spm_conn :139 ][WARNING ][628] Unable to get status: Expected ack '12' but got '255'
  30052. 2020-08-04 12:51:43,840 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  30053. 2020-08-04 12:51:44,343 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  30054. 2020-08-04 12:51:44,846 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  30055. 2020-08-04 12:51:44,848 [spm_conn :82 ][WARNING ][628] Unable to send noop: Expected ack '12' but got '255'
  30056. 2020-08-04 12:51:45,352 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  30057. 2020-08-04 12:51:45,464 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  30058. Traceback (most recent call last):
  30059. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30060. self._serial.open()
  30061. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30062. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30063. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30064. 2020-08-04 12:51:45,855 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  30065. 2020-08-04 12:51:46,358 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  30066. 2020-08-04 12:51:46,361 [spm_conn :82 ][WARNING ][628] Unable to send noop: Expected ack '12' but got '255'
  30067. 2020-08-04 12:51:46,474 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  30068. Traceback (most recent call last):
  30069. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30070. self._serial.open()
  30071. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30072. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30073. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30074. 2020-08-04 12:51:46,865 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  30075. 2020-08-04 12:51:47,368 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  30076. 2020-08-04 12:51:47,479 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  30077. Traceback (most recent call last):
  30078. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30079. self._serial.open()
  30080. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30081. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30082. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30083. 2020-08-04 12:51:47,483 [messaging :742 ][ERROR ][625] Exception while processing event: {'tag': 'ec2x/req/b618e431-2d29-4c0c-96b6-fa5104d1f395', 'data': {'_stamp': '2020-08-04T12:51:23.073405', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/b618e431-2d29-4c0c-96b6-fa5104d1f395', 'kwargs': {'cooldown_delay': None}}}
  30084. Traceback (most recent call last):
  30085. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  30086. res = self.process(message)
  30087. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  30088. result = func(message, **settings)
  30089. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  30090. found, result = self._call_hook_for(message, "workflow", message)
  30091. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30092. return True, func(*args, **kwargs)
  30093. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  30094. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30095. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30096. return True, func(*args, **kwargs)
  30097. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30098. return func(*args, **kwargs)
  30099. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  30100. return _exec(cmd, **kwargs)
  30101. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  30102. conn.write_line(cmd)
  30103. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  30104. self.ensure_open()
  30105. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  30106. self.open()
  30107. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  30108. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  30109. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  30110. raise attempt.get()
  30111. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  30112. six.reraise(self.value[0], self.value[1], self.value[2])
  30113. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  30114. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  30115. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30116. self._serial.open()
  30117. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30118. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30119. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30120. 2020-08-04 12:51:47,871 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  30121. 2020-08-04 12:51:47,874 [spm_conn :82 ][WARNING ][628] Unable to send noop: Expected ack '12' but got '255'
  30122. 2020-08-04 12:51:47,877 [messaging :208 ][ERROR ][628] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  30123. Traceback (most recent call last):
  30124. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  30125. self._call_hook_for(message, "workflow", message)
  30126. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30127. return True, func(*args, **kwargs)
  30128. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  30129. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30130. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30131. return True, func(*args, **kwargs)
  30132. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30133. return func(*args, **kwargs)
  30134. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  30135. conn.heartbeat()
  30136. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  30137. self.noop()
  30138. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  30139. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  30140. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  30141. raise attempt.get()
  30142. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  30143. six.reraise(self.value[0], self.value[1], self.value[2])
  30144. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  30145. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  30146. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  30147. self._begin_message()
  30148. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  30149. self.recv(ack=ACK_MESSAGE_BEGIN)
  30150. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  30151. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  30152. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  30153. raise attempt.get()
  30154. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  30155. six.reraise(self.value[0], self.value[1], self.value[2])
  30156. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  30157. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  30158. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  30159. raise Exception(msg)
  30160. Exception: Expected ack '12' but got '255'
  30161. 2020-08-04 12:51:49,755 [messaging :208 ][ERROR ][626] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  30162. Traceback (most recent call last):
  30163. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  30164. self._call_hook_for(message, "workflow", message)
  30165. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30166. return True, func(*args, **kwargs)
  30167. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  30168. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30169. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30170. return True, func(*args, **kwargs)
  30171. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30172. return func(*args, **kwargs)
  30173. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  30174. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  30175. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  30176. res = query("AT+QGPSLOC={:d}".format(mode))
  30177. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  30178. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  30179. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  30180. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  30181. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  30182. raise salt.exceptions.CommandExecutionError(message["error"])
  30183. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30184. 2020-08-04 12:51:54,800 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  30185. Traceback (most recent call last):
  30186. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30187. self._serial.open()
  30188. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30189. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30190. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30191. 2020-08-04 12:51:55,816 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  30192. Traceback (most recent call last):
  30193. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30194. self._serial.open()
  30195. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30196. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30197. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30198. 2020-08-04 12:51:56,821 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  30199. Traceback (most recent call last):
  30200. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30201. self._serial.open()
  30202. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30203. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30204. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30205. 2020-08-04 12:51:56,825 [messaging :742 ][ERROR ][625] Exception while processing event: {'tag': 'ec2x/req/a0b84c15-b308-416d-93b9-42a3c1bcc988', 'data': {'_stamp': '2020-08-04T12:51:54.793033', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/a0b84c15-b308-416d-93b9-42a3c1bcc988', 'kwargs': {'cooldown_delay': None}}}
  30206. Traceback (most recent call last):
  30207. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  30208. res = self.process(message)
  30209. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  30210. result = func(message, **settings)
  30211. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  30212. found, result = self._call_hook_for(message, "workflow", message)
  30213. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30214. return True, func(*args, **kwargs)
  30215. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  30216. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30217. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30218. return True, func(*args, **kwargs)
  30219. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30220. return func(*args, **kwargs)
  30221. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  30222. return _exec(cmd, **kwargs)
  30223. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  30224. conn.write_line(cmd)
  30225. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  30226. self.ensure_open()
  30227. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  30228. self.open()
  30229. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  30230. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  30231. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  30232. raise attempt.get()
  30233. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  30234. six.reraise(self.value[0], self.value[1], self.value[2])
  30235. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  30236. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  30237. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30238. self._serial.open()
  30239. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30240. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30241. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30242. 2020-08-04 12:51:56,861 [messaging :206 ][ERROR ][626] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  30243. Traceback (most recent call last):
  30244. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  30245. self._call_hook_for(message, "workflow", message)
  30246. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30247. return True, func(*args, **kwargs)
  30248. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  30249. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30250. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30251. return True, func(*args, **kwargs)
  30252. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30253. return func(*args, **kwargs)
  30254. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  30255. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  30256. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  30257. res = query("AT+QGPSLOC={:d}".format(mode))
  30258. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  30259. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  30260. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  30261. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  30262. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  30263. raise salt.exceptions.CommandExecutionError(message["error"])
  30264. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30265. 2020-08-04 12:52:00,041 [obd.obd :107 ][ERROR ][714] Failed to use explicit port '/dev/serial0'
  30266. Traceback (most recent call last):
  30267. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  30268. self.interface.open(baudrate, protocol=protocol)
  30269. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  30270. self.set_protocol(prot.pop("id", None), **prot)
  30271. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  30272. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  30273. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  30274. self._protocol = self._auto_protocol(**kwargs)
  30275. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  30276. res_0100 = self._verify_protocol("auto", test=not verify)
  30277. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  30278. for line in self.query("0100", parse=False, read_timeout=10):
  30279. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  30280. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  30281. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  30282. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  30283. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  30284. data = self._port.read(self._port.in_waiting or 1)
  30285. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  30286. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  30287. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  30288. sys.exit(salt.defaults.exitcodes.EX_OK)
  30289. SystemExit: 0
  30290. 2020-08-04 12:52:00,091 [obd.obd :120 ][WARNING ][714] Cannot load commands - no connection to bus
  30291. 2020-08-04 12:52:00,139 [obd.interfaces.elm327:730 ][ERROR ][714] Failed to relay command 'STSLCS' to interface
  30292. Traceback (most recent call last):
  30293. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  30294. lines = self.send(cmd, raw_response=raw_response)
  30295. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  30296. raise ELM327Error(self.ERRORS[line], code=line)
  30297. ELM327Error: Operation interrupted by a received RS232 character
  30298. 2020-08-04 12:52:00,153 [messaging :742 ][ERROR ][714] Exception while processing event: {'tag': 'obd/req/fa1e31dc-62f5-400e-a699-955d05382a03', 'data': {'_stamp': '2020-08-04T12:51:54.637673', 'handler': 'execute', '_event_tag': 'obd/req/fa1e31dc-62f5-400e-a699-955d05382a03', 'args': ['STSLCS']}}
  30299. Traceback (most recent call last):
  30300. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  30301. res = self.process(message)
  30302. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  30303. result = func(message, **settings)
  30304. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  30305. found, result = self._call_hook_for(message, "workflow", message)
  30306. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30307. return True, func(*args, **kwargs)
  30308. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  30309. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30310. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30311. return True, func(*args, **kwargs)
  30312. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30313. return func(*args, **kwargs)
  30314. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  30315. res = conn.execute(cmd)
  30316. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  30317. return func(self, *args, **kwargs)
  30318. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  30319. return self._obd.execute(cmd, **kwargs)
  30320. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  30321. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  30322. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  30323. lines = self.send(cmd, raw_response=raw_response)
  30324. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  30325. raise ELM327Error(self.ERRORS[line], code=line)
  30326. ELM327Error: Operation interrupted by a received RS232 character
  30327. 2020-08-04 12:52:00,990 [salt.utils.parsers:1050][WARNING ][424] Minion received a SIGTERM. Exiting.
  30328. 2020-08-04 12:52:01,530 [messaging :871 ][WARNING ][825] No reply message with tag 'obd/res/fa1e31dc-62f5-400e-a699-955d05382a03' received within timeout of 30 secs
  30329. 2020-08-04 12:52:01,534 [salt.state :292 ][ERROR ][825] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  30330. 2020-08-04 12:52:18,133 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  30331. 2020-08-04 12:52:18,145 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  30332. 2020-08-04 12:52:18,149 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  30333. 2020-08-04 12:52:18,822 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  30334. Traceback (most recent call last):
  30335. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30336. self._serial.open()
  30337. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30338. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30339. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30340. 2020-08-04 12:52:19,842 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  30341. Traceback (most recent call last):
  30342. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30343. self._serial.open()
  30344. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30345. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30346. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30347. 2020-08-04 12:52:20,189 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  30348. 2020-08-04 12:52:20,694 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  30349. 2020-08-04 12:52:20,856 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  30350. Traceback (most recent call last):
  30351. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30352. self._serial.open()
  30353. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30354. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30355. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30356. 2020-08-04 12:52:21,199 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  30357. 2020-08-04 12:52:21,202 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  30358. 2020-08-04 12:52:21,421 [messaging :208 ][ERROR ][621] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  30359. Traceback (most recent call last):
  30360. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  30361. self._call_hook_for(message, "workflow", message)
  30362. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30363. return True, func(*args, **kwargs)
  30364. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  30365. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30366. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30367. return True, func(*args, **kwargs)
  30368. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30369. return func(*args, **kwargs)
  30370. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  30371. res = _exec("AT+CCLK?")
  30372. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  30373. conn.write_line(cmd)
  30374. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  30375. self.ensure_open()
  30376. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  30377. self.open()
  30378. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  30379. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  30380. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  30381. raise attempt.get()
  30382. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  30383. six.reraise(self.value[0], self.value[1], self.value[2])
  30384. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  30385. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  30386. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30387. self._serial.open()
  30388. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30389. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30390. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30391. 2020-08-04 12:52:21,707 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  30392. 2020-08-04 12:52:22,211 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  30393. 2020-08-04 12:52:22,714 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  30394. 2020-08-04 12:52:22,718 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  30395. 2020-08-04 12:52:23,222 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  30396. 2020-08-04 12:52:23,740 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  30397. 2020-08-04 12:52:24,244 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  30398. 2020-08-04 12:52:24,246 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  30399. 2020-08-04 12:52:24,249 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  30400. 2020-08-04 12:52:24,752 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  30401. 2020-08-04 12:52:25,263 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  30402. 2020-08-04 12:52:25,265 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  30403. 2020-08-04 12:52:25,621 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  30404. Traceback (most recent call last):
  30405. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30406. self._serial.open()
  30407. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30408. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30409. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30410. 2020-08-04 12:52:25,769 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  30411. 2020-08-04 12:52:26,272 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  30412. 2020-08-04 12:52:26,656 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  30413. Traceback (most recent call last):
  30414. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30415. self._serial.open()
  30416. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30417. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30418. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30419. 2020-08-04 12:52:26,775 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  30420. 2020-08-04 12:52:26,778 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  30421. 2020-08-04 12:52:27,283 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  30422. 2020-08-04 12:52:27,670 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  30423. Traceback (most recent call last):
  30424. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30425. self._serial.open()
  30426. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30427. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30428. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30429. 2020-08-04 12:52:27,684 [messaging :742 ][ERROR ][621] Exception while processing event: {'tag': 'ec2x/req/8389461a-246f-457f-8b5d-a52fc2ade958', 'data': {'_stamp': '2020-08-04T12:52:18.220908', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/8389461a-246f-457f-8b5d-a52fc2ade958', 'kwargs': {'cooldown_delay': None}}}
  30430. Traceback (most recent call last):
  30431. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  30432. res = self.process(message)
  30433. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  30434. result = func(message, **settings)
  30435. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  30436. found, result = self._call_hook_for(message, "workflow", message)
  30437. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30438. return True, func(*args, **kwargs)
  30439. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  30440. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30441. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30442. return True, func(*args, **kwargs)
  30443. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30444. return func(*args, **kwargs)
  30445. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  30446. return _exec(cmd, **kwargs)
  30447. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  30448. conn.write_line(cmd)
  30449. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  30450. self.ensure_open()
  30451. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  30452. self.open()
  30453. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  30454. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  30455. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  30456. raise attempt.get()
  30457. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  30458. six.reraise(self.value[0], self.value[1], self.value[2])
  30459. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  30460. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  30461. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30462. self._serial.open()
  30463. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30464. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30465. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30466. 2020-08-04 12:52:27,786 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  30467. 2020-08-04 12:52:28,291 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  30468. 2020-08-04 12:52:28,294 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  30469. 2020-08-04 12:52:28,297 [messaging :208 ][ERROR ][624] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  30470. Traceback (most recent call last):
  30471. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  30472. self._call_hook_for(message, "workflow", message)
  30473. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30474. return True, func(*args, **kwargs)
  30475. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  30476. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30477. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30478. return True, func(*args, **kwargs)
  30479. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30480. return func(*args, **kwargs)
  30481. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  30482. conn.heartbeat()
  30483. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  30484. self.noop()
  30485. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  30486. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  30487. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  30488. raise attempt.get()
  30489. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  30490. six.reraise(self.value[0], self.value[1], self.value[2])
  30491. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  30492. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  30493. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  30494. self._begin_message()
  30495. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  30496. self.recv(ack=ACK_MESSAGE_BEGIN)
  30497. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  30498. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  30499. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  30500. raise attempt.get()
  30501. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  30502. six.reraise(self.value[0], self.value[1], self.value[2])
  30503. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  30504. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  30505. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  30506. raise Exception(msg)
  30507. Exception: Expected ack '12' but got '255'
  30508. 2020-08-04 12:52:28,338 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  30509. Traceback (most recent call last):
  30510. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30511. self._serial.open()
  30512. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30513. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30514. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30515. 2020-08-04 12:52:29,343 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  30516. Traceback (most recent call last):
  30517. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30518. self._serial.open()
  30519. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30520. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30521. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30522. 2020-08-04 12:52:29,801 [messaging :208 ][ERROR ][622] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  30523. Traceback (most recent call last):
  30524. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  30525. self._call_hook_for(message, "workflow", message)
  30526. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30527. return True, func(*args, **kwargs)
  30528. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  30529. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30530. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30531. return True, func(*args, **kwargs)
  30532. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30533. return func(*args, **kwargs)
  30534. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  30535. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  30536. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  30537. res = query("AT+QGPSLOC={:d}".format(mode))
  30538. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  30539. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  30540. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  30541. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  30542. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  30543. raise salt.exceptions.CommandExecutionError(message["error"])
  30544. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30545. 2020-08-04 12:52:30,347 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  30546. Traceback (most recent call last):
  30547. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30548. self._serial.open()
  30549. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30550. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30551. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30552. 2020-08-04 12:52:30,894 [messaging :206 ][ERROR ][621] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  30553. Traceback (most recent call last):
  30554. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  30555. self._call_hook_for(message, "workflow", message)
  30556. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30557. return True, func(*args, **kwargs)
  30558. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  30559. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30560. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30561. return True, func(*args, **kwargs)
  30562. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30563. return func(*args, **kwargs)
  30564. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  30565. res = _exec("AT+CCLK?")
  30566. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  30567. conn.write_line(cmd)
  30568. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  30569. self.ensure_open()
  30570. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  30571. self.open()
  30572. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  30573. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  30574. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  30575. raise attempt.get()
  30576. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  30577. six.reraise(self.value[0], self.value[1], self.value[2])
  30578. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  30579. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  30580. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30581. self._serial.open()
  30582. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30583. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30584. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30585. 2020-08-04 12:52:34,856 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  30586. Traceback (most recent call last):
  30587. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30588. self._serial.open()
  30589. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30590. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30591. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30592. 2020-08-04 12:52:35,869 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  30593. Traceback (most recent call last):
  30594. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30595. self._serial.open()
  30596. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30597. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30598. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30599. 2020-08-04 12:52:36,873 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  30600. Traceback (most recent call last):
  30601. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30602. self._serial.open()
  30603. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30604. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30605. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30606. 2020-08-04 12:52:36,876 [messaging :742 ][ERROR ][621] Exception while processing event: {'tag': 'ec2x/req/5e431aee-8ebc-43b7-b775-96ccd227feca', 'data': {'_stamp': '2020-08-04T12:52:34.848655', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/5e431aee-8ebc-43b7-b775-96ccd227feca', 'kwargs': {'cooldown_delay': None}}}
  30607. Traceback (most recent call last):
  30608. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  30609. res = self.process(message)
  30610. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  30611. result = func(message, **settings)
  30612. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  30613. found, result = self._call_hook_for(message, "workflow", message)
  30614. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30615. return True, func(*args, **kwargs)
  30616. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  30617. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30618. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30619. return True, func(*args, **kwargs)
  30620. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30621. return func(*args, **kwargs)
  30622. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  30623. return _exec(cmd, **kwargs)
  30624. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  30625. conn.write_line(cmd)
  30626. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  30627. self.ensure_open()
  30628. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  30629. self.open()
  30630. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  30631. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  30632. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  30633. raise attempt.get()
  30634. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  30635. six.reraise(self.value[0], self.value[1], self.value[2])
  30636. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  30637. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  30638. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30639. self._serial.open()
  30640. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30641. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30642. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30643. 2020-08-04 12:52:36,921 [messaging :206 ][ERROR ][622] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  30644. Traceback (most recent call last):
  30645. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  30646. self._call_hook_for(message, "workflow", message)
  30647. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30648. return True, func(*args, **kwargs)
  30649. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  30650. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30651. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30652. return True, func(*args, **kwargs)
  30653. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30654. return func(*args, **kwargs)
  30655. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  30656. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  30657. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  30658. res = query("AT+QGPSLOC={:d}".format(mode))
  30659. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  30660. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  30661. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  30662. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  30663. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  30664. raise salt.exceptions.CommandExecutionError(message["error"])
  30665. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30666. 2020-08-04 12:52:37,480 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  30667. Traceback (most recent call last):
  30668. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30669. self._serial.open()
  30670. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30671. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30672. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30673. 2020-08-04 12:52:38,486 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  30674. Traceback (most recent call last):
  30675. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30676. self._serial.open()
  30677. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30678. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30679. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30680. 2020-08-04 12:52:39,491 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  30681. Traceback (most recent call last):
  30682. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30683. self._serial.open()
  30684. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30685. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30686. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30687. 2020-08-04 12:52:39,547 [salt.loaded.int.module.cmdmod:693 ][ERROR ][621] Command '['timedatectl', 'set-ntp', '1']' failed with return code: 1
  30688. 2020-08-04 12:52:39,549 [salt.loaded.int.module.cmdmod:697 ][ERROR ][621] stderr: Failed to set ntp: Refusing activation, D-Bus is shutting down.
  30689. 2020-08-04 12:52:39,551 [salt.loaded.int.module.cmdmod:699 ][ERROR ][621] retcode: 1
  30690. 2020-08-04 12:52:39,553 [messaging :208 ][ERROR ][621] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  30691. Traceback (most recent call last):
  30692. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  30693. self._call_hook_for(message, "workflow", message)
  30694. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30695. return True, func(*args, **kwargs)
  30696. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  30697. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30698. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30699. return True, func(*args, **kwargs)
  30700. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30701. return func(*args, **kwargs)
  30702. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 295, in sync_time_handler
  30703. __salt__["clock.ntp"](enable=True)
  30704. File "/var/cache/salt/minion/extmods/modules/clock.py", line 76, in ntp
  30705. raise salt.exceptions.CommandExecutionError(res["stderr"])
  30706. CommandExecutionError: Failed to set ntp: Refusing activation, D-Bus is shutting down.
  30707. 2020-08-04 12:52:40,326 [obd.obd :107 ][ERROR ][660] Failed to use explicit port '/dev/serial0'
  30708. Traceback (most recent call last):
  30709. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  30710. self.interface.open(baudrate, protocol=protocol)
  30711. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  30712. self.set_protocol(prot.pop("id", None), **prot)
  30713. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  30714. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  30715. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  30716. self._protocol = self._auto_protocol(**kwargs)
  30717. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  30718. res_0100 = self._verify_protocol("auto", test=not verify)
  30719. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  30720. for line in self.query("0100", parse=False, read_timeout=10):
  30721. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  30722. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  30723. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  30724. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  30725. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  30726. data = self._port.read(self._port.in_waiting or 1)
  30727. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  30728. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  30729. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  30730. sys.exit(salt.defaults.exitcodes.EX_OK)
  30731. SystemExit: 0
  30732. 2020-08-04 12:52:40,365 [obd.obd :120 ][WARNING ][660] Cannot load commands - no connection to bus
  30733. 2020-08-04 12:52:40,403 [obd.interfaces.elm327:730 ][ERROR ][660] Failed to relay command 'STSLCS' to interface
  30734. Traceback (most recent call last):
  30735. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  30736. lines = self.send(cmd, raw_response=raw_response)
  30737. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  30738. raise ELM327Error(self.ERRORS[line], code=line)
  30739. ELM327Error: Operation interrupted by a received RS232 character
  30740. 2020-08-04 12:52:40,406 [messaging :742 ][ERROR ][660] Exception while processing event: {'tag': 'obd/req/f8d9cfb3-0595-4368-8f94-4f114046004a', 'data': {'_stamp': '2020-08-04T12:52:34.691138', 'handler': 'execute', '_event_tag': 'obd/req/f8d9cfb3-0595-4368-8f94-4f114046004a', 'args': ['STSLCS']}}
  30741. Traceback (most recent call last):
  30742. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  30743. res = self.process(message)
  30744. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  30745. result = func(message, **settings)
  30746. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  30747. found, result = self._call_hook_for(message, "workflow", message)
  30748. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30749. return True, func(*args, **kwargs)
  30750. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  30751. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30752. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30753. return True, func(*args, **kwargs)
  30754. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30755. return func(*args, **kwargs)
  30756. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  30757. res = conn.execute(cmd)
  30758. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  30759. return func(self, *args, **kwargs)
  30760. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  30761. return self._obd.execute(cmd, **kwargs)
  30762. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  30763. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  30764. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  30765. lines = self.send(cmd, raw_response=raw_response)
  30766. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  30767. raise ELM327Error(self.ERRORS[line], code=line)
  30768. ELM327Error: Operation interrupted by a received RS232 character
  30769. 2020-08-04 12:52:41,138 [salt.utils.parsers:1050][WARNING ][420] Minion received a SIGTERM. Exiting.
  30770. 2020-08-04 12:52:41,678 [messaging :871 ][WARNING ][835] No reply message with tag 'obd/res/f8d9cfb3-0595-4368-8f94-4f114046004a' received within timeout of 30 secs
  30771. 2020-08-04 12:52:41,682 [salt.state :292 ][ERROR ][835] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  30772. 2020-08-04 12:52:58,080 [gpio_spi_conn :42 ][WARNING ][626] Unable to clear buffer - got unexpected value: 255
  30773. 2020-08-04 12:52:58,089 [gpio_spi_conn :42 ][WARNING ][626] Unable to clear buffer - got unexpected value: 255
  30774. 2020-08-04 12:52:58,093 [gpio_spi_conn :42 ][WARNING ][626] Unable to clear buffer - got unexpected value: 255
  30775. 2020-08-04 12:52:58,229 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  30776. Traceback (most recent call last):
  30777. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30778. self._serial.open()
  30779. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30780. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30781. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30782. 2020-08-04 12:52:59,244 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  30783. Traceback (most recent call last):
  30784. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30785. self._serial.open()
  30786. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30787. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30788. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30789. 2020-08-04 12:53:00,120 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  30790. 2020-08-04 12:53:00,248 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  30791. Traceback (most recent call last):
  30792. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30793. self._serial.open()
  30794. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30795. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30796. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30797. 2020-08-04 12:53:00,623 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  30798. 2020-08-04 12:53:00,828 [messaging :208 ][ERROR ][623] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  30799. Traceback (most recent call last):
  30800. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  30801. self._call_hook_for(message, "workflow", message)
  30802. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30803. return True, func(*args, **kwargs)
  30804. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  30805. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30806. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30807. return True, func(*args, **kwargs)
  30808. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30809. return func(*args, **kwargs)
  30810. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  30811. res = _exec("AT+CCLK?")
  30812. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  30813. conn.write_line(cmd)
  30814. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  30815. self.ensure_open()
  30816. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  30817. self.open()
  30818. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  30819. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  30820. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  30821. raise attempt.get()
  30822. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  30823. six.reraise(self.value[0], self.value[1], self.value[2])
  30824. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  30825. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  30826. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30827. self._serial.open()
  30828. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30829. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30830. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30831. 2020-08-04 12:53:01,128 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  30832. 2020-08-04 12:53:01,131 [spm_conn :139 ][WARNING ][626] Unable to get status: Expected ack '12' but got '255'
  30833. 2020-08-04 12:53:01,635 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  30834. 2020-08-04 12:53:02,139 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  30835. 2020-08-04 12:53:02,642 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  30836. 2020-08-04 12:53:02,644 [spm_conn :139 ][WARNING ][626] Unable to get status: Expected ack '12' but got '255'
  30837. 2020-08-04 12:53:03,148 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  30838. 2020-08-04 12:53:03,651 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  30839. 2020-08-04 12:53:04,155 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  30840. 2020-08-04 12:53:04,158 [spm_conn :139 ][WARNING ][626] Unable to get status: Expected ack '12' but got '255'
  30841. 2020-08-04 12:53:04,162 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  30842. 2020-08-04 12:53:04,666 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  30843. 2020-08-04 12:53:05,169 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  30844. 2020-08-04 12:53:05,172 [spm_conn :82 ][WARNING ][626] Unable to send noop: Expected ack '12' but got '255'
  30845. 2020-08-04 12:53:05,387 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  30846. Traceback (most recent call last):
  30847. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30848. self._serial.open()
  30849. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30850. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30851. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30852. 2020-08-04 12:53:05,677 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  30853. 2020-08-04 12:53:06,180 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  30854. 2020-08-04 12:53:06,421 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  30855. Traceback (most recent call last):
  30856. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30857. self._serial.open()
  30858. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30859. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30860. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30861. 2020-08-04 12:53:06,683 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  30862. 2020-08-04 12:53:06,686 [spm_conn :82 ][WARNING ][626] Unable to send noop: Expected ack '12' but got '255'
  30863. 2020-08-04 12:53:07,190 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  30864. 2020-08-04 12:53:07,434 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  30865. Traceback (most recent call last):
  30866. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30867. self._serial.open()
  30868. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30869. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30870. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30871. 2020-08-04 12:53:07,447 [messaging :742 ][ERROR ][623] Exception while processing event: {'tag': 'ec2x/req/236364b5-c06c-4233-b9e3-e59308ef991b', 'data': {'_stamp': '2020-08-04T12:52:58.160569', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/236364b5-c06c-4233-b9e3-e59308ef991b', 'kwargs': {'cooldown_delay': None}}}
  30872. Traceback (most recent call last):
  30873. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  30874. res = self.process(message)
  30875. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  30876. result = func(message, **settings)
  30877. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  30878. found, result = self._call_hook_for(message, "workflow", message)
  30879. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30880. return True, func(*args, **kwargs)
  30881. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  30882. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30883. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30884. return True, func(*args, **kwargs)
  30885. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30886. return func(*args, **kwargs)
  30887. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  30888. return _exec(cmd, **kwargs)
  30889. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  30890. conn.write_line(cmd)
  30891. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  30892. self.ensure_open()
  30893. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  30894. self.open()
  30895. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  30896. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  30897. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  30898. raise attempt.get()
  30899. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  30900. six.reraise(self.value[0], self.value[1], self.value[2])
  30901. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  30902. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  30903. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30904. self._serial.open()
  30905. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30906. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30907. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30908. 2020-08-04 12:53:07,694 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  30909. 2020-08-04 12:53:08,081 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  30910. Traceback (most recent call last):
  30911. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30912. self._serial.open()
  30913. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30914. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30915. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30916. 2020-08-04 12:53:08,201 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  30917. 2020-08-04 12:53:08,203 [spm_conn :82 ][WARNING ][626] Unable to send noop: Expected ack '12' but got '255'
  30918. 2020-08-04 12:53:08,206 [messaging :208 ][ERROR ][626] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  30919. Traceback (most recent call last):
  30920. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  30921. self._call_hook_for(message, "workflow", message)
  30922. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30923. return True, func(*args, **kwargs)
  30924. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  30925. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30926. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30927. return True, func(*args, **kwargs)
  30928. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30929. return func(*args, **kwargs)
  30930. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  30931. conn.heartbeat()
  30932. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  30933. self.noop()
  30934. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  30935. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  30936. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  30937. raise attempt.get()
  30938. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  30939. six.reraise(self.value[0], self.value[1], self.value[2])
  30940. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  30941. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  30942. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  30943. self._begin_message()
  30944. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  30945. self.recv(ack=ACK_MESSAGE_BEGIN)
  30946. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  30947. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  30948. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  30949. raise attempt.get()
  30950. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  30951. six.reraise(self.value[0], self.value[1], self.value[2])
  30952. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  30953. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  30954. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  30955. raise Exception(msg)
  30956. Exception: Expected ack '12' but got '255'
  30957. 2020-08-04 12:53:09,086 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  30958. Traceback (most recent call last):
  30959. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30960. self._serial.open()
  30961. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30962. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30963. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30964. 2020-08-04 12:53:09,626 [messaging :208 ][ERROR ][624] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  30965. Traceback (most recent call last):
  30966. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  30967. self._call_hook_for(message, "workflow", message)
  30968. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30969. return True, func(*args, **kwargs)
  30970. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  30971. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  30972. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30973. return True, func(*args, **kwargs)
  30974. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  30975. return func(*args, **kwargs)
  30976. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  30977. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  30978. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  30979. res = query("AT+QGPSLOC={:d}".format(mode))
  30980. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  30981. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  30982. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  30983. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  30984. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  30985. raise salt.exceptions.CommandExecutionError(message["error"])
  30986. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30987. 2020-08-04 12:53:10,090 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  30988. Traceback (most recent call last):
  30989. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  30990. self._serial.open()
  30991. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  30992. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  30993. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  30994. 2020-08-04 12:53:10,591 [messaging :206 ][ERROR ][623] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  30995. Traceback (most recent call last):
  30996. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  30997. self._call_hook_for(message, "workflow", message)
  30998. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  30999. return True, func(*args, **kwargs)
  31000. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  31001. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31002. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31003. return True, func(*args, **kwargs)
  31004. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31005. return func(*args, **kwargs)
  31006. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  31007. res = _exec("AT+CCLK?")
  31008. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  31009. conn.write_line(cmd)
  31010. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  31011. self.ensure_open()
  31012. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  31013. self.open()
  31014. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  31015. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  31016. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  31017. raise attempt.get()
  31018. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  31019. six.reraise(self.value[0], self.value[1], self.value[2])
  31020. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  31021. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  31022. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31023. self._serial.open()
  31024. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31025. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31026. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31027. 2020-08-04 12:53:40,661 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][649] Timeout after 1.28205128205 second(s) waiting for interrupt
  31028. 2020-08-04 12:53:40,705 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  31029. Traceback (most recent call last):
  31030. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31031. self._serial.open()
  31032. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31033. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31034. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31035. 2020-08-04 12:53:41,721 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  31036. Traceback (most recent call last):
  31037. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31038. self._serial.open()
  31039. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31040. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31041. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31042. 2020-08-04 12:53:42,725 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  31043. Traceback (most recent call last):
  31044. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31045. self._serial.open()
  31046. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31047. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31048. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31049. 2020-08-04 12:53:42,728 [messaging :206 ][ERROR ][623] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  31050. Traceback (most recent call last):
  31051. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  31052. self._call_hook_for(message, "workflow", message)
  31053. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31054. return True, func(*args, **kwargs)
  31055. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  31056. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31057. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31058. return True, func(*args, **kwargs)
  31059. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31060. return func(*args, **kwargs)
  31061. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  31062. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  31063. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  31064. conn.write_line(cmd)
  31065. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  31066. self.ensure_open()
  31067. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  31068. self.open()
  31069. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  31070. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  31071. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  31072. raise attempt.get()
  31073. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  31074. six.reraise(self.value[0], self.value[1], self.value[2])
  31075. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  31076. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  31077. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31078. self._serial.open()
  31079. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31080. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31081. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31082. 2020-08-04 12:53:42,738 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  31083. Traceback (most recent call last):
  31084. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31085. self._serial.open()
  31086. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31087. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31088. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31089. 2020-08-04 12:53:43,742 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  31090. Traceback (most recent call last):
  31091. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31092. self._serial.open()
  31093. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31094. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31095. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31096. 2020-08-04 12:53:44,747 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  31097. Traceback (most recent call last):
  31098. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31099. self._serial.open()
  31100. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31101. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31102. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31103. 2020-08-04 12:53:44,751 [messaging :742 ][ERROR ][623] Exception while processing event: {'tag': 'ec2x/req/4189bf98-9fb9-4db3-85fb-e9cc56ecb6c8', 'data': {'_stamp': '2020-08-04T12:53:40.671294', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/4189bf98-9fb9-4db3-85fb-e9cc56ecb6c8', 'kwargs': {'cooldown_delay': None}}}
  31104. Traceback (most recent call last):
  31105. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  31106. res = self.process(message)
  31107. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  31108. result = func(message, **settings)
  31109. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  31110. found, result = self._call_hook_for(message, "workflow", message)
  31111. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31112. return True, func(*args, **kwargs)
  31113. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  31114. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31115. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31116. return True, func(*args, **kwargs)
  31117. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31118. return func(*args, **kwargs)
  31119. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  31120. return _exec(cmd, **kwargs)
  31121. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  31122. conn.write_line(cmd)
  31123. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  31124. self.ensure_open()
  31125. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  31126. self.open()
  31127. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  31128. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  31129. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  31130. raise attempt.get()
  31131. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  31132. six.reraise(self.value[0], self.value[1], self.value[2])
  31133. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  31134. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  31135. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31136. self._serial.open()
  31137. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31138. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31139. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31140. 2020-08-04 12:53:44,785 [messaging :206 ][ERROR ][624] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  31141. Traceback (most recent call last):
  31142. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  31143. self._call_hook_for(message, "workflow", message)
  31144. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31145. return True, func(*args, **kwargs)
  31146. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  31147. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31148. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31149. return True, func(*args, **kwargs)
  31150. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31151. return func(*args, **kwargs)
  31152. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  31153. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  31154. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  31155. res = query("AT+QGPSLOC={:d}".format(mode))
  31156. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  31157. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  31158. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  31159. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  31160. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  31161. raise salt.exceptions.CommandExecutionError(message["error"])
  31162. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31163. 2020-08-04 12:53:49,958 [obd.obd :107 ][ERROR ][647] Failed to use explicit port '/dev/serial0'
  31164. Traceback (most recent call last):
  31165. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  31166. self.interface.open(baudrate, protocol=protocol)
  31167. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  31168. self.set_protocol(prot.pop("id", None), **prot)
  31169. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  31170. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  31171. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  31172. self._protocol = self._auto_protocol(**kwargs)
  31173. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  31174. res_0100 = self._verify_protocol("auto", test=not verify)
  31175. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  31176. for line in self.query("0100", parse=False, read_timeout=10):
  31177. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  31178. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  31179. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  31180. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  31181. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  31182. data = self._port.read(self._port.in_waiting or 1)
  31183. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  31184. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  31185. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  31186. sys.exit(salt.defaults.exitcodes.EX_OK)
  31187. SystemExit: 0
  31188. 2020-08-04 12:53:49,983 [obd.obd :120 ][WARNING ][647] Cannot load commands - no connection to bus
  31189. 2020-08-04 12:53:50,010 [obd.interfaces.elm327:730 ][ERROR ][647] Failed to relay command 'STSLCS' to interface
  31190. Traceback (most recent call last):
  31191. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  31192. lines = self.send(cmd, raw_response=raw_response)
  31193. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  31194. raise ELM327Error(self.ERRORS[line], code=line)
  31195. ELM327Error: Operation interrupted by a received RS232 character
  31196. 2020-08-04 12:53:50,014 [messaging :742 ][ERROR ][647] Exception while processing event: {'tag': 'obd/req/dc4ecc62-493c-403c-b6ad-bc63d19a1bfa', 'data': {'_stamp': '2020-08-04T12:53:44.373810', 'handler': 'execute', '_event_tag': 'obd/req/dc4ecc62-493c-403c-b6ad-bc63d19a1bfa', 'args': ['STSLCS']}}
  31197. Traceback (most recent call last):
  31198. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  31199. res = self.process(message)
  31200. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  31201. result = func(message, **settings)
  31202. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  31203. found, result = self._call_hook_for(message, "workflow", message)
  31204. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31205. return True, func(*args, **kwargs)
  31206. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  31207. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31208. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31209. return True, func(*args, **kwargs)
  31210. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31211. return func(*args, **kwargs)
  31212. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  31213. res = conn.execute(cmd)
  31214. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  31215. return func(self, *args, **kwargs)
  31216. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  31217. return self._obd.execute(cmd, **kwargs)
  31218. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  31219. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  31220. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  31221. lines = self.send(cmd, raw_response=raw_response)
  31222. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  31223. raise ELM327Error(self.ERRORS[line], code=line)
  31224. ELM327Error: Operation interrupted by a received RS232 character
  31225. 2020-08-04 12:53:50,719 [salt.utils.parsers:1050][WARNING ][423] Minion received a SIGTERM. Exiting.
  31226. 2020-08-04 12:53:51,258 [messaging :871 ][WARNING ][823] No reply message with tag 'obd/res/dc4ecc62-493c-403c-b6ad-bc63d19a1bfa' received within timeout of 30 secs
  31227. 2020-08-04 12:53:51,264 [salt.state :292 ][ERROR ][823] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  31228. 2020-08-04 12:54:08,110 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  31229. 2020-08-04 12:54:08,121 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  31230. 2020-08-04 12:54:08,129 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  31231. 2020-08-04 12:54:08,744 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  31232. Traceback (most recent call last):
  31233. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31234. self._serial.open()
  31235. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31236. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31237. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31238. 2020-08-04 12:54:09,755 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  31239. Traceback (most recent call last):
  31240. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31241. self._serial.open()
  31242. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31243. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31244. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31245. 2020-08-04 12:54:10,163 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  31246. 2020-08-04 12:54:10,666 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  31247. 2020-08-04 12:54:10,759 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  31248. Traceback (most recent call last):
  31249. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31250. self._serial.open()
  31251. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31252. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31253. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31254. 2020-08-04 12:54:11,170 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  31255. 2020-08-04 12:54:11,172 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  31256. 2020-08-04 12:54:11,435 [messaging :208 ][ERROR ][621] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  31257. Traceback (most recent call last):
  31258. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  31259. self._call_hook_for(message, "workflow", message)
  31260. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31261. return True, func(*args, **kwargs)
  31262. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  31263. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31264. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31265. return True, func(*args, **kwargs)
  31266. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31267. return func(*args, **kwargs)
  31268. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  31269. res = _exec("AT+CCLK?")
  31270. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  31271. conn.write_line(cmd)
  31272. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  31273. self.ensure_open()
  31274. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  31275. self.open()
  31276. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  31277. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  31278. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  31279. raise attempt.get()
  31280. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  31281. six.reraise(self.value[0], self.value[1], self.value[2])
  31282. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  31283. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  31284. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31285. self._serial.open()
  31286. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31287. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31288. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31289. 2020-08-04 12:54:11,676 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  31290. 2020-08-04 12:54:26,353 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][711] Timeout after 1.28205128205 second(s) waiting for interrupt
  31291. 2020-08-04 12:54:26,417 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  31292. Traceback (most recent call last):
  31293. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31294. self._serial.open()
  31295. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31296. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31297. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31298. 2020-08-04 12:54:26,728 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  31299. 2020-08-04 12:54:27,231 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  31300. 2020-08-04 12:54:27,233 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  31301. 2020-08-04 12:54:27,422 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  31302. Traceback (most recent call last):
  31303. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31304. self._serial.open()
  31305. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31306. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31307. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31308. 2020-08-04 12:54:27,737 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  31309. 2020-08-04 12:54:28,240 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  31310. 2020-08-04 12:54:28,426 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  31311. Traceback (most recent call last):
  31312. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31313. self._serial.open()
  31314. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31315. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31316. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31317. 2020-08-04 12:54:28,429 [messaging :206 ][ERROR ][621] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  31318. Traceback (most recent call last):
  31319. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  31320. self._call_hook_for(message, "workflow", message)
  31321. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31322. return True, func(*args, **kwargs)
  31323. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  31324. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31325. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31326. return True, func(*args, **kwargs)
  31327. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31328. return func(*args, **kwargs)
  31329. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  31330. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  31331. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  31332. conn.write_line(cmd)
  31333. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  31334. self.ensure_open()
  31335. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  31336. self.open()
  31337. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  31338. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  31339. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  31340. raise attempt.get()
  31341. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  31342. six.reraise(self.value[0], self.value[1], self.value[2])
  31343. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  31344. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  31345. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31346. self._serial.open()
  31347. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31348. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31349. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31350. 2020-08-04 12:54:28,744 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  31351. 2020-08-04 12:54:28,746 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  31352. 2020-08-04 12:54:28,749 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  31353. 2020-08-04 12:54:29,252 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  31354. 2020-08-04 12:54:29,755 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  31355. 2020-08-04 12:54:29,758 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  31356. 2020-08-04 12:54:30,137 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  31357. Traceback (most recent call last):
  31358. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31359. self._serial.open()
  31360. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31361. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31362. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31363. 2020-08-04 12:54:30,261 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  31364. 2020-08-04 12:54:30,764 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  31365. 2020-08-04 12:54:31,142 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  31366. Traceback (most recent call last):
  31367. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31368. self._serial.open()
  31369. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31370. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31371. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31372. 2020-08-04 12:54:31,270 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  31373. 2020-08-04 12:54:31,274 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  31374. 2020-08-04 12:54:31,779 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  31375. 2020-08-04 12:54:32,146 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  31376. Traceback (most recent call last):
  31377. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31378. self._serial.open()
  31379. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31380. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31381. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31382. 2020-08-04 12:54:32,157 [messaging :742 ][ERROR ][621] Exception while processing event: {'tag': 'ec2x/req/c4f0dde6-a489-4384-bd2b-5bc29d683ef1', 'data': {'_stamp': '2020-08-04T12:54:08.181633', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/c4f0dde6-a489-4384-bd2b-5bc29d683ef1', 'kwargs': {'cooldown_delay': None}}}
  31383. Traceback (most recent call last):
  31384. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  31385. res = self.process(message)
  31386. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  31387. result = func(message, **settings)
  31388. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  31389. found, result = self._call_hook_for(message, "workflow", message)
  31390. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31391. return True, func(*args, **kwargs)
  31392. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  31393. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31394. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31395. return True, func(*args, **kwargs)
  31396. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31397. return func(*args, **kwargs)
  31398. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  31399. return _exec(cmd, **kwargs)
  31400. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  31401. conn.write_line(cmd)
  31402. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  31403. self.ensure_open()
  31404. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  31405. self.open()
  31406. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  31407. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  31408. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  31409. raise attempt.get()
  31410. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  31411. six.reraise(self.value[0], self.value[1], self.value[2])
  31412. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  31413. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  31414. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31415. self._serial.open()
  31416. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31417. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31418. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31419. 2020-08-04 12:54:32,284 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  31420. 2020-08-04 12:54:32,788 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  31421. 2020-08-04 12:54:32,790 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  31422. 2020-08-04 12:54:32,792 [messaging :208 ][ERROR ][624] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  31423. Traceback (most recent call last):
  31424. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  31425. self._call_hook_for(message, "workflow", message)
  31426. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31427. return True, func(*args, **kwargs)
  31428. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  31429. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31430. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31431. return True, func(*args, **kwargs)
  31432. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31433. return func(*args, **kwargs)
  31434. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  31435. conn.heartbeat()
  31436. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  31437. self.noop()
  31438. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  31439. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  31440. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  31441. raise attempt.get()
  31442. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  31443. six.reraise(self.value[0], self.value[1], self.value[2])
  31444. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  31445. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  31446. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  31447. self._begin_message()
  31448. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  31449. self.recv(ack=ACK_MESSAGE_BEGIN)
  31450. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  31451. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  31452. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  31453. raise attempt.get()
  31454. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  31455. six.reraise(self.value[0], self.value[1], self.value[2])
  31456. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  31457. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  31458. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  31459. raise Exception(msg)
  31460. Exception: Expected ack '12' but got '255'
  31461. 2020-08-04 12:54:34,271 [messaging :208 ][ERROR ][622] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  31462. Traceback (most recent call last):
  31463. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  31464. self._call_hook_for(message, "workflow", message)
  31465. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31466. return True, func(*args, **kwargs)
  31467. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  31468. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31469. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31470. return True, func(*args, **kwargs)
  31471. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31472. return func(*args, **kwargs)
  31473. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  31474. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  31475. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  31476. res = query("AT+QGPSLOC={:d}".format(mode))
  31477. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  31478. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  31479. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  31480. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  31481. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  31482. raise salt.exceptions.CommandExecutionError(message["error"])
  31483. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31484. 2020-08-04 12:54:39,318 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  31485. Traceback (most recent call last):
  31486. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31487. self._serial.open()
  31488. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31489. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31490. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31491. 2020-08-04 12:54:40,327 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  31492. Traceback (most recent call last):
  31493. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31494. self._serial.open()
  31495. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31496. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31497. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31498. 2020-08-04 12:54:41,331 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  31499. Traceback (most recent call last):
  31500. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31501. self._serial.open()
  31502. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31503. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31504. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31505. 2020-08-04 12:54:41,334 [messaging :742 ][ERROR ][621] Exception while processing event: {'tag': 'ec2x/req/ac5f7eff-7465-4f34-8247-0cc515094bdc', 'data': {'_stamp': '2020-08-04T12:54:39.309131', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/ac5f7eff-7465-4f34-8247-0cc515094bdc', 'kwargs': {'cooldown_delay': None}}}
  31506. Traceback (most recent call last):
  31507. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  31508. res = self.process(message)
  31509. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  31510. result = func(message, **settings)
  31511. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  31512. found, result = self._call_hook_for(message, "workflow", message)
  31513. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31514. return True, func(*args, **kwargs)
  31515. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  31516. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31517. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31518. return True, func(*args, **kwargs)
  31519. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31520. return func(*args, **kwargs)
  31521. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  31522. return _exec(cmd, **kwargs)
  31523. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  31524. conn.write_line(cmd)
  31525. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  31526. self.ensure_open()
  31527. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  31528. self.open()
  31529. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  31530. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  31531. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  31532. raise attempt.get()
  31533. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  31534. six.reraise(self.value[0], self.value[1], self.value[2])
  31535. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  31536. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  31537. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31538. self._serial.open()
  31539. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31540. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31541. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31542. 2020-08-04 12:54:41,360 [messaging :206 ][ERROR ][622] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  31543. Traceback (most recent call last):
  31544. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  31545. self._call_hook_for(message, "workflow", message)
  31546. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31547. return True, func(*args, **kwargs)
  31548. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  31549. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31550. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31551. return True, func(*args, **kwargs)
  31552. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31553. return func(*args, **kwargs)
  31554. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  31555. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  31556. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  31557. res = query("AT+QGPSLOC={:d}".format(mode))
  31558. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  31559. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  31560. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  31561. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  31562. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  31563. raise salt.exceptions.CommandExecutionError(message["error"])
  31564. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31565. 2020-08-04 12:54:44,387 [obd.obd :107 ][ERROR ][709] Failed to use explicit port '/dev/serial0'
  31566. Traceback (most recent call last):
  31567. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  31568. self.interface.open(baudrate, protocol=protocol)
  31569. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  31570. self.set_protocol(prot.pop("id", None), **prot)
  31571. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  31572. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  31573. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  31574. self._protocol = self._auto_protocol(**kwargs)
  31575. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  31576. res_0100 = self._verify_protocol("auto", test=not verify)
  31577. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  31578. for line in self.query("0100", parse=False, read_timeout=10):
  31579. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  31580. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  31581. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  31582. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  31583. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  31584. data = self._port.read(self._port.in_waiting or 1)
  31585. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  31586. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  31587. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  31588. sys.exit(salt.defaults.exitcodes.EX_OK)
  31589. SystemExit: 0
  31590. 2020-08-04 12:54:44,424 [obd.obd :120 ][WARNING ][709] Cannot load commands - no connection to bus
  31591. 2020-08-04 12:54:44,451 [obd.interfaces.elm327:730 ][ERROR ][709] Failed to relay command 'STSLCS' to interface
  31592. Traceback (most recent call last):
  31593. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  31594. lines = self.send(cmd, raw_response=raw_response)
  31595. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  31596. raise ELM327Error(self.ERRORS[line], code=line)
  31597. ELM327Error: Operation interrupted by a received RS232 character
  31598. 2020-08-04 12:54:44,455 [messaging :742 ][ERROR ][709] Exception while processing event: {'tag': 'obd/req/72f9a36d-44c4-4f0c-8587-0dfe31817c4e', 'data': {'_stamp': '2020-08-04T12:54:39.153194', 'handler': 'execute', '_event_tag': 'obd/req/72f9a36d-44c4-4f0c-8587-0dfe31817c4e', 'args': ['STSLCS']}}
  31599. Traceback (most recent call last):
  31600. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  31601. res = self.process(message)
  31602. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  31603. result = func(message, **settings)
  31604. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  31605. found, result = self._call_hook_for(message, "workflow", message)
  31606. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31607. return True, func(*args, **kwargs)
  31608. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  31609. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31610. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31611. return True, func(*args, **kwargs)
  31612. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31613. return func(*args, **kwargs)
  31614. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  31615. res = conn.execute(cmd)
  31616. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  31617. return func(self, *args, **kwargs)
  31618. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  31619. return self._obd.execute(cmd, **kwargs)
  31620. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  31621. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  31622. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  31623. lines = self.send(cmd, raw_response=raw_response)
  31624. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  31625. raise ELM327Error(self.ERRORS[line], code=line)
  31626. ELM327Error: Operation interrupted by a received RS232 character
  31627. 2020-08-04 12:54:45,146 [salt.utils.parsers:1050][WARNING ][420] Minion received a SIGTERM. Exiting.
  31628. 2020-08-04 12:54:45,687 [messaging :871 ][WARNING ][821] No reply message with tag 'obd/res/72f9a36d-44c4-4f0c-8587-0dfe31817c4e' received within timeout of 30 secs
  31629. 2020-08-04 12:54:45,691 [salt.state :292 ][ERROR ][821] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  31630. 2020-08-04 12:55:01,924 [gpio_spi_conn :42 ][WARNING ][615] Unable to clear buffer - got unexpected value: 255
  31631. 2020-08-04 12:55:01,933 [gpio_spi_conn :42 ][WARNING ][615] Unable to clear buffer - got unexpected value: 255
  31632. 2020-08-04 12:55:01,940 [gpio_spi_conn :42 ][WARNING ][615] Unable to clear buffer - got unexpected value: 255
  31633. 2020-08-04 12:55:02,616 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  31634. Traceback (most recent call last):
  31635. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31636. self._serial.open()
  31637. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31638. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31639. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31640. 2020-08-04 12:55:03,629 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  31641. Traceback (most recent call last):
  31642. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31643. self._serial.open()
  31644. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31645. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31646. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31647. 2020-08-04 12:55:03,970 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  31648. 2020-08-04 12:55:04,473 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  31649. 2020-08-04 12:55:04,633 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  31650. Traceback (most recent call last):
  31651. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31652. self._serial.open()
  31653. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31654. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31655. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31656. 2020-08-04 12:55:04,976 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  31657. 2020-08-04 12:55:04,978 [spm_conn :139 ][WARNING ][615] Unable to get status: Expected ack '12' but got '255'
  31658. 2020-08-04 12:55:05,188 [messaging :208 ][ERROR ][612] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  31659. Traceback (most recent call last):
  31660. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  31661. self._call_hook_for(message, "workflow", message)
  31662. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31663. return True, func(*args, **kwargs)
  31664. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  31665. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31666. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31667. return True, func(*args, **kwargs)
  31668. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31669. return func(*args, **kwargs)
  31670. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  31671. res = _exec("AT+CCLK?")
  31672. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  31673. conn.write_line(cmd)
  31674. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  31675. self.ensure_open()
  31676. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  31677. self.open()
  31678. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  31679. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  31680. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  31681. raise attempt.get()
  31682. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  31683. six.reraise(self.value[0], self.value[1], self.value[2])
  31684. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  31685. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  31686. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31687. self._serial.open()
  31688. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31689. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31690. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31691. 2020-08-04 12:55:05,482 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  31692. 2020-08-04 12:55:20,599 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][650] Timeout after 1.28205128205 second(s) waiting for interrupt
  31693. 2020-08-04 12:55:20,650 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  31694. Traceback (most recent call last):
  31695. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31696. self._serial.open()
  31697. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31698. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31699. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31700. 2020-08-04 12:55:20,894 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  31701. 2020-08-04 12:55:21,398 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  31702. 2020-08-04 12:55:21,400 [spm_conn :139 ][WARNING ][615] Unable to get status: Expected ack '12' but got '255'
  31703. 2020-08-04 12:55:21,665 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  31704. Traceback (most recent call last):
  31705. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31706. self._serial.open()
  31707. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31708. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31709. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31710. 2020-08-04 12:55:21,904 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  31711. 2020-08-04 12:55:22,407 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  31712. 2020-08-04 12:55:22,669 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  31713. Traceback (most recent call last):
  31714. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31715. self._serial.open()
  31716. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31717. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31718. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31719. 2020-08-04 12:55:22,672 [messaging :206 ][ERROR ][612] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  31720. Traceback (most recent call last):
  31721. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  31722. self._call_hook_for(message, "workflow", message)
  31723. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31724. return True, func(*args, **kwargs)
  31725. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  31726. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31727. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31728. return True, func(*args, **kwargs)
  31729. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31730. return func(*args, **kwargs)
  31731. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  31732. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  31733. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  31734. conn.write_line(cmd)
  31735. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  31736. self.ensure_open()
  31737. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  31738. self.open()
  31739. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  31740. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  31741. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  31742. raise attempt.get()
  31743. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  31744. six.reraise(self.value[0], self.value[1], self.value[2])
  31745. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  31746. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  31747. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31748. self._serial.open()
  31749. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31750. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31751. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31752. 2020-08-04 12:55:22,910 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  31753. 2020-08-04 12:55:22,913 [spm_conn :139 ][WARNING ][615] Unable to get status: Expected ack '12' but got '255'
  31754. 2020-08-04 12:55:22,916 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  31755. 2020-08-04 12:55:23,420 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  31756. 2020-08-04 12:55:23,923 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  31757. 2020-08-04 12:55:23,925 [spm_conn :82 ][WARNING ][615] Unable to send noop: Expected ack '12' but got '255'
  31758. 2020-08-04 12:55:24,330 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  31759. Traceback (most recent call last):
  31760. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31761. self._serial.open()
  31762. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31763. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31764. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31765. 2020-08-04 12:55:24,441 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  31766. 2020-08-04 12:55:24,945 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  31767. 2020-08-04 12:55:25,334 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  31768. Traceback (most recent call last):
  31769. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31770. self._serial.open()
  31771. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31772. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31773. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31774. 2020-08-04 12:55:25,448 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  31775. 2020-08-04 12:55:25,451 [spm_conn :82 ][WARNING ][615] Unable to send noop: Expected ack '12' but got '255'
  31776. 2020-08-04 12:55:25,955 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  31777. 2020-08-04 12:55:26,338 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  31778. Traceback (most recent call last):
  31779. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31780. self._serial.open()
  31781. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31782. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31783. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31784. 2020-08-04 12:55:26,349 [messaging :742 ][ERROR ][612] Exception while processing event: {'tag': 'ec2x/req/8f59f62f-741d-4eaa-b083-f5fbbb6b7363', 'data': {'_stamp': '2020-08-04T12:55:02.010374', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/8f59f62f-741d-4eaa-b083-f5fbbb6b7363', 'kwargs': {'cooldown_delay': None}}}
  31785. Traceback (most recent call last):
  31786. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  31787. res = self.process(message)
  31788. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  31789. result = func(message, **settings)
  31790. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  31791. found, result = self._call_hook_for(message, "workflow", message)
  31792. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31793. return True, func(*args, **kwargs)
  31794. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  31795. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31796. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31797. return True, func(*args, **kwargs)
  31798. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31799. return func(*args, **kwargs)
  31800. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  31801. return _exec(cmd, **kwargs)
  31802. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  31803. conn.write_line(cmd)
  31804. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  31805. self.ensure_open()
  31806. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  31807. self.open()
  31808. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  31809. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  31810. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  31811. raise attempt.get()
  31812. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  31813. six.reraise(self.value[0], self.value[1], self.value[2])
  31814. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  31815. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  31816. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31817. self._serial.open()
  31818. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31819. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31820. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31821. 2020-08-04 12:55:26,458 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  31822. 2020-08-04 12:55:26,961 [gpio_spi_conn :109 ][WARNING ][615] Expected ack '12' but got '255'
  31823. 2020-08-04 12:55:26,964 [spm_conn :82 ][WARNING ][615] Unable to send noop: Expected ack '12' but got '255'
  31824. 2020-08-04 12:55:26,967 [messaging :208 ][ERROR ][615] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  31825. Traceback (most recent call last):
  31826. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  31827. self._call_hook_for(message, "workflow", message)
  31828. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31829. return True, func(*args, **kwargs)
  31830. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  31831. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31832. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31833. return True, func(*args, **kwargs)
  31834. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31835. return func(*args, **kwargs)
  31836. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  31837. conn.heartbeat()
  31838. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  31839. self.noop()
  31840. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  31841. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  31842. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  31843. raise attempt.get()
  31844. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  31845. six.reraise(self.value[0], self.value[1], self.value[2])
  31846. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  31847. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  31848. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  31849. self._begin_message()
  31850. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  31851. self.recv(ack=ACK_MESSAGE_BEGIN)
  31852. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  31853. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  31854. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  31855. raise attempt.get()
  31856. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  31857. six.reraise(self.value[0], self.value[1], self.value[2])
  31858. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  31859. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  31860. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  31861. raise Exception(msg)
  31862. Exception: Expected ack '12' but got '255'
  31863. 2020-08-04 12:55:28,476 [messaging :208 ][ERROR ][613] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  31864. Traceback (most recent call last):
  31865. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  31866. self._call_hook_for(message, "workflow", message)
  31867. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31868. return True, func(*args, **kwargs)
  31869. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  31870. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31871. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31872. return True, func(*args, **kwargs)
  31873. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31874. return func(*args, **kwargs)
  31875. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  31876. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  31877. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  31878. res = query("AT+QGPSLOC={:d}".format(mode))
  31879. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  31880. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  31881. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  31882. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  31883. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  31884. raise salt.exceptions.CommandExecutionError(message["error"])
  31885. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31886. 2020-08-04 12:55:33,530 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  31887. Traceback (most recent call last):
  31888. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31889. self._serial.open()
  31890. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31891. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31892. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31893. 2020-08-04 12:55:34,546 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  31894. Traceback (most recent call last):
  31895. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31896. self._serial.open()
  31897. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31898. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31899. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31900. 2020-08-04 12:55:35,550 [serial_conn :79 ][ERROR ][612] Failed to open serial connection
  31901. Traceback (most recent call last):
  31902. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31903. self._serial.open()
  31904. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31905. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31906. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31907. 2020-08-04 12:55:35,553 [messaging :742 ][ERROR ][612] Exception while processing event: {'tag': 'ec2x/req/ab32ce80-70f5-439e-a188-53f1fbc48cda', 'data': {'_stamp': '2020-08-04T12:55:33.523894', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/ab32ce80-70f5-439e-a188-53f1fbc48cda', 'kwargs': {'cooldown_delay': None}}}
  31908. Traceback (most recent call last):
  31909. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  31910. res = self.process(message)
  31911. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  31912. result = func(message, **settings)
  31913. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  31914. found, result = self._call_hook_for(message, "workflow", message)
  31915. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31916. return True, func(*args, **kwargs)
  31917. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  31918. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31919. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31920. return True, func(*args, **kwargs)
  31921. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31922. return func(*args, **kwargs)
  31923. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  31924. return _exec(cmd, **kwargs)
  31925. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  31926. conn.write_line(cmd)
  31927. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  31928. self.ensure_open()
  31929. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  31930. self.open()
  31931. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  31932. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  31933. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  31934. raise attempt.get()
  31935. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  31936. six.reraise(self.value[0], self.value[1], self.value[2])
  31937. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  31938. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  31939. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  31940. self._serial.open()
  31941. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  31942. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  31943. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31944. 2020-08-04 12:55:35,586 [messaging :206 ][ERROR ][613] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  31945. Traceback (most recent call last):
  31946. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  31947. self._call_hook_for(message, "workflow", message)
  31948. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31949. return True, func(*args, **kwargs)
  31950. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  31951. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  31952. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  31953. return True, func(*args, **kwargs)
  31954. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  31955. return func(*args, **kwargs)
  31956. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  31957. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  31958. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  31959. res = query("AT+QGPSLOC={:d}".format(mode))
  31960. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  31961. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  31962. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  31963. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  31964. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  31965. raise salt.exceptions.CommandExecutionError(message["error"])
  31966. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  31967. 2020-08-04 12:55:38,785 [obd.obd :107 ][ERROR ][649] Failed to use explicit port '/dev/serial0'
  31968. Traceback (most recent call last):
  31969. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  31970. self.interface.open(baudrate, protocol=protocol)
  31971. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  31972. self.set_protocol(prot.pop("id", None), **prot)
  31973. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  31974. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  31975. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  31976. self._protocol = self._auto_protocol(**kwargs)
  31977. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  31978. res_0100 = self._verify_protocol("auto", test=not verify)
  31979. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  31980. for line in self.query("0100", parse=False, read_timeout=10):
  31981. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  31982. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  31983. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  31984. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  31985. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  31986. data = self._port.read(self._port.in_waiting or 1)
  31987. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  31988. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  31989. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  31990. sys.exit(salt.defaults.exitcodes.EX_OK)
  31991. SystemExit: 0
  31992. 2020-08-04 12:55:38,825 [obd.obd :120 ][WARNING ][649] Cannot load commands - no connection to bus
  31993. 2020-08-04 12:55:38,854 [obd.interfaces.elm327:730 ][ERROR ][649] Failed to relay command 'STSLCS' to interface
  31994. Traceback (most recent call last):
  31995. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  31996. lines = self.send(cmd, raw_response=raw_response)
  31997. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  31998. raise ELM327Error(self.ERRORS[line], code=line)
  31999. ELM327Error: Operation interrupted by a received RS232 character
  32000. 2020-08-04 12:55:38,858 [messaging :742 ][ERROR ][649] Exception while processing event: {'tag': 'obd/req/15461eba-13b4-444c-8575-fd414ff958e5', 'data': {'_stamp': '2020-08-04T12:55:33.299174', 'handler': 'execute', '_event_tag': 'obd/req/15461eba-13b4-444c-8575-fd414ff958e5', 'args': ['STSLCS']}}
  32001. Traceback (most recent call last):
  32002. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  32003. res = self.process(message)
  32004. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  32005. result = func(message, **settings)
  32006. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  32007. found, result = self._call_hook_for(message, "workflow", message)
  32008. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32009. return True, func(*args, **kwargs)
  32010. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  32011. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32012. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32013. return True, func(*args, **kwargs)
  32014. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32015. return func(*args, **kwargs)
  32016. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  32017. res = conn.execute(cmd)
  32018. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  32019. return func(self, *args, **kwargs)
  32020. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  32021. return self._obd.execute(cmd, **kwargs)
  32022. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  32023. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  32024. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  32025. lines = self.send(cmd, raw_response=raw_response)
  32026. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  32027. raise ELM327Error(self.ERRORS[line], code=line)
  32028. ELM327Error: Operation interrupted by a received RS232 character
  32029. 2020-08-04 12:55:39,674 [salt.utils.parsers:1050][WARNING ][411] Minion received a SIGTERM. Exiting.
  32030. 2020-08-04 12:55:40,214 [messaging :871 ][WARNING ][812] No reply message with tag 'obd/res/15461eba-13b4-444c-8575-fd414ff958e5' received within timeout of 30 secs
  32031. 2020-08-04 12:55:40,218 [salt.state :292 ][ERROR ][812] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  32032. 2020-08-04 12:55:57,061 [gpio_spi_conn :42 ][WARNING ][626] Unable to clear buffer - got unexpected value: 255
  32033. 2020-08-04 12:55:57,081 [gpio_spi_conn :42 ][WARNING ][626] Unable to clear buffer - got unexpected value: 255
  32034. 2020-08-04 12:55:57,090 [gpio_spi_conn :42 ][WARNING ][626] Unable to clear buffer - got unexpected value: 255
  32035. 2020-08-04 12:55:57,779 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  32036. Traceback (most recent call last):
  32037. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32038. self._serial.open()
  32039. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32040. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32041. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32042. 2020-08-04 12:55:58,791 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  32043. Traceback (most recent call last):
  32044. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32045. self._serial.open()
  32046. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32047. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32048. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32049. 2020-08-04 12:55:59,134 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  32050. 2020-08-04 12:55:59,637 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  32051. 2020-08-04 12:55:59,795 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  32052. Traceback (most recent call last):
  32053. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32054. self._serial.open()
  32055. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32056. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32057. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32058. 2020-08-04 12:56:00,139 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  32059. 2020-08-04 12:56:00,142 [spm_conn :139 ][WARNING ][626] Unable to get status: Expected ack '12' but got '255'
  32060. 2020-08-04 12:56:00,383 [messaging :208 ][ERROR ][623] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  32061. Traceback (most recent call last):
  32062. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  32063. self._call_hook_for(message, "workflow", message)
  32064. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32065. return True, func(*args, **kwargs)
  32066. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  32067. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32068. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32069. return True, func(*args, **kwargs)
  32070. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32071. return func(*args, **kwargs)
  32072. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  32073. res = _exec("AT+CCLK?")
  32074. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  32075. conn.write_line(cmd)
  32076. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  32077. self.ensure_open()
  32078. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  32079. self.open()
  32080. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  32081. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  32082. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  32083. raise attempt.get()
  32084. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  32085. six.reraise(self.value[0], self.value[1], self.value[2])
  32086. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  32087. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  32088. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32089. self._serial.open()
  32090. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32091. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32092. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32093. 2020-08-04 12:56:00,645 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  32094. 2020-08-04 12:56:15,319 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][663] Timeout after 1.28205128205 second(s) waiting for interrupt
  32095. 2020-08-04 12:56:15,372 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  32096. Traceback (most recent call last):
  32097. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32098. self._serial.open()
  32099. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32100. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32101. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32102. 2020-08-04 12:56:15,627 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  32103. 2020-08-04 12:56:16,130 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  32104. 2020-08-04 12:56:16,132 [spm_conn :139 ][WARNING ][626] Unable to get status: Expected ack '12' but got '255'
  32105. 2020-08-04 12:56:16,376 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  32106. Traceback (most recent call last):
  32107. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32108. self._serial.open()
  32109. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32110. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32111. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32112. 2020-08-04 12:56:16,635 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  32113. 2020-08-04 12:56:17,139 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  32114. 2020-08-04 12:56:17,381 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  32115. Traceback (most recent call last):
  32116. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32117. self._serial.open()
  32118. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32119. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32120. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32121. 2020-08-04 12:56:17,395 [messaging :206 ][ERROR ][623] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  32122. Traceback (most recent call last):
  32123. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  32124. self._call_hook_for(message, "workflow", message)
  32125. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32126. return True, func(*args, **kwargs)
  32127. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  32128. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32129. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32130. return True, func(*args, **kwargs)
  32131. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32132. return func(*args, **kwargs)
  32133. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  32134. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  32135. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  32136. conn.write_line(cmd)
  32137. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  32138. self.ensure_open()
  32139. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  32140. self.open()
  32141. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  32142. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  32143. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  32144. raise attempt.get()
  32145. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  32146. six.reraise(self.value[0], self.value[1], self.value[2])
  32147. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  32148. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  32149. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32150. self._serial.open()
  32151. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32152. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32153. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32154. 2020-08-04 12:56:17,642 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  32155. 2020-08-04 12:56:17,644 [spm_conn :139 ][WARNING ][626] Unable to get status: Expected ack '12' but got '255'
  32156. 2020-08-04 12:56:17,650 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  32157. 2020-08-04 12:56:18,153 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  32158. 2020-08-04 12:56:18,656 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  32159. 2020-08-04 12:56:18,658 [spm_conn :82 ][WARNING ][626] Unable to send noop: Expected ack '12' but got '255'
  32160. 2020-08-04 12:56:19,065 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  32161. Traceback (most recent call last):
  32162. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32163. self._serial.open()
  32164. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32165. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32166. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32167. 2020-08-04 12:56:19,164 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  32168. 2020-08-04 12:56:19,668 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  32169. 2020-08-04 12:56:20,077 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  32170. Traceback (most recent call last):
  32171. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32172. self._serial.open()
  32173. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32174. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32175. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32176. 2020-08-04 12:56:20,171 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  32177. 2020-08-04 12:56:20,173 [spm_conn :82 ][WARNING ][626] Unable to send noop: Expected ack '12' but got '255'
  32178. 2020-08-04 12:56:20,677 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  32179. 2020-08-04 12:56:21,081 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  32180. Traceback (most recent call last):
  32181. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32182. self._serial.open()
  32183. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32184. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32185. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32186. 2020-08-04 12:56:21,084 [messaging :742 ][ERROR ][623] Exception while processing event: {'tag': 'ec2x/req/98fb0dc0-64dc-4ed3-8bc3-ad9ab1766384', 'data': {'_stamp': '2020-08-04T12:55:57.146231', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/98fb0dc0-64dc-4ed3-8bc3-ad9ab1766384', 'kwargs': {'cooldown_delay': None}}}
  32187. Traceback (most recent call last):
  32188. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  32189. res = self.process(message)
  32190. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  32191. result = func(message, **settings)
  32192. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  32193. found, result = self._call_hook_for(message, "workflow", message)
  32194. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32195. return True, func(*args, **kwargs)
  32196. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  32197. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32198. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32199. return True, func(*args, **kwargs)
  32200. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32201. return func(*args, **kwargs)
  32202. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  32203. return _exec(cmd, **kwargs)
  32204. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  32205. conn.write_line(cmd)
  32206. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  32207. self.ensure_open()
  32208. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  32209. self.open()
  32210. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  32211. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  32212. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  32213. raise attempt.get()
  32214. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  32215. six.reraise(self.value[0], self.value[1], self.value[2])
  32216. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  32217. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  32218. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32219. self._serial.open()
  32220. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32221. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32222. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32223. 2020-08-04 12:56:21,180 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  32224. 2020-08-04 12:56:21,683 [gpio_spi_conn :109 ][WARNING ][626] Expected ack '12' but got '255'
  32225. 2020-08-04 12:56:21,685 [spm_conn :82 ][WARNING ][626] Unable to send noop: Expected ack '12' but got '255'
  32226. 2020-08-04 12:56:21,688 [messaging :208 ][ERROR ][626] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  32227. Traceback (most recent call last):
  32228. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  32229. self._call_hook_for(message, "workflow", message)
  32230. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32231. return True, func(*args, **kwargs)
  32232. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  32233. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32234. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32235. return True, func(*args, **kwargs)
  32236. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32237. return func(*args, **kwargs)
  32238. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  32239. conn.heartbeat()
  32240. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  32241. self.noop()
  32242. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  32243. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  32244. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  32245. raise attempt.get()
  32246. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  32247. six.reraise(self.value[0], self.value[1], self.value[2])
  32248. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  32249. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  32250. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  32251. self._begin_message()
  32252. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  32253. self.recv(ack=ACK_MESSAGE_BEGIN)
  32254. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  32255. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  32256. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  32257. raise attempt.get()
  32258. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  32259. six.reraise(self.value[0], self.value[1], self.value[2])
  32260. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  32261. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  32262. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  32263. raise Exception(msg)
  32264. Exception: Expected ack '12' but got '255'
  32265. 2020-08-04 12:56:23,236 [messaging :208 ][ERROR ][624] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  32266. Traceback (most recent call last):
  32267. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  32268. self._call_hook_for(message, "workflow", message)
  32269. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32270. return True, func(*args, **kwargs)
  32271. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  32272. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32273. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32274. return True, func(*args, **kwargs)
  32275. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32276. return func(*args, **kwargs)
  32277. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  32278. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  32279. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  32280. res = query("AT+QGPSLOC={:d}".format(mode))
  32281. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  32282. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  32283. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  32284. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  32285. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  32286. raise salt.exceptions.CommandExecutionError(message["error"])
  32287. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32288. 2020-08-04 12:56:28,292 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  32289. Traceback (most recent call last):
  32290. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32291. self._serial.open()
  32292. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32293. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32294. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32295. 2020-08-04 12:56:29,299 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  32296. Traceback (most recent call last):
  32297. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32298. self._serial.open()
  32299. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32300. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32301. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32302. 2020-08-04 12:56:30,303 [serial_conn :79 ][ERROR ][623] Failed to open serial connection
  32303. Traceback (most recent call last):
  32304. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32305. self._serial.open()
  32306. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32307. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32308. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32309. 2020-08-04 12:56:30,306 [messaging :742 ][ERROR ][623] Exception while processing event: {'tag': 'ec2x/req/6fead942-f62c-4d28-b283-f577ee9be3d0', 'data': {'_stamp': '2020-08-04T12:56:28.285355', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/6fead942-f62c-4d28-b283-f577ee9be3d0', 'kwargs': {'cooldown_delay': None}}}
  32310. Traceback (most recent call last):
  32311. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  32312. res = self.process(message)
  32313. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  32314. result = func(message, **settings)
  32315. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  32316. found, result = self._call_hook_for(message, "workflow", message)
  32317. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32318. return True, func(*args, **kwargs)
  32319. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  32320. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32321. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32322. return True, func(*args, **kwargs)
  32323. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32324. return func(*args, **kwargs)
  32325. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  32326. return _exec(cmd, **kwargs)
  32327. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  32328. conn.write_line(cmd)
  32329. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  32330. self.ensure_open()
  32331. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  32332. self.open()
  32333. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  32334. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  32335. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  32336. raise attempt.get()
  32337. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  32338. six.reraise(self.value[0], self.value[1], self.value[2])
  32339. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  32340. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  32341. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32342. self._serial.open()
  32343. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32344. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32345. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32346. 2020-08-04 12:56:30,334 [messaging :206 ][ERROR ][624] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  32347. Traceback (most recent call last):
  32348. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  32349. self._call_hook_for(message, "workflow", message)
  32350. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32351. return True, func(*args, **kwargs)
  32352. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  32353. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32354. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32355. return True, func(*args, **kwargs)
  32356. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32357. return func(*args, **kwargs)
  32358. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  32359. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  32360. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  32361. res = query("AT+QGPSLOC={:d}".format(mode))
  32362. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  32363. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  32364. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  32365. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  32366. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  32367. raise salt.exceptions.CommandExecutionError(message["error"])
  32368. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32369. 2020-08-04 12:56:33,690 [obd.obd :107 ][ERROR ][660] Failed to use explicit port '/dev/serial0'
  32370. Traceback (most recent call last):
  32371. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  32372. self.interface.open(baudrate, protocol=protocol)
  32373. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  32374. self.set_protocol(prot.pop("id", None), **prot)
  32375. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  32376. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  32377. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  32378. self._protocol = self._auto_protocol(**kwargs)
  32379. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  32380. res_0100 = self._verify_protocol("auto", test=not verify)
  32381. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  32382. for line in self.query("0100", parse=False, read_timeout=10):
  32383. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  32384. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  32385. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  32386. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  32387. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  32388. data = self._port.read(self._port.in_waiting or 1)
  32389. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  32390. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  32391. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  32392. sys.exit(salt.defaults.exitcodes.EX_OK)
  32393. SystemExit: 0
  32394. 2020-08-04 12:56:33,714 [obd.obd :120 ][WARNING ][660] Cannot load commands - no connection to bus
  32395. 2020-08-04 12:56:33,747 [obd.interfaces.elm327:730 ][ERROR ][660] Failed to relay command 'STSLCS' to interface
  32396. Traceback (most recent call last):
  32397. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  32398. lines = self.send(cmd, raw_response=raw_response)
  32399. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  32400. raise ELM327Error(self.ERRORS[line], code=line)
  32401. ELM327Error: Operation interrupted by a received RS232 character
  32402. 2020-08-04 12:56:33,749 [messaging :742 ][ERROR ][660] Exception while processing event: {'tag': 'obd/req/9c7e793c-d58e-4474-99e7-b919cd9ecfb2', 'data': {'_stamp': '2020-08-04T12:56:28.120072', 'handler': 'execute', '_event_tag': 'obd/req/9c7e793c-d58e-4474-99e7-b919cd9ecfb2', 'args': ['STSLCS']}}
  32403. Traceback (most recent call last):
  32404. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  32405. res = self.process(message)
  32406. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  32407. result = func(message, **settings)
  32408. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  32409. found, result = self._call_hook_for(message, "workflow", message)
  32410. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32411. return True, func(*args, **kwargs)
  32412. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  32413. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32414. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32415. return True, func(*args, **kwargs)
  32416. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32417. return func(*args, **kwargs)
  32418. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  32419. res = conn.execute(cmd)
  32420. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  32421. return func(self, *args, **kwargs)
  32422. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  32423. return self._obd.execute(cmd, **kwargs)
  32424. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  32425. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  32426. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  32427. lines = self.send(cmd, raw_response=raw_response)
  32428. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  32429. raise ELM327Error(self.ERRORS[line], code=line)
  32430. ELM327Error: Operation interrupted by a received RS232 character
  32431. 2020-08-04 12:56:34,443 [salt.utils.parsers:1050][WARNING ][422] Minion received a SIGTERM. Exiting.
  32432. 2020-08-04 12:56:34,983 [messaging :871 ][WARNING ][823] No reply message with tag 'obd/res/9c7e793c-d58e-4474-99e7-b919cd9ecfb2' received within timeout of 30 secs
  32433. 2020-08-04 12:56:34,987 [salt.state :292 ][ERROR ][823] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  32434. 2020-08-04 12:56:52,121 [gpio_spi_conn :42 ][WARNING ][631] Unable to clear buffer - got unexpected value: 255
  32435. 2020-08-04 12:56:52,134 [gpio_spi_conn :42 ][WARNING ][631] Unable to clear buffer - got unexpected value: 255
  32436. 2020-08-04 12:56:52,139 [gpio_spi_conn :42 ][WARNING ][631] Unable to clear buffer - got unexpected value: 255
  32437. 2020-08-04 12:56:52,843 [serial_conn :79 ][ERROR ][628] Failed to open serial connection
  32438. Traceback (most recent call last):
  32439. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32440. self._serial.open()
  32441. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32442. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32443. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32444. 2020-08-04 12:56:53,860 [serial_conn :79 ][ERROR ][628] Failed to open serial connection
  32445. Traceback (most recent call last):
  32446. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32447. self._serial.open()
  32448. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32449. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32450. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32451. 2020-08-04 12:56:54,181 [gpio_spi_conn :109 ][WARNING ][631] Expected ack '12' but got '255'
  32452. 2020-08-04 12:56:54,683 [gpio_spi_conn :109 ][WARNING ][631] Expected ack '12' but got '255'
  32453. 2020-08-04 12:56:54,865 [serial_conn :79 ][ERROR ][628] Failed to open serial connection
  32454. Traceback (most recent call last):
  32455. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32456. self._serial.open()
  32457. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32458. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32459. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32460. 2020-08-04 12:56:55,186 [gpio_spi_conn :109 ][WARNING ][631] Expected ack '12' but got '255'
  32461. 2020-08-04 12:56:55,189 [spm_conn :139 ][WARNING ][631] Unable to get status: Expected ack '12' but got '255'
  32462. 2020-08-04 12:56:55,502 [messaging :208 ][ERROR ][628] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  32463. Traceback (most recent call last):
  32464. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  32465. self._call_hook_for(message, "workflow", message)
  32466. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32467. return True, func(*args, **kwargs)
  32468. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  32469. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32470. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32471. return True, func(*args, **kwargs)
  32472. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32473. return func(*args, **kwargs)
  32474. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  32475. res = _exec("AT+CCLK?")
  32476. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  32477. conn.write_line(cmd)
  32478. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  32479. self.ensure_open()
  32480. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  32481. self.open()
  32482. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  32483. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  32484. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  32485. raise attempt.get()
  32486. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  32487. six.reraise(self.value[0], self.value[1], self.value[2])
  32488. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  32489. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  32490. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32491. self._serial.open()
  32492. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32493. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32494. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32495. 2020-08-04 12:56:55,696 [gpio_spi_conn :109 ][WARNING ][631] Expected ack '12' but got '255'
  32496. 2020-08-04 12:57:10,092 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][668] Timeout after 1.28205128205 second(s) waiting for interrupt
  32497. 2020-08-04 12:57:10,198 [serial_conn :79 ][ERROR ][628] Failed to open serial connection
  32498. Traceback (most recent call last):
  32499. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32500. self._serial.open()
  32501. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32502. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32503. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32504. 2020-08-04 12:57:10,398 [gpio_spi_conn :109 ][WARNING ][631] Expected ack '12' but got '255'
  32505. 2020-08-04 12:57:10,903 [gpio_spi_conn :109 ][WARNING ][631] Expected ack '12' but got '255'
  32506. 2020-08-04 12:57:10,905 [spm_conn :139 ][WARNING ][631] Unable to get status: Expected ack '12' but got '255'
  32507. 2020-08-04 12:57:11,203 [serial_conn :79 ][ERROR ][628] Failed to open serial connection
  32508. Traceback (most recent call last):
  32509. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32510. self._serial.open()
  32511. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32512. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32513. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32514. 2020-08-04 12:57:11,408 [gpio_spi_conn :109 ][WARNING ][631] Expected ack '12' but got '255'
  32515. 2020-08-04 12:57:11,911 [gpio_spi_conn :109 ][WARNING ][631] Expected ack '12' but got '255'
  32516. 2020-08-04 12:57:12,207 [serial_conn :79 ][ERROR ][628] Failed to open serial connection
  32517. Traceback (most recent call last):
  32518. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32519. self._serial.open()
  32520. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32521. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32522. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32523. 2020-08-04 12:57:12,220 [messaging :206 ][ERROR ][628] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  32524. Traceback (most recent call last):
  32525. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  32526. self._call_hook_for(message, "workflow", message)
  32527. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32528. return True, func(*args, **kwargs)
  32529. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  32530. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32531. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32532. return True, func(*args, **kwargs)
  32533. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32534. return func(*args, **kwargs)
  32535. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  32536. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  32537. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  32538. conn.write_line(cmd)
  32539. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  32540. self.ensure_open()
  32541. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  32542. self.open()
  32543. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  32544. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  32545. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  32546. raise attempt.get()
  32547. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  32548. six.reraise(self.value[0], self.value[1], self.value[2])
  32549. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  32550. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  32551. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32552. self._serial.open()
  32553. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32554. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32555. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32556. 2020-08-04 12:57:12,414 [gpio_spi_conn :109 ][WARNING ][631] Expected ack '12' but got '255'
  32557. 2020-08-04 12:57:12,416 [spm_conn :139 ][WARNING ][631] Unable to get status: Expected ack '12' but got '255'
  32558. 2020-08-04 12:57:12,420 [gpio_spi_conn :109 ][WARNING ][631] Expected ack '12' but got '255'
  32559. 2020-08-04 12:57:12,923 [gpio_spi_conn :109 ][WARNING ][631] Expected ack '12' but got '255'
  32560. 2020-08-04 12:57:13,426 [gpio_spi_conn :109 ][WARNING ][631] Expected ack '12' but got '255'
  32561. 2020-08-04 12:57:13,429 [spm_conn :82 ][WARNING ][631] Unable to send noop: Expected ack '12' but got '255'
  32562. 2020-08-04 12:57:13,805 [serial_conn :79 ][ERROR ][628] Failed to open serial connection
  32563. Traceback (most recent call last):
  32564. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32565. self._serial.open()
  32566. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32567. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32568. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32569. 2020-08-04 12:57:13,933 [gpio_spi_conn :109 ][WARNING ][631] Expected ack '12' but got '255'
  32570. 2020-08-04 12:57:14,436 [gpio_spi_conn :109 ][WARNING ][631] Expected ack '12' but got '255'
  32571. 2020-08-04 12:57:14,810 [serial_conn :79 ][ERROR ][628] Failed to open serial connection
  32572. Traceback (most recent call last):
  32573. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32574. self._serial.open()
  32575. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32576. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32577. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32578. 2020-08-04 12:57:14,940 [gpio_spi_conn :109 ][WARNING ][631] Expected ack '12' but got '255'
  32579. 2020-08-04 12:57:14,942 [spm_conn :82 ][WARNING ][631] Unable to send noop: Expected ack '12' but got '255'
  32580. 2020-08-04 12:57:15,446 [gpio_spi_conn :109 ][WARNING ][631] Expected ack '12' but got '255'
  32581. 2020-08-04 12:57:15,814 [serial_conn :79 ][ERROR ][628] Failed to open serial connection
  32582. Traceback (most recent call last):
  32583. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32584. self._serial.open()
  32585. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32586. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32587. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32588. 2020-08-04 12:57:15,825 [messaging :742 ][ERROR ][628] Exception while processing event: {'tag': 'ec2x/req/9dca8541-48da-48b7-902c-95a2290d2898', 'data': {'_stamp': '2020-08-04T12:56:52.186592', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/9dca8541-48da-48b7-902c-95a2290d2898', 'kwargs': {'cooldown_delay': None}}}
  32589. Traceback (most recent call last):
  32590. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  32591. res = self.process(message)
  32592. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  32593. result = func(message, **settings)
  32594. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  32595. found, result = self._call_hook_for(message, "workflow", message)
  32596. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32597. return True, func(*args, **kwargs)
  32598. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  32599. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32600. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32601. return True, func(*args, **kwargs)
  32602. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32603. return func(*args, **kwargs)
  32604. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  32605. return _exec(cmd, **kwargs)
  32606. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  32607. conn.write_line(cmd)
  32608. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  32609. self.ensure_open()
  32610. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  32611. self.open()
  32612. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  32613. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  32614. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  32615. raise attempt.get()
  32616. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  32617. six.reraise(self.value[0], self.value[1], self.value[2])
  32618. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  32619. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  32620. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32621. self._serial.open()
  32622. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32623. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32624. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32625. 2020-08-04 12:57:15,950 [gpio_spi_conn :109 ][WARNING ][631] Expected ack '12' but got '255'
  32626. 2020-08-04 12:57:16,454 [gpio_spi_conn :109 ][WARNING ][631] Expected ack '12' but got '255'
  32627. 2020-08-04 12:57:16,457 [spm_conn :82 ][WARNING ][631] Unable to send noop: Expected ack '12' but got '255'
  32628. 2020-08-04 12:57:16,460 [messaging :208 ][ERROR ][631] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  32629. Traceback (most recent call last):
  32630. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  32631. self._call_hook_for(message, "workflow", message)
  32632. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32633. return True, func(*args, **kwargs)
  32634. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  32635. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32636. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32637. return True, func(*args, **kwargs)
  32638. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32639. return func(*args, **kwargs)
  32640. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  32641. conn.heartbeat()
  32642. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  32643. self.noop()
  32644. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  32645. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  32646. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  32647. raise attempt.get()
  32648. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  32649. six.reraise(self.value[0], self.value[1], self.value[2])
  32650. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  32651. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  32652. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  32653. self._begin_message()
  32654. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  32655. self.recv(ack=ACK_MESSAGE_BEGIN)
  32656. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  32657. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  32658. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  32659. raise attempt.get()
  32660. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  32661. six.reraise(self.value[0], self.value[1], self.value[2])
  32662. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  32663. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  32664. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  32665. raise Exception(msg)
  32666. Exception: Expected ack '12' but got '255'
  32667. 2020-08-04 12:57:17,877 [messaging :208 ][ERROR ][629] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  32668. Traceback (most recent call last):
  32669. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  32670. self._call_hook_for(message, "workflow", message)
  32671. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32672. return True, func(*args, **kwargs)
  32673. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  32674. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32675. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32676. return True, func(*args, **kwargs)
  32677. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32678. return func(*args, **kwargs)
  32679. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  32680. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  32681. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  32682. res = query("AT+QGPSLOC={:d}".format(mode))
  32683. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  32684. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  32685. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  32686. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  32687. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  32688. raise salt.exceptions.CommandExecutionError(message["error"])
  32689. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32690. 2020-08-04 12:57:22,937 [serial_conn :79 ][ERROR ][628] Failed to open serial connection
  32691. Traceback (most recent call last):
  32692. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32693. self._serial.open()
  32694. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32695. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32696. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32697. 2020-08-04 12:57:23,951 [serial_conn :79 ][ERROR ][628] Failed to open serial connection
  32698. Traceback (most recent call last):
  32699. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32700. self._serial.open()
  32701. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32702. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32703. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32704. 2020-08-04 12:57:24,955 [serial_conn :79 ][ERROR ][628] Failed to open serial connection
  32705. Traceback (most recent call last):
  32706. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32707. self._serial.open()
  32708. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32709. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32710. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32711. 2020-08-04 12:57:24,958 [messaging :742 ][ERROR ][628] Exception while processing event: {'tag': 'ec2x/req/1b778201-b24c-44f3-929f-7da6bd394188', 'data': {'_stamp': '2020-08-04T12:57:22.929440', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/1b778201-b24c-44f3-929f-7da6bd394188', 'kwargs': {'cooldown_delay': None}}}
  32712. Traceback (most recent call last):
  32713. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  32714. res = self.process(message)
  32715. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  32716. result = func(message, **settings)
  32717. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  32718. found, result = self._call_hook_for(message, "workflow", message)
  32719. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32720. return True, func(*args, **kwargs)
  32721. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  32722. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32723. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32724. return True, func(*args, **kwargs)
  32725. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32726. return func(*args, **kwargs)
  32727. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  32728. return _exec(cmd, **kwargs)
  32729. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  32730. conn.write_line(cmd)
  32731. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  32732. self.ensure_open()
  32733. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  32734. self.open()
  32735. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  32736. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  32737. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  32738. raise attempt.get()
  32739. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  32740. six.reraise(self.value[0], self.value[1], self.value[2])
  32741. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  32742. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  32743. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32744. self._serial.open()
  32745. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32746. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32747. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32748. 2020-08-04 12:57:24,971 [messaging :206 ][ERROR ][629] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  32749. Traceback (most recent call last):
  32750. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  32751. self._call_hook_for(message, "workflow", message)
  32752. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32753. return True, func(*args, **kwargs)
  32754. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  32755. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32756. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32757. return True, func(*args, **kwargs)
  32758. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32759. return func(*args, **kwargs)
  32760. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  32761. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  32762. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  32763. res = query("AT+QGPSLOC={:d}".format(mode))
  32764. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  32765. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  32766. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  32767. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  32768. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  32769. raise salt.exceptions.CommandExecutionError(message["error"])
  32770. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32771. 2020-08-04 12:57:28,308 [obd.obd :107 ][ERROR ][667] Failed to use explicit port '/dev/serial0'
  32772. Traceback (most recent call last):
  32773. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  32774. self.interface.open(baudrate, protocol=protocol)
  32775. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  32776. self.set_protocol(prot.pop("id", None), **prot)
  32777. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  32778. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  32779. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  32780. self._protocol = self._auto_protocol(**kwargs)
  32781. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  32782. res_0100 = self._verify_protocol("auto", test=not verify)
  32783. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  32784. for line in self.query("0100", parse=False, read_timeout=10):
  32785. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  32786. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  32787. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  32788. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  32789. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  32790. data = self._port.read(self._port.in_waiting or 1)
  32791. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  32792. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  32793. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  32794. sys.exit(salt.defaults.exitcodes.EX_OK)
  32795. SystemExit: 0
  32796. 2020-08-04 12:57:28,337 [obd.obd :120 ][WARNING ][667] Cannot load commands - no connection to bus
  32797. 2020-08-04 12:57:28,368 [obd.interfaces.elm327:730 ][ERROR ][667] Failed to relay command 'STSLCS' to interface
  32798. Traceback (most recent call last):
  32799. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  32800. lines = self.send(cmd, raw_response=raw_response)
  32801. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  32802. raise ELM327Error(self.ERRORS[line], code=line)
  32803. ELM327Error: Operation interrupted by a received RS232 character
  32804. 2020-08-04 12:57:28,371 [messaging :742 ][ERROR ][667] Exception while processing event: {'tag': 'obd/req/13b7a62c-0953-46a8-902b-427d4ad02989', 'data': {'_stamp': '2020-08-04T12:57:22.857623', 'handler': 'execute', '_event_tag': 'obd/req/13b7a62c-0953-46a8-902b-427d4ad02989', 'args': ['STSLCS']}}
  32805. Traceback (most recent call last):
  32806. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  32807. res = self.process(message)
  32808. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  32809. result = func(message, **settings)
  32810. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  32811. found, result = self._call_hook_for(message, "workflow", message)
  32812. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32813. return True, func(*args, **kwargs)
  32814. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  32815. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32816. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32817. return True, func(*args, **kwargs)
  32818. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32819. return func(*args, **kwargs)
  32820. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  32821. res = conn.execute(cmd)
  32822. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  32823. return func(self, *args, **kwargs)
  32824. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  32825. return self._obd.execute(cmd, **kwargs)
  32826. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  32827. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  32828. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  32829. lines = self.send(cmd, raw_response=raw_response)
  32830. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  32831. raise ELM327Error(self.ERRORS[line], code=line)
  32832. ELM327Error: Operation interrupted by a received RS232 character
  32833. 2020-08-04 12:57:29,154 [salt.utils.parsers:1050][WARNING ][427] Minion received a SIGTERM. Exiting.
  32834. 2020-08-04 12:57:29,694 [messaging :871 ][WARNING ][828] No reply message with tag 'obd/res/13b7a62c-0953-46a8-902b-427d4ad02989' received within timeout of 30 secs
  32835. 2020-08-04 12:57:29,700 [salt.state :292 ][ERROR ][828] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  32836. 2020-08-04 12:57:46,267 [gpio_spi_conn :42 ][WARNING ][628] Unable to clear buffer - got unexpected value: 255
  32837. 2020-08-04 12:57:46,285 [gpio_spi_conn :42 ][WARNING ][628] Unable to clear buffer - got unexpected value: 255
  32838. 2020-08-04 12:57:46,293 [gpio_spi_conn :42 ][WARNING ][628] Unable to clear buffer - got unexpected value: 255
  32839. 2020-08-04 12:57:46,968 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  32840. Traceback (most recent call last):
  32841. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32842. self._serial.open()
  32843. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32844. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32845. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32846. 2020-08-04 12:57:47,980 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  32847. Traceback (most recent call last):
  32848. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32849. self._serial.open()
  32850. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32851. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32852. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32853. 2020-08-04 12:57:48,315 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  32854. 2020-08-04 12:57:48,818 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  32855. 2020-08-04 12:57:48,984 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  32856. Traceback (most recent call last):
  32857. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32858. self._serial.open()
  32859. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32860. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32861. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32862. 2020-08-04 12:57:49,321 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  32863. 2020-08-04 12:57:49,324 [spm_conn :139 ][WARNING ][628] Unable to get status: Expected ack '12' but got '255'
  32864. 2020-08-04 12:57:49,543 [messaging :208 ][ERROR ][625] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  32865. Traceback (most recent call last):
  32866. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  32867. self._call_hook_for(message, "workflow", message)
  32868. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32869. return True, func(*args, **kwargs)
  32870. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  32871. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32872. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32873. return True, func(*args, **kwargs)
  32874. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32875. return func(*args, **kwargs)
  32876. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  32877. res = _exec("AT+CCLK?")
  32878. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  32879. conn.write_line(cmd)
  32880. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  32881. self.ensure_open()
  32882. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  32883. self.open()
  32884. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  32885. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  32886. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  32887. raise attempt.get()
  32888. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  32889. six.reraise(self.value[0], self.value[1], self.value[2])
  32890. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  32891. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  32892. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32893. self._serial.open()
  32894. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32895. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32896. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32897. 2020-08-04 12:57:49,828 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  32898. 2020-08-04 12:58:04,876 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][715] Timeout after 1.28205128205 second(s) waiting for interrupt
  32899. 2020-08-04 12:58:04,925 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  32900. Traceback (most recent call last):
  32901. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32902. self._serial.open()
  32903. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32904. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32905. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32906. 2020-08-04 12:58:05,251 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  32907. 2020-08-04 12:58:05,754 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  32908. 2020-08-04 12:58:05,757 [spm_conn :139 ][WARNING ][628] Unable to get status: Expected ack '12' but got '255'
  32909. 2020-08-04 12:58:05,929 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  32910. Traceback (most recent call last):
  32911. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32912. self._serial.open()
  32913. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32914. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32915. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32916. 2020-08-04 12:58:06,261 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  32917. 2020-08-04 12:58:06,765 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  32918. 2020-08-04 12:58:06,933 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  32919. Traceback (most recent call last):
  32920. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32921. self._serial.open()
  32922. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32923. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32924. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32925. 2020-08-04 12:58:06,937 [messaging :206 ][ERROR ][625] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  32926. Traceback (most recent call last):
  32927. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  32928. self._call_hook_for(message, "workflow", message)
  32929. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32930. return True, func(*args, **kwargs)
  32931. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  32932. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  32933. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  32934. return True, func(*args, **kwargs)
  32935. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  32936. return func(*args, **kwargs)
  32937. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  32938. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  32939. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  32940. conn.write_line(cmd)
  32941. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  32942. self.ensure_open()
  32943. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  32944. self.open()
  32945. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  32946. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  32947. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  32948. raise attempt.get()
  32949. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  32950. six.reraise(self.value[0], self.value[1], self.value[2])
  32951. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  32952. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  32953. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32954. self._serial.open()
  32955. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32956. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32957. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32958. 2020-08-04 12:58:07,269 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  32959. 2020-08-04 12:58:07,272 [spm_conn :139 ][WARNING ][628] Unable to get status: Expected ack '12' but got '255'
  32960. 2020-08-04 12:58:07,275 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  32961. 2020-08-04 12:58:07,779 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  32962. 2020-08-04 12:58:08,282 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  32963. 2020-08-04 12:58:08,285 [spm_conn :82 ][WARNING ][628] Unable to send noop: Expected ack '12' but got '255'
  32964. 2020-08-04 12:58:08,775 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  32965. Traceback (most recent call last):
  32966. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32967. self._serial.open()
  32968. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32969. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32970. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32971. 2020-08-04 12:58:08,796 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  32972. 2020-08-04 12:58:09,304 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  32973. 2020-08-04 12:58:09,784 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  32974. Traceback (most recent call last):
  32975. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32976. self._serial.open()
  32977. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32978. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32979. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32980. 2020-08-04 12:58:09,808 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  32981. 2020-08-04 12:58:09,810 [spm_conn :82 ][WARNING ][628] Unable to send noop: Expected ack '12' but got '255'
  32982. 2020-08-04 12:58:10,314 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  32983. 2020-08-04 12:58:10,788 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  32984. Traceback (most recent call last):
  32985. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  32986. self._serial.open()
  32987. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  32988. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  32989. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  32990. 2020-08-04 12:58:10,817 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  32991. 2020-08-04 12:58:10,802 [messaging :742 ][ERROR ][625] Exception while processing event: {'tag': 'ec2x/req/25383ba4-238c-43d1-8a1f-eed4844093bf', 'data': {'_stamp': '2020-08-04T12:57:46.351721', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/25383ba4-238c-43d1-8a1f-eed4844093bf', 'kwargs': {'cooldown_delay': None}}}
  32992. Traceback (most recent call last):
  32993. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  32994. res = self.process(message)
  32995. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  32996. result = func(message, **settings)
  32997. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  32998. found, result = self._call_hook_for(message, "workflow", message)
  32999. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33000. return True, func(*args, **kwargs)
  33001. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  33002. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33003. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33004. return True, func(*args, **kwargs)
  33005. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33006. return func(*args, **kwargs)
  33007. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  33008. return _exec(cmd, **kwargs)
  33009. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  33010. conn.write_line(cmd)
  33011. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  33012. self.ensure_open()
  33013. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  33014. self.open()
  33015. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  33016. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  33017. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  33018. raise attempt.get()
  33019. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  33020. six.reraise(self.value[0], self.value[1], self.value[2])
  33021. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  33022. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  33023. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33024. self._serial.open()
  33025. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33026. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33027. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33028. 2020-08-04 12:58:11,320 [gpio_spi_conn :109 ][WARNING ][628] Expected ack '12' but got '255'
  33029. 2020-08-04 12:58:11,322 [spm_conn :82 ][WARNING ][628] Unable to send noop: Expected ack '12' but got '255'
  33030. 2020-08-04 12:58:11,325 [messaging :208 ][ERROR ][628] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  33031. Traceback (most recent call last):
  33032. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  33033. self._call_hook_for(message, "workflow", message)
  33034. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33035. return True, func(*args, **kwargs)
  33036. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  33037. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33038. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33039. return True, func(*args, **kwargs)
  33040. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33041. return func(*args, **kwargs)
  33042. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  33043. conn.heartbeat()
  33044. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  33045. self.noop()
  33046. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  33047. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  33048. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  33049. raise attempt.get()
  33050. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  33051. six.reraise(self.value[0], self.value[1], self.value[2])
  33052. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  33053. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  33054. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  33055. self._begin_message()
  33056. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  33057. self.recv(ack=ACK_MESSAGE_BEGIN)
  33058. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  33059. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  33060. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  33061. raise attempt.get()
  33062. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  33063. six.reraise(self.value[0], self.value[1], self.value[2])
  33064. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  33065. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  33066. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  33067. raise Exception(msg)
  33068. Exception: Expected ack '12' but got '255'
  33069. 2020-08-04 12:58:12,942 [messaging :208 ][ERROR ][626] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  33070. Traceback (most recent call last):
  33071. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  33072. self._call_hook_for(message, "workflow", message)
  33073. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33074. return True, func(*args, **kwargs)
  33075. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  33076. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33077. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33078. return True, func(*args, **kwargs)
  33079. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33080. return func(*args, **kwargs)
  33081. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  33082. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  33083. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  33084. res = query("AT+QGPSLOC={:d}".format(mode))
  33085. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  33086. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  33087. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  33088. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  33089. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  33090. raise salt.exceptions.CommandExecutionError(message["error"])
  33091. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33092. 2020-08-04 12:58:17,996 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  33093. Traceback (most recent call last):
  33094. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33095. self._serial.open()
  33096. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33097. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33098. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33099. 2020-08-04 12:58:19,000 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  33100. Traceback (most recent call last):
  33101. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33102. self._serial.open()
  33103. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33104. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33105. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33106. 2020-08-04 12:58:20,004 [serial_conn :79 ][ERROR ][625] Failed to open serial connection
  33107. Traceback (most recent call last):
  33108. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33109. self._serial.open()
  33110. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33111. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33112. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33113. 2020-08-04 12:58:20,007 [messaging :742 ][ERROR ][625] Exception while processing event: {'tag': 'ec2x/req/64887c3b-3c5e-49df-955e-b7960cd7ce99', 'data': {'_stamp': '2020-08-04T12:58:17.989284', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/64887c3b-3c5e-49df-955e-b7960cd7ce99', 'kwargs': {'cooldown_delay': None}}}
  33114. Traceback (most recent call last):
  33115. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  33116. res = self.process(message)
  33117. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  33118. result = func(message, **settings)
  33119. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  33120. found, result = self._call_hook_for(message, "workflow", message)
  33121. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33122. return True, func(*args, **kwargs)
  33123. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  33124. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33125. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33126. return True, func(*args, **kwargs)
  33127. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33128. return func(*args, **kwargs)
  33129. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  33130. return _exec(cmd, **kwargs)
  33131. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  33132. conn.write_line(cmd)
  33133. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  33134. self.ensure_open()
  33135. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  33136. self.open()
  33137. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  33138. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  33139. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  33140. raise attempt.get()
  33141. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  33142. six.reraise(self.value[0], self.value[1], self.value[2])
  33143. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  33144. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  33145. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33146. self._serial.open()
  33147. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33148. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33149. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33150. 2020-08-04 12:58:20,024 [messaging :206 ][ERROR ][626] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  33151. Traceback (most recent call last):
  33152. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  33153. self._call_hook_for(message, "workflow", message)
  33154. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33155. return True, func(*args, **kwargs)
  33156. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  33157. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33158. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33159. return True, func(*args, **kwargs)
  33160. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33161. return func(*args, **kwargs)
  33162. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  33163. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  33164. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  33165. res = query("AT+QGPSLOC={:d}".format(mode))
  33166. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  33167. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  33168. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  33169. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  33170. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  33171. raise salt.exceptions.CommandExecutionError(message["error"])
  33172. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33173. 2020-08-04 12:58:23,406 [obd.obd :107 ][ERROR ][714] Failed to use explicit port '/dev/serial0'
  33174. Traceback (most recent call last):
  33175. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  33176. self.interface.open(baudrate, protocol=protocol)
  33177. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  33178. self.set_protocol(prot.pop("id", None), **prot)
  33179. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  33180. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  33181. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  33182. self._protocol = self._auto_protocol(**kwargs)
  33183. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  33184. res_0100 = self._verify_protocol("auto", test=not verify)
  33185. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  33186. for line in self.query("0100", parse=False, read_timeout=10):
  33187. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  33188. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  33189. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  33190. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  33191. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  33192. data = self._port.read(self._port.in_waiting or 1)
  33193. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  33194. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  33195. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  33196. sys.exit(salt.defaults.exitcodes.EX_OK)
  33197. SystemExit: 0
  33198. 2020-08-04 12:58:23,431 [obd.obd :120 ][WARNING ][714] Cannot load commands - no connection to bus
  33199. 2020-08-04 12:58:23,469 [obd.interfaces.elm327:730 ][ERROR ][714] Failed to relay command 'STSLCS' to interface
  33200. Traceback (most recent call last):
  33201. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  33202. lines = self.send(cmd, raw_response=raw_response)
  33203. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  33204. raise ELM327Error(self.ERRORS[line], code=line)
  33205. ELM327Error: Operation interrupted by a received RS232 character
  33206. 2020-08-04 12:58:23,473 [messaging :742 ][ERROR ][714] Exception while processing event: {'tag': 'obd/req/a46de2c7-1cd9-4b1b-a43e-06f6312f0b46', 'data': {'_stamp': '2020-08-04T12:58:17.861945', 'handler': 'execute', '_event_tag': 'obd/req/a46de2c7-1cd9-4b1b-a43e-06f6312f0b46', 'args': ['STSLCS']}}
  33207. Traceback (most recent call last):
  33208. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  33209. res = self.process(message)
  33210. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  33211. result = func(message, **settings)
  33212. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  33213. found, result = self._call_hook_for(message, "workflow", message)
  33214. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33215. return True, func(*args, **kwargs)
  33216. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  33217. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33218. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33219. return True, func(*args, **kwargs)
  33220. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33221. return func(*args, **kwargs)
  33222. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  33223. res = conn.execute(cmd)
  33224. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  33225. return func(self, *args, **kwargs)
  33226. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  33227. return self._obd.execute(cmd, **kwargs)
  33228. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  33229. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  33230. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  33231. lines = self.send(cmd, raw_response=raw_response)
  33232. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  33233. raise ELM327Error(self.ERRORS[line], code=line)
  33234. ELM327Error: Operation interrupted by a received RS232 character
  33235. 2020-08-04 12:58:24,229 [salt.utils.parsers:1050][WARNING ][424] Minion received a SIGTERM. Exiting.
  33236. 2020-08-04 12:58:24,769 [messaging :871 ][WARNING ][825] No reply message with tag 'obd/res/a46de2c7-1cd9-4b1b-a43e-06f6312f0b46' received within timeout of 30 secs
  33237. 2020-08-04 12:58:24,773 [salt.state :292 ][ERROR ][825] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  33238. 2020-08-04 12:58:40,778 [gpio_spi_conn :42 ][WARNING ][608] Unable to clear buffer - got unexpected value: 255
  33239. 2020-08-04 12:58:40,790 [gpio_spi_conn :42 ][WARNING ][608] Unable to clear buffer - got unexpected value: 255
  33240. 2020-08-04 12:58:40,795 [gpio_spi_conn :42 ][WARNING ][608] Unable to clear buffer - got unexpected value: 255
  33241. 2020-08-04 12:58:41,461 [serial_conn :79 ][ERROR ][605] Failed to open serial connection
  33242. Traceback (most recent call last):
  33243. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33244. self._serial.open()
  33245. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33246. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33247. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33248. 2020-08-04 12:58:42,480 [serial_conn :79 ][ERROR ][605] Failed to open serial connection
  33249. Traceback (most recent call last):
  33250. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33251. self._serial.open()
  33252. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33253. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33254. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33255. 2020-08-04 12:58:42,818 [gpio_spi_conn :109 ][WARNING ][608] Expected ack '12' but got '255'
  33256. 2020-08-04 12:58:43,321 [gpio_spi_conn :109 ][WARNING ][608] Expected ack '12' but got '255'
  33257. 2020-08-04 12:58:43,485 [serial_conn :79 ][ERROR ][605] Failed to open serial connection
  33258. Traceback (most recent call last):
  33259. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33260. self._serial.open()
  33261. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33262. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33263. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33264. 2020-08-04 12:58:43,824 [gpio_spi_conn :109 ][WARNING ][608] Expected ack '12' but got '255'
  33265. 2020-08-04 12:58:43,826 [spm_conn :139 ][WARNING ][608] Unable to get status: Expected ack '12' but got '255'
  33266. 2020-08-04 12:58:44,129 [messaging :208 ][ERROR ][605] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  33267. Traceback (most recent call last):
  33268. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  33269. self._call_hook_for(message, "workflow", message)
  33270. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33271. return True, func(*args, **kwargs)
  33272. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  33273. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33274. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33275. return True, func(*args, **kwargs)
  33276. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33277. return func(*args, **kwargs)
  33278. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  33279. res = _exec("AT+CCLK?")
  33280. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  33281. conn.write_line(cmd)
  33282. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  33283. self.ensure_open()
  33284. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  33285. self.open()
  33286. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  33287. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  33288. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  33289. raise attempt.get()
  33290. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  33291. six.reraise(self.value[0], self.value[1], self.value[2])
  33292. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  33293. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  33294. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33295. self._serial.open()
  33296. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33297. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33298. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33299. 2020-08-04 12:58:44,330 [gpio_spi_conn :109 ][WARNING ][608] Expected ack '12' but got '255'
  33300. 2020-08-04 12:58:59,609 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][695] Timeout after 1.28205128205 second(s) waiting for interrupt
  33301. 2020-08-04 12:58:59,669 [serial_conn :79 ][ERROR ][605] Failed to open serial connection
  33302. Traceback (most recent call last):
  33303. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33304. self._serial.open()
  33305. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33306. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33307. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33308. 2020-08-04 12:58:59,872 [gpio_spi_conn :109 ][WARNING ][608] Expected ack '12' but got '255'
  33309. 2020-08-04 12:59:00,375 [gpio_spi_conn :109 ][WARNING ][608] Expected ack '12' but got '255'
  33310. 2020-08-04 12:59:00,378 [spm_conn :139 ][WARNING ][608] Unable to get status: Expected ack '12' but got '255'
  33311. 2020-08-04 12:59:00,684 [serial_conn :79 ][ERROR ][605] Failed to open serial connection
  33312. Traceback (most recent call last):
  33313. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33314. self._serial.open()
  33315. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33316. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33317. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33318. 2020-08-04 12:59:00,882 [gpio_spi_conn :109 ][WARNING ][608] Expected ack '12' but got '255'
  33319. 2020-08-04 12:59:01,385 [gpio_spi_conn :109 ][WARNING ][608] Expected ack '12' but got '255'
  33320. 2020-08-04 12:59:01,689 [serial_conn :79 ][ERROR ][605] Failed to open serial connection
  33321. Traceback (most recent call last):
  33322. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33323. self._serial.open()
  33324. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33325. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33326. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33327. 2020-08-04 12:59:01,693 [messaging :206 ][ERROR ][605] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  33328. Traceback (most recent call last):
  33329. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  33330. self._call_hook_for(message, "workflow", message)
  33331. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33332. return True, func(*args, **kwargs)
  33333. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  33334. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33335. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33336. return True, func(*args, **kwargs)
  33337. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33338. return func(*args, **kwargs)
  33339. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  33340. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  33341. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  33342. conn.write_line(cmd)
  33343. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  33344. self.ensure_open()
  33345. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  33346. self.open()
  33347. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  33348. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  33349. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  33350. raise attempt.get()
  33351. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  33352. six.reraise(self.value[0], self.value[1], self.value[2])
  33353. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  33354. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  33355. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33356. self._serial.open()
  33357. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33358. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33359. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33360. 2020-08-04 12:59:01,890 [gpio_spi_conn :109 ][WARNING ][608] Expected ack '12' but got '255'
  33361. 2020-08-04 12:59:01,893 [spm_conn :139 ][WARNING ][608] Unable to get status: Expected ack '12' but got '255'
  33362. 2020-08-04 12:59:01,897 [gpio_spi_conn :109 ][WARNING ][608] Expected ack '12' but got '255'
  33363. 2020-08-04 12:59:02,400 [gpio_spi_conn :109 ][WARNING ][608] Expected ack '12' but got '255'
  33364. 2020-08-04 12:59:02,904 [gpio_spi_conn :109 ][WARNING ][608] Expected ack '12' but got '255'
  33365. 2020-08-04 12:59:02,906 [spm_conn :82 ][WARNING ][608] Unable to send noop: Expected ack '12' but got '255'
  33366. 2020-08-04 12:59:03,384 [serial_conn :79 ][ERROR ][605] Failed to open serial connection
  33367. Traceback (most recent call last):
  33368. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33369. self._serial.open()
  33370. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33371. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33372. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33373. 2020-08-04 12:59:03,410 [gpio_spi_conn :109 ][WARNING ][608] Expected ack '12' but got '255'
  33374. 2020-08-04 12:59:03,914 [gpio_spi_conn :109 ][WARNING ][608] Expected ack '12' but got '255'
  33375. 2020-08-04 12:59:04,389 [serial_conn :79 ][ERROR ][605] Failed to open serial connection
  33376. Traceback (most recent call last):
  33377. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33378. self._serial.open()
  33379. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33380. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33381. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33382. 2020-08-04 12:59:04,417 [gpio_spi_conn :109 ][WARNING ][608] Expected ack '12' but got '255'
  33383. 2020-08-04 12:59:04,420 [spm_conn :82 ][WARNING ][608] Unable to send noop: Expected ack '12' but got '255'
  33384. 2020-08-04 12:59:04,924 [gpio_spi_conn :109 ][WARNING ][608] Expected ack '12' but got '255'
  33385. 2020-08-04 12:59:05,393 [serial_conn :79 ][ERROR ][605] Failed to open serial connection
  33386. Traceback (most recent call last):
  33387. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33388. self._serial.open()
  33389. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33390. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33391. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33392. 2020-08-04 12:59:05,404 [messaging :742 ][ERROR ][605] Exception while processing event: {'tag': 'ec2x/req/4d81e85c-a89e-4473-9a19-08bd576ab337', 'data': {'_stamp': '2020-08-04T12:58:40.861786', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/4d81e85c-a89e-4473-9a19-08bd576ab337', 'kwargs': {'cooldown_delay': None}}}
  33393. Traceback (most recent call last):
  33394. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  33395. res = self.process(message)
  33396. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  33397. result = func(message, **settings)
  33398. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  33399. found, result = self._call_hook_for(message, "workflow", message)
  33400. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33401. return True, func(*args, **kwargs)
  33402. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  33403. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33404. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33405. return True, func(*args, **kwargs)
  33406. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33407. return func(*args, **kwargs)
  33408. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  33409. return _exec(cmd, **kwargs)
  33410. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  33411. conn.write_line(cmd)
  33412. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  33413. self.ensure_open()
  33414. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  33415. self.open()
  33416. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  33417. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  33418. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  33419. raise attempt.get()
  33420. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  33421. six.reraise(self.value[0], self.value[1], self.value[2])
  33422. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  33423. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  33424. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33425. self._serial.open()
  33426. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33427. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33428. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33429. 2020-08-04 12:59:05,428 [gpio_spi_conn :109 ][WARNING ][608] Expected ack '12' but got '255'
  33430. 2020-08-04 12:59:05,932 [gpio_spi_conn :109 ][WARNING ][608] Expected ack '12' but got '255'
  33431. 2020-08-04 12:59:05,935 [spm_conn :82 ][WARNING ][608] Unable to send noop: Expected ack '12' but got '255'
  33432. 2020-08-04 12:59:05,937 [messaging :208 ][ERROR ][608] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  33433. Traceback (most recent call last):
  33434. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  33435. self._call_hook_for(message, "workflow", message)
  33436. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33437. return True, func(*args, **kwargs)
  33438. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  33439. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33440. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33441. return True, func(*args, **kwargs)
  33442. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33443. return func(*args, **kwargs)
  33444. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  33445. conn.heartbeat()
  33446. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  33447. self.noop()
  33448. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  33449. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  33450. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  33451. raise attempt.get()
  33452. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  33453. six.reraise(self.value[0], self.value[1], self.value[2])
  33454. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  33455. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  33456. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  33457. self._begin_message()
  33458. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  33459. self.recv(ack=ACK_MESSAGE_BEGIN)
  33460. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  33461. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  33462. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  33463. raise attempt.get()
  33464. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  33465. six.reraise(self.value[0], self.value[1], self.value[2])
  33466. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  33467. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  33468. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  33469. raise Exception(msg)
  33470. Exception: Expected ack '12' but got '255'
  33471. 2020-08-04 12:59:07,548 [messaging :208 ][ERROR ][606] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  33472. Traceback (most recent call last):
  33473. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  33474. self._call_hook_for(message, "workflow", message)
  33475. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33476. return True, func(*args, **kwargs)
  33477. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  33478. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33479. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33480. return True, func(*args, **kwargs)
  33481. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33482. return func(*args, **kwargs)
  33483. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  33484. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  33485. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  33486. res = query("AT+QGPSLOC={:d}".format(mode))
  33487. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  33488. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  33489. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  33490. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  33491. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  33492. raise salt.exceptions.CommandExecutionError(message["error"])
  33493. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33494. 2020-08-04 12:59:12,618 [serial_conn :79 ][ERROR ][605] Failed to open serial connection
  33495. Traceback (most recent call last):
  33496. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33497. self._serial.open()
  33498. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33499. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33500. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33501. 2020-08-04 12:59:13,622 [serial_conn :79 ][ERROR ][605] Failed to open serial connection
  33502. Traceback (most recent call last):
  33503. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33504. self._serial.open()
  33505. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33506. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33507. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33508. 2020-08-04 12:59:14,627 [serial_conn :79 ][ERROR ][605] Failed to open serial connection
  33509. Traceback (most recent call last):
  33510. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33511. self._serial.open()
  33512. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33513. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33514. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33515. 2020-08-04 12:59:14,630 [messaging :742 ][ERROR ][605] Exception while processing event: {'tag': 'ec2x/req/992bd730-656c-466e-9fd7-4486884c4757', 'data': {'_stamp': '2020-08-04T12:59:12.611576', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/992bd730-656c-466e-9fd7-4486884c4757', 'kwargs': {'cooldown_delay': None}}}
  33516. Traceback (most recent call last):
  33517. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  33518. res = self.process(message)
  33519. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  33520. result = func(message, **settings)
  33521. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  33522. found, result = self._call_hook_for(message, "workflow", message)
  33523. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33524. return True, func(*args, **kwargs)
  33525. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  33526. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33527. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33528. return True, func(*args, **kwargs)
  33529. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33530. return func(*args, **kwargs)
  33531. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  33532. return _exec(cmd, **kwargs)
  33533. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  33534. conn.write_line(cmd)
  33535. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  33536. self.ensure_open()
  33537. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  33538. self.open()
  33539. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  33540. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  33541. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  33542. raise attempt.get()
  33543. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  33544. six.reraise(self.value[0], self.value[1], self.value[2])
  33545. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  33546. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  33547. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33548. self._serial.open()
  33549. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33550. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33551. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33552. 2020-08-04 12:59:14,649 [messaging :206 ][ERROR ][606] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  33553. Traceback (most recent call last):
  33554. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  33555. self._call_hook_for(message, "workflow", message)
  33556. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33557. return True, func(*args, **kwargs)
  33558. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  33559. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33560. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33561. return True, func(*args, **kwargs)
  33562. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33563. return func(*args, **kwargs)
  33564. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  33565. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  33566. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  33567. res = query("AT+QGPSLOC={:d}".format(mode))
  33568. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  33569. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  33570. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  33571. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  33572. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  33573. raise salt.exceptions.CommandExecutionError(message["error"])
  33574. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33575. 2020-08-04 12:59:17,958 [obd.obd :107 ][ERROR ][694] Failed to use explicit port '/dev/serial0'
  33576. Traceback (most recent call last):
  33577. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  33578. self.interface.open(baudrate, protocol=protocol)
  33579. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  33580. self.set_protocol(prot.pop("id", None), **prot)
  33581. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  33582. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  33583. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  33584. self._protocol = self._auto_protocol(**kwargs)
  33585. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  33586. res_0100 = self._verify_protocol("auto", test=not verify)
  33587. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  33588. for line in self.query("0100", parse=False, read_timeout=10):
  33589. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  33590. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  33591. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  33592. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  33593. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  33594. data = self._port.read(self._port.in_waiting or 1)
  33595. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  33596. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  33597. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  33598. sys.exit(salt.defaults.exitcodes.EX_OK)
  33599. SystemExit: 0
  33600. 2020-08-04 12:59:17,992 [obd.obd :120 ][WARNING ][694] Cannot load commands - no connection to bus
  33601. 2020-08-04 12:59:18,022 [obd.interfaces.elm327:730 ][ERROR ][694] Failed to relay command 'STSLCS' to interface
  33602. Traceback (most recent call last):
  33603. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  33604. lines = self.send(cmd, raw_response=raw_response)
  33605. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  33606. raise ELM327Error(self.ERRORS[line], code=line)
  33607. ELM327Error: Operation interrupted by a received RS232 character
  33608. 2020-08-04 12:59:18,025 [messaging :742 ][ERROR ][694] Exception while processing event: {'tag': 'obd/req/ccc2c548-f7aa-463a-a105-fb37fa016d36', 'data': {'_stamp': '2020-08-04T12:59:12.466106', 'handler': 'execute', '_event_tag': 'obd/req/ccc2c548-f7aa-463a-a105-fb37fa016d36', 'args': ['STSLCS']}}
  33609. Traceback (most recent call last):
  33610. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  33611. res = self.process(message)
  33612. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  33613. result = func(message, **settings)
  33614. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  33615. found, result = self._call_hook_for(message, "workflow", message)
  33616. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33617. return True, func(*args, **kwargs)
  33618. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  33619. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33620. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33621. return True, func(*args, **kwargs)
  33622. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33623. return func(*args, **kwargs)
  33624. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  33625. res = conn.execute(cmd)
  33626. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  33627. return func(self, *args, **kwargs)
  33628. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  33629. return self._obd.execute(cmd, **kwargs)
  33630. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  33631. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  33632. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  33633. lines = self.send(cmd, raw_response=raw_response)
  33634. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  33635. raise ELM327Error(self.ERRORS[line], code=line)
  33636. ELM327Error: Operation interrupted by a received RS232 character
  33637. 2020-08-04 12:59:18,747 [salt.utils.parsers:1050][WARNING ][405] Minion received a SIGTERM. Exiting.
  33638. 2020-08-04 12:59:19,286 [messaging :871 ][WARNING ][805] No reply message with tag 'obd/res/ccc2c548-f7aa-463a-a105-fb37fa016d36' received within timeout of 30 secs
  33639. 2020-08-04 12:59:19,290 [salt.state :292 ][ERROR ][805] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  33640. 2020-08-04 12:59:36,234 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  33641. 2020-08-04 12:59:36,245 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  33642. 2020-08-04 12:59:36,250 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  33643. 2020-08-04 12:59:36,910 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  33644. Traceback (most recent call last):
  33645. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33646. self._serial.open()
  33647. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33648. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33649. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33650. 2020-08-04 12:59:37,925 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  33651. Traceback (most recent call last):
  33652. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33653. self._serial.open()
  33654. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33655. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33656. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33657. 2020-08-04 12:59:38,290 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  33658. 2020-08-04 12:59:38,793 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  33659. 2020-08-04 12:59:38,929 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  33660. Traceback (most recent call last):
  33661. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33662. self._serial.open()
  33663. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33664. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33665. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33666. 2020-08-04 12:59:39,296 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  33667. 2020-08-04 12:59:39,298 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  33668. 2020-08-04 12:59:39,571 [messaging :208 ][ERROR ][617] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  33669. Traceback (most recent call last):
  33670. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  33671. self._call_hook_for(message, "workflow", message)
  33672. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33673. return True, func(*args, **kwargs)
  33674. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  33675. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33676. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33677. return True, func(*args, **kwargs)
  33678. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33679. return func(*args, **kwargs)
  33680. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  33681. res = _exec("AT+CCLK?")
  33682. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  33683. conn.write_line(cmd)
  33684. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  33685. self.ensure_open()
  33686. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  33687. self.open()
  33688. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  33689. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  33690. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  33691. raise attempt.get()
  33692. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  33693. six.reraise(self.value[0], self.value[1], self.value[2])
  33694. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  33695. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  33696. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33697. self._serial.open()
  33698. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33699. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33700. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33701. 2020-08-04 12:59:39,803 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  33702. 2020-08-04 12:59:40,306 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  33703. 2020-08-04 12:59:40,809 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  33704. 2020-08-04 12:59:40,812 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  33705. 2020-08-04 12:59:41,315 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  33706. 2020-08-04 12:59:41,819 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  33707. 2020-08-04 12:59:42,322 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  33708. 2020-08-04 12:59:42,326 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  33709. 2020-08-04 12:59:42,332 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  33710. 2020-08-04 12:59:42,837 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  33711. 2020-08-04 12:59:43,341 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  33712. 2020-08-04 12:59:43,346 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  33713. 2020-08-04 12:59:43,787 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  33714. Traceback (most recent call last):
  33715. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33716. self._serial.open()
  33717. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33718. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33719. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33720. 2020-08-04 12:59:43,852 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  33721. 2020-08-04 12:59:44,355 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  33722. 2020-08-04 12:59:44,822 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  33723. Traceback (most recent call last):
  33724. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33725. self._serial.open()
  33726. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33727. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33728. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33729. 2020-08-04 12:59:44,859 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  33730. 2020-08-04 12:59:44,862 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  33731. 2020-08-04 12:59:45,366 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  33732. 2020-08-04 12:59:45,836 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  33733. Traceback (most recent call last):
  33734. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33735. self._serial.open()
  33736. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33737. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33738. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33739. 2020-08-04 12:59:45,850 [messaging :742 ][ERROR ][617] Exception while processing event: {'tag': 'ec2x/req/efada8b0-45cd-4e09-8794-e6021b767f88', 'data': {'_stamp': '2020-08-04T12:59:36.319158', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/efada8b0-45cd-4e09-8794-e6021b767f88', 'kwargs': {'cooldown_delay': None}}}
  33740. Traceback (most recent call last):
  33741. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  33742. res = self.process(message)
  33743. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  33744. result = func(message, **settings)
  33745. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  33746. found, result = self._call_hook_for(message, "workflow", message)
  33747. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33748. return True, func(*args, **kwargs)
  33749. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  33750. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33751. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33752. return True, func(*args, **kwargs)
  33753. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33754. return func(*args, **kwargs)
  33755. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  33756. return _exec(cmd, **kwargs)
  33757. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  33758. conn.write_line(cmd)
  33759. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  33760. self.ensure_open()
  33761. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  33762. self.open()
  33763. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  33764. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  33765. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  33766. raise attempt.get()
  33767. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  33768. six.reraise(self.value[0], self.value[1], self.value[2])
  33769. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  33770. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  33771. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33772. self._serial.open()
  33773. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33774. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33775. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33776. 2020-08-04 12:59:45,870 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  33777. 2020-08-04 12:59:46,377 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  33778. 2020-08-04 12:59:46,380 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  33779. 2020-08-04 12:59:46,383 [messaging :208 ][ERROR ][620] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  33780. Traceback (most recent call last):
  33781. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  33782. self._call_hook_for(message, "workflow", message)
  33783. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33784. return True, func(*args, **kwargs)
  33785. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  33786. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33787. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33788. return True, func(*args, **kwargs)
  33789. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33790. return func(*args, **kwargs)
  33791. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  33792. conn.heartbeat()
  33793. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  33794. self.noop()
  33795. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  33796. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  33797. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  33798. raise attempt.get()
  33799. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  33800. six.reraise(self.value[0], self.value[1], self.value[2])
  33801. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  33802. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  33803. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  33804. self._begin_message()
  33805. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  33806. self.recv(ack=ACK_MESSAGE_BEGIN)
  33807. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  33808. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  33809. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  33810. raise attempt.get()
  33811. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  33812. six.reraise(self.value[0], self.value[1], self.value[2])
  33813. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  33814. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  33815. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  33816. raise Exception(msg)
  33817. Exception: Expected ack '12' but got '255'
  33818. 2020-08-04 12:59:46,548 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  33819. Traceback (most recent call last):
  33820. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33821. self._serial.open()
  33822. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33823. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33824. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33825. 2020-08-04 12:59:47,553 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  33826. Traceback (most recent call last):
  33827. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33828. self._serial.open()
  33829. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33830. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33831. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33832. 2020-08-04 12:59:48,070 [messaging :208 ][ERROR ][618] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  33833. Traceback (most recent call last):
  33834. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  33835. self._call_hook_for(message, "workflow", message)
  33836. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33837. return True, func(*args, **kwargs)
  33838. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  33839. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33840. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33841. return True, func(*args, **kwargs)
  33842. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33843. return func(*args, **kwargs)
  33844. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  33845. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  33846. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  33847. res = query("AT+QGPSLOC={:d}".format(mode))
  33848. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  33849. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  33850. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  33851. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  33852. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  33853. raise salt.exceptions.CommandExecutionError(message["error"])
  33854. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33855. 2020-08-04 12:59:48,557 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  33856. Traceback (most recent call last):
  33857. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33858. self._serial.open()
  33859. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33860. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33861. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33862. 2020-08-04 12:59:49,071 [messaging :206 ][ERROR ][617] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  33863. Traceback (most recent call last):
  33864. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  33865. self._call_hook_for(message, "workflow", message)
  33866. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33867. return True, func(*args, **kwargs)
  33868. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  33869. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33870. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33871. return True, func(*args, **kwargs)
  33872. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33873. return func(*args, **kwargs)
  33874. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  33875. res = _exec("AT+CCLK?")
  33876. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  33877. conn.write_line(cmd)
  33878. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  33879. self.ensure_open()
  33880. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  33881. self.open()
  33882. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  33883. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  33884. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  33885. raise attempt.get()
  33886. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  33887. six.reraise(self.value[0], self.value[1], self.value[2])
  33888. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  33889. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  33890. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33891. self._serial.open()
  33892. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33893. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33894. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33895. 2020-08-04 13:00:03,978 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][707] Timeout after 1.28205128205 second(s) waiting for interrupt
  33896. 2020-08-04 13:00:04,628 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  33897. Traceback (most recent call last):
  33898. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33899. self._serial.open()
  33900. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33901. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33902. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33903. 2020-08-04 13:00:05,634 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  33904. Traceback (most recent call last):
  33905. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33906. self._serial.open()
  33907. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33908. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33909. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33910. 2020-08-04 13:00:06,647 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  33911. Traceback (most recent call last):
  33912. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33913. self._serial.open()
  33914. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33915. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33916. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33917. 2020-08-04 13:00:07,181 [messaging :206 ][ERROR ][617] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  33918. Traceback (most recent call last):
  33919. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  33920. self._call_hook_for(message, "workflow", message)
  33921. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33922. return True, func(*args, **kwargs)
  33923. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  33924. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33925. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33926. return True, func(*args, **kwargs)
  33927. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33928. return func(*args, **kwargs)
  33929. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  33930. res = _exec("AT+CCLK?")
  33931. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  33932. conn.write_line(cmd)
  33933. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  33934. self.ensure_open()
  33935. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  33936. self.open()
  33937. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  33938. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  33939. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  33940. raise attempt.get()
  33941. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  33942. six.reraise(self.value[0], self.value[1], self.value[2])
  33943. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  33944. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  33945. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33946. self._serial.open()
  33947. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33948. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33949. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33950. 2020-08-04 13:00:07,183 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  33951. Traceback (most recent call last):
  33952. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33953. self._serial.open()
  33954. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33955. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33956. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33957. 2020-08-04 13:00:08,197 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  33958. Traceback (most recent call last):
  33959. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33960. self._serial.open()
  33961. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33962. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33963. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33964. 2020-08-04 13:00:09,201 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  33965. Traceback (most recent call last):
  33966. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  33967. self._serial.open()
  33968. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  33969. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  33970. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  33971. 2020-08-04 13:00:09,204 [messaging :742 ][ERROR ][617] Exception while processing event: {'tag': 'ec2x/req/8cfc3065-3960-483e-8dd7-6b1a32fd2b41', 'data': {'_stamp': '2020-08-04T13:00:03.983641', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/8cfc3065-3960-483e-8dd7-6b1a32fd2b41', 'kwargs': {'cooldown_delay': None}}}
  33972. Traceback (most recent call last):
  33973. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  33974. res = self.process(message)
  33975. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  33976. result = func(message, **settings)
  33977. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  33978. found, result = self._call_hook_for(message, "workflow", message)
  33979. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33980. return True, func(*args, **kwargs)
  33981. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  33982. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  33983. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  33984. return True, func(*args, **kwargs)
  33985. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  33986. return func(*args, **kwargs)
  33987. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  33988. return _exec(cmd, **kwargs)
  33989. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  33990. conn.write_line(cmd)
  33991. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  33992. self.ensure_open()
  33993. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  33994. self.open()
  33995. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  33996. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  33997. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  33998. raise attempt.get()
  33999. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  34000. six.reraise(self.value[0], self.value[1], self.value[2])
  34001. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  34002. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  34003. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34004. self._serial.open()
  34005. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34006. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34007. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34008. 2020-08-04 13:00:09,231 [messaging :206 ][ERROR ][618] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  34009. Traceback (most recent call last):
  34010. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  34011. self._call_hook_for(message, "workflow", message)
  34012. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34013. return True, func(*args, **kwargs)
  34014. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  34015. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34016. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34017. return True, func(*args, **kwargs)
  34018. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34019. return func(*args, **kwargs)
  34020. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  34021. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  34022. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  34023. res = query("AT+QGPSLOC={:d}".format(mode))
  34024. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  34025. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  34026. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  34027. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  34028. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  34029. raise salt.exceptions.CommandExecutionError(message["error"])
  34030. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34031. 2020-08-04 13:00:12,241 [salt.loaded.int.module.cmdmod:693 ][ERROR ][617] Command '['timedatectl', 'status']' failed with return code: 1
  34032. 2020-08-04 13:00:12,244 [salt.loaded.int.module.cmdmod:695 ][ERROR ][617] stdout: Failed to query server: Operation canceled
  34033. 2020-08-04 13:00:12,246 [salt.loaded.int.module.cmdmod:699 ][ERROR ][617] retcode: 1
  34034. 2020-08-04 13:00:12,248 [messaging :208 ][ERROR ][617] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  34035. Traceback (most recent call last):
  34036. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  34037. self._call_hook_for(message, "workflow", message)
  34038. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34039. return True, func(*args, **kwargs)
  34040. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  34041. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34042. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34043. return True, func(*args, **kwargs)
  34044. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34045. return func(*args, **kwargs)
  34046. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 215, in sync_time_handler
  34047. if not force and status["ntp_synchronized"] == "yes":
  34048. KeyError: 'ntp_synchronized'
  34049. 2020-08-04 13:00:13,237 [obd.obd :107 ][ERROR ][706] Failed to use explicit port '/dev/serial0'
  34050. Traceback (most recent call last):
  34051. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  34052. self.interface.open(baudrate, protocol=protocol)
  34053. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  34054. self.set_protocol(prot.pop("id", None), **prot)
  34055. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  34056. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  34057. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  34058. self._protocol = self._auto_protocol(**kwargs)
  34059. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  34060. res_0100 = self._verify_protocol("auto", test=not verify)
  34061. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  34062. for line in self.query("0100", parse=False, read_timeout=10):
  34063. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  34064. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  34065. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  34066. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  34067. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  34068. data = self._port.read(self._port.in_waiting or 1)
  34069. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  34070. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  34071. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  34072. sys.exit(salt.defaults.exitcodes.EX_OK)
  34073. SystemExit: 0
  34074. 2020-08-04 13:00:13,275 [obd.obd :120 ][WARNING ][706] Cannot load commands - no connection to bus
  34075. 2020-08-04 13:00:13,307 [obd.interfaces.elm327:730 ][ERROR ][706] Failed to relay command 'STSLCS' to interface
  34076. Traceback (most recent call last):
  34077. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  34078. lines = self.send(cmd, raw_response=raw_response)
  34079. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  34080. raise ELM327Error(self.ERRORS[line], code=line)
  34081. ELM327Error: Operation interrupted by a received RS232 character
  34082. 2020-08-04 13:00:13,310 [messaging :742 ][ERROR ][706] Exception while processing event: {'tag': 'obd/req/212a0f99-52d1-4b62-8741-cff9a4a65797', 'data': {'_stamp': '2020-08-04T13:00:07.685458', 'handler': 'execute', '_event_tag': 'obd/req/212a0f99-52d1-4b62-8741-cff9a4a65797', 'args': ['STSLCS']}}
  34083. Traceback (most recent call last):
  34084. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  34085. res = self.process(message)
  34086. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  34087. result = func(message, **settings)
  34088. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  34089. found, result = self._call_hook_for(message, "workflow", message)
  34090. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34091. return True, func(*args, **kwargs)
  34092. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  34093. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34094. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34095. return True, func(*args, **kwargs)
  34096. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34097. return func(*args, **kwargs)
  34098. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  34099. res = conn.execute(cmd)
  34100. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  34101. return func(self, *args, **kwargs)
  34102. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  34103. return self._obd.execute(cmd, **kwargs)
  34104. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  34105. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  34106. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  34107. lines = self.send(cmd, raw_response=raw_response)
  34108. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  34109. raise ELM327Error(self.ERRORS[line], code=line)
  34110. ELM327Error: Operation interrupted by a received RS232 character
  34111. 2020-08-04 13:00:14,000 [salt.utils.parsers:1050][WARNING ][417] Minion received a SIGTERM. Exiting.
  34112. 2020-08-04 13:00:14,541 [messaging :871 ][WARNING ][831] No reply message with tag 'obd/res/212a0f99-52d1-4b62-8741-cff9a4a65797' received within timeout of 30 secs
  34113. 2020-08-04 13:00:14,544 [salt.state :292 ][ERROR ][831] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  34114. 2020-08-04 13:00:30,962 [gpio_spi_conn :42 ][WARNING ][627] Unable to clear buffer - got unexpected value: 255
  34115. 2020-08-04 13:00:30,973 [gpio_spi_conn :42 ][WARNING ][627] Unable to clear buffer - got unexpected value: 255
  34116. 2020-08-04 13:00:30,980 [gpio_spi_conn :42 ][WARNING ][627] Unable to clear buffer - got unexpected value: 255
  34117. 2020-08-04 13:00:31,624 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  34118. Traceback (most recent call last):
  34119. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34120. self._serial.open()
  34121. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34122. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34123. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34124. 2020-08-04 13:00:32,643 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  34125. Traceback (most recent call last):
  34126. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34127. self._serial.open()
  34128. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34129. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34130. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34131. 2020-08-04 13:00:33,021 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  34132. 2020-08-04 13:00:33,525 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  34133. 2020-08-04 13:00:33,647 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  34134. Traceback (most recent call last):
  34135. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34136. self._serial.open()
  34137. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34138. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34139. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34140. 2020-08-04 13:00:34,028 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  34141. 2020-08-04 13:00:34,030 [spm_conn :139 ][WARNING ][627] Unable to get status: Expected ack '12' but got '255'
  34142. 2020-08-04 13:00:34,213 [messaging :208 ][ERROR ][624] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  34143. Traceback (most recent call last):
  34144. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  34145. self._call_hook_for(message, "workflow", message)
  34146. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34147. return True, func(*args, **kwargs)
  34148. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  34149. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34150. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34151. return True, func(*args, **kwargs)
  34152. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34153. return func(*args, **kwargs)
  34154. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  34155. res = _exec("AT+CCLK?")
  34156. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  34157. conn.write_line(cmd)
  34158. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  34159. self.ensure_open()
  34160. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  34161. self.open()
  34162. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  34163. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  34164. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  34165. raise attempt.get()
  34166. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  34167. six.reraise(self.value[0], self.value[1], self.value[2])
  34168. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  34169. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  34170. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34171. self._serial.open()
  34172. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34173. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34174. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34175. 2020-08-04 13:00:34,533 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  34176. 2020-08-04 13:00:49,481 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][715] Timeout after 1.28205128205 second(s) waiting for interrupt
  34177. 2020-08-04 13:00:49,547 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  34178. Traceback (most recent call last):
  34179. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34180. self._serial.open()
  34181. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34182. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34183. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34184. 2020-08-04 13:00:49,861 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  34185. 2020-08-04 13:00:50,364 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  34186. 2020-08-04 13:00:50,368 [spm_conn :139 ][WARNING ][627] Unable to get status: Expected ack '12' but got '255'
  34187. 2020-08-04 13:00:50,552 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  34188. Traceback (most recent call last):
  34189. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34190. self._serial.open()
  34191. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34192. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34193. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34194. 2020-08-04 13:00:50,876 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  34195. 2020-08-04 13:00:51,382 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  34196. 2020-08-04 13:00:51,557 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  34197. Traceback (most recent call last):
  34198. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34199. self._serial.open()
  34200. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34201. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34202. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34203. 2020-08-04 13:00:51,562 [messaging :206 ][ERROR ][624] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  34204. Traceback (most recent call last):
  34205. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  34206. self._call_hook_for(message, "workflow", message)
  34207. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34208. return True, func(*args, **kwargs)
  34209. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  34210. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34211. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34212. return True, func(*args, **kwargs)
  34213. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34214. return func(*args, **kwargs)
  34215. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  34216. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  34217. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  34218. conn.write_line(cmd)
  34219. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  34220. self.ensure_open()
  34221. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  34222. self.open()
  34223. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  34224. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  34225. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  34226. raise attempt.get()
  34227. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  34228. six.reraise(self.value[0], self.value[1], self.value[2])
  34229. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  34230. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  34231. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34232. self._serial.open()
  34233. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34234. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34235. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34236. 2020-08-04 13:00:51,888 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  34237. 2020-08-04 13:00:51,890 [spm_conn :139 ][WARNING ][627] Unable to get status: Expected ack '12' but got '255'
  34238. 2020-08-04 13:00:51,895 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  34239. 2020-08-04 13:00:52,398 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  34240. 2020-08-04 13:00:52,901 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  34241. 2020-08-04 13:00:52,904 [spm_conn :82 ][WARNING ][627] Unable to send noop: Expected ack '12' but got '255'
  34242. 2020-08-04 13:00:53,360 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  34243. Traceback (most recent call last):
  34244. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34245. self._serial.open()
  34246. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34247. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34248. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34249. 2020-08-04 13:00:53,409 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  34250. 2020-08-04 13:00:53,916 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  34251. 2020-08-04 13:00:54,364 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  34252. Traceback (most recent call last):
  34253. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34254. self._serial.open()
  34255. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34256. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34257. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34258. 2020-08-04 13:00:54,420 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  34259. 2020-08-04 13:00:54,422 [spm_conn :82 ][WARNING ][627] Unable to send noop: Expected ack '12' but got '255'
  34260. 2020-08-04 13:00:54,927 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  34261. 2020-08-04 13:00:55,369 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  34262. Traceback (most recent call last):
  34263. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34264. self._serial.open()
  34265. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34266. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34267. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34268. 2020-08-04 13:00:55,380 [messaging :742 ][ERROR ][624] Exception while processing event: {'tag': 'ec2x/req/2db8ea70-9d8c-43e3-be70-d8b5760e30a7', 'data': {'_stamp': '2020-08-04T13:00:31.029179', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/2db8ea70-9d8c-43e3-be70-d8b5760e30a7', 'kwargs': {'cooldown_delay': None}}}
  34269. Traceback (most recent call last):
  34270. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  34271. res = self.process(message)
  34272. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  34273. result = func(message, **settings)
  34274. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  34275. found, result = self._call_hook_for(message, "workflow", message)
  34276. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34277. return True, func(*args, **kwargs)
  34278. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  34279. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34280. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34281. return True, func(*args, **kwargs)
  34282. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34283. return func(*args, **kwargs)
  34284. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  34285. return _exec(cmd, **kwargs)
  34286. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  34287. conn.write_line(cmd)
  34288. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  34289. self.ensure_open()
  34290. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  34291. self.open()
  34292. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  34293. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  34294. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  34295. raise attempt.get()
  34296. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  34297. six.reraise(self.value[0], self.value[1], self.value[2])
  34298. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  34299. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  34300. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34301. self._serial.open()
  34302. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34303. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34304. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34305. 2020-08-04 13:00:55,430 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  34306. 2020-08-04 13:00:55,934 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  34307. 2020-08-04 13:00:55,937 [spm_conn :82 ][WARNING ][627] Unable to send noop: Expected ack '12' but got '255'
  34308. 2020-08-04 13:00:55,940 [messaging :208 ][ERROR ][627] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  34309. Traceback (most recent call last):
  34310. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  34311. self._call_hook_for(message, "workflow", message)
  34312. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34313. return True, func(*args, **kwargs)
  34314. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  34315. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34316. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34317. return True, func(*args, **kwargs)
  34318. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34319. return func(*args, **kwargs)
  34320. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  34321. conn.heartbeat()
  34322. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  34323. self.noop()
  34324. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  34325. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  34326. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  34327. raise attempt.get()
  34328. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  34329. six.reraise(self.value[0], self.value[1], self.value[2])
  34330. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  34331. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  34332. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  34333. self._begin_message()
  34334. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  34335. self.recv(ack=ACK_MESSAGE_BEGIN)
  34336. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  34337. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  34338. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  34339. raise attempt.get()
  34340. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  34341. six.reraise(self.value[0], self.value[1], self.value[2])
  34342. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  34343. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  34344. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  34345. raise Exception(msg)
  34346. Exception: Expected ack '12' but got '255'
  34347. 2020-08-04 13:00:57,461 [messaging :208 ][ERROR ][625] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  34348. Traceback (most recent call last):
  34349. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  34350. self._call_hook_for(message, "workflow", message)
  34351. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34352. return True, func(*args, **kwargs)
  34353. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  34354. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34355. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34356. return True, func(*args, **kwargs)
  34357. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34358. return func(*args, **kwargs)
  34359. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  34360. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  34361. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  34362. res = query("AT+QGPSLOC={:d}".format(mode))
  34363. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  34364. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  34365. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  34366. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  34367. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  34368. raise salt.exceptions.CommandExecutionError(message["error"])
  34369. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34370. 2020-08-04 13:01:02,532 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  34371. Traceback (most recent call last):
  34372. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34373. self._serial.open()
  34374. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34375. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34376. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34377. 2020-08-04 13:01:03,537 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  34378. Traceback (most recent call last):
  34379. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34380. self._serial.open()
  34381. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34382. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34383. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34384. 2020-08-04 13:01:04,541 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  34385. Traceback (most recent call last):
  34386. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34387. self._serial.open()
  34388. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34389. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34390. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34391. 2020-08-04 13:01:04,543 [messaging :742 ][ERROR ][624] Exception while processing event: {'tag': 'ec2x/req/8fab2968-360d-43d0-a66c-3858e598e324', 'data': {'_stamp': '2020-08-04T13:01:02.525938', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/8fab2968-360d-43d0-a66c-3858e598e324', 'kwargs': {'cooldown_delay': None}}}
  34392. Traceback (most recent call last):
  34393. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  34394. res = self.process(message)
  34395. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  34396. result = func(message, **settings)
  34397. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  34398. found, result = self._call_hook_for(message, "workflow", message)
  34399. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34400. return True, func(*args, **kwargs)
  34401. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  34402. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34403. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34404. return True, func(*args, **kwargs)
  34405. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34406. return func(*args, **kwargs)
  34407. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  34408. return _exec(cmd, **kwargs)
  34409. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  34410. conn.write_line(cmd)
  34411. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  34412. self.ensure_open()
  34413. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  34414. self.open()
  34415. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  34416. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  34417. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  34418. raise attempt.get()
  34419. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  34420. six.reraise(self.value[0], self.value[1], self.value[2])
  34421. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  34422. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  34423. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34424. self._serial.open()
  34425. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34426. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34427. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34428. 2020-08-04 13:01:04,562 [messaging :206 ][ERROR ][625] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  34429. Traceback (most recent call last):
  34430. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  34431. self._call_hook_for(message, "workflow", message)
  34432. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34433. return True, func(*args, **kwargs)
  34434. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  34435. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34436. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34437. return True, func(*args, **kwargs)
  34438. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34439. return func(*args, **kwargs)
  34440. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  34441. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  34442. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  34443. res = query("AT+QGPSLOC={:d}".format(mode))
  34444. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  34445. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  34446. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  34447. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  34448. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  34449. raise salt.exceptions.CommandExecutionError(message["error"])
  34450. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34451. 2020-08-04 13:01:08,041 [obd.obd :107 ][ERROR ][713] Failed to use explicit port '/dev/serial0'
  34452. Traceback (most recent call last):
  34453. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  34454. self.interface.open(baudrate, protocol=protocol)
  34455. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  34456. self.set_protocol(prot.pop("id", None), **prot)
  34457. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  34458. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  34459. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  34460. self._protocol = self._auto_protocol(**kwargs)
  34461. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  34462. res_0100 = self._verify_protocol("auto", test=not verify)
  34463. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  34464. for line in self.query("0100", parse=False, read_timeout=10):
  34465. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  34466. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  34467. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  34468. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  34469. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  34470. data = self._port.read(self._port.in_waiting or 1)
  34471. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  34472. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  34473. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  34474. sys.exit(salt.defaults.exitcodes.EX_OK)
  34475. SystemExit: 0
  34476. 2020-08-04 13:01:08,075 [obd.obd :120 ][WARNING ][713] Cannot load commands - no connection to bus
  34477. 2020-08-04 13:01:08,105 [obd.interfaces.elm327:730 ][ERROR ][713] Failed to relay command 'STSLCS' to interface
  34478. Traceback (most recent call last):
  34479. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  34480. lines = self.send(cmd, raw_response=raw_response)
  34481. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  34482. raise ELM327Error(self.ERRORS[line], code=line)
  34483. ELM327Error: Operation interrupted by a received RS232 character
  34484. 2020-08-04 13:01:08,108 [messaging :742 ][ERROR ][713] Exception while processing event: {'tag': 'obd/req/8208040d-67b2-4810-bae0-59416f6b4928', 'data': {'_stamp': '2020-08-04T13:01:02.483554', 'handler': 'execute', '_event_tag': 'obd/req/8208040d-67b2-4810-bae0-59416f6b4928', 'args': ['STSLCS']}}
  34485. Traceback (most recent call last):
  34486. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  34487. res = self.process(message)
  34488. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  34489. result = func(message, **settings)
  34490. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  34491. found, result = self._call_hook_for(message, "workflow", message)
  34492. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34493. return True, func(*args, **kwargs)
  34494. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  34495. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34496. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34497. return True, func(*args, **kwargs)
  34498. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34499. return func(*args, **kwargs)
  34500. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  34501. res = conn.execute(cmd)
  34502. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  34503. return func(self, *args, **kwargs)
  34504. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  34505. return self._obd.execute(cmd, **kwargs)
  34506. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  34507. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  34508. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  34509. lines = self.send(cmd, raw_response=raw_response)
  34510. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  34511. raise ELM327Error(self.ERRORS[line], code=line)
  34512. ELM327Error: Operation interrupted by a received RS232 character
  34513. 2020-08-04 13:01:08,816 [salt.utils.parsers:1050][WARNING ][424] Minion received a SIGTERM. Exiting.
  34514. 2020-08-04 13:01:09,357 [messaging :871 ][WARNING ][824] No reply message with tag 'obd/res/8208040d-67b2-4810-bae0-59416f6b4928' received within timeout of 30 secs
  34515. 2020-08-04 13:01:09,363 [salt.state :292 ][ERROR ][824] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  34516. 2020-08-04 13:01:26,095 [gpio_spi_conn :42 ][WARNING ][630] Unable to clear buffer - got unexpected value: 255
  34517. 2020-08-04 13:01:26,106 [gpio_spi_conn :42 ][WARNING ][630] Unable to clear buffer - got unexpected value: 255
  34518. 2020-08-04 13:01:26,113 [gpio_spi_conn :42 ][WARNING ][630] Unable to clear buffer - got unexpected value: 255
  34519. 2020-08-04 13:01:26,749 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  34520. Traceback (most recent call last):
  34521. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34522. self._serial.open()
  34523. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34524. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34525. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34526. 2020-08-04 13:01:27,767 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  34527. Traceback (most recent call last):
  34528. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34529. self._serial.open()
  34530. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34531. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34532. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34533. 2020-08-04 13:01:28,149 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  34534. 2020-08-04 13:01:28,652 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  34535. 2020-08-04 13:01:28,771 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  34536. Traceback (most recent call last):
  34537. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34538. self._serial.open()
  34539. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34540. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34541. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34542. 2020-08-04 13:01:29,155 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  34543. 2020-08-04 13:01:29,157 [spm_conn :139 ][WARNING ][630] Unable to get status: Expected ack '12' but got '255'
  34544. 2020-08-04 13:01:29,334 [messaging :208 ][ERROR ][627] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  34545. Traceback (most recent call last):
  34546. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  34547. self._call_hook_for(message, "workflow", message)
  34548. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34549. return True, func(*args, **kwargs)
  34550. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  34551. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34552. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34553. return True, func(*args, **kwargs)
  34554. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34555. return func(*args, **kwargs)
  34556. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  34557. res = _exec("AT+CCLK?")
  34558. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  34559. conn.write_line(cmd)
  34560. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  34561. self.ensure_open()
  34562. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  34563. self.open()
  34564. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  34565. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  34566. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  34567. raise attempt.get()
  34568. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  34569. six.reraise(self.value[0], self.value[1], self.value[2])
  34570. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  34571. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  34572. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34573. self._serial.open()
  34574. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34575. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34576. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34577. 2020-08-04 13:01:29,661 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  34578. 2020-08-04 13:01:44,452 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  34579. Traceback (most recent call last):
  34580. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34581. self._serial.open()
  34582. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34583. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34584. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34585. 2020-08-04 13:01:44,761 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  34586. 2020-08-04 13:01:45,264 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  34587. 2020-08-04 13:01:45,266 [spm_conn :139 ][WARNING ][630] Unable to get status: Expected ack '12' but got '255'
  34588. 2020-08-04 13:01:45,457 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  34589. Traceback (most recent call last):
  34590. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34591. self._serial.open()
  34592. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34593. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34594. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34595. 2020-08-04 13:01:45,770 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  34596. 2020-08-04 13:01:46,273 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  34597. 2020-08-04 13:01:46,461 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  34598. Traceback (most recent call last):
  34599. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34600. self._serial.open()
  34601. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34602. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34603. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34604. 2020-08-04 13:01:46,464 [messaging :206 ][ERROR ][627] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  34605. Traceback (most recent call last):
  34606. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  34607. self._call_hook_for(message, "workflow", message)
  34608. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34609. return True, func(*args, **kwargs)
  34610. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  34611. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34612. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34613. return True, func(*args, **kwargs)
  34614. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34615. return func(*args, **kwargs)
  34616. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  34617. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  34618. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  34619. conn.write_line(cmd)
  34620. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  34621. self.ensure_open()
  34622. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  34623. self.open()
  34624. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  34625. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  34626. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  34627. raise attempt.get()
  34628. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  34629. six.reraise(self.value[0], self.value[1], self.value[2])
  34630. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  34631. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  34632. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34633. self._serial.open()
  34634. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34635. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34636. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34637. 2020-08-04 13:01:46,777 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  34638. 2020-08-04 13:01:46,779 [spm_conn :139 ][WARNING ][630] Unable to get status: Expected ack '12' but got '255'
  34639. 2020-08-04 13:01:46,782 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  34640. 2020-08-04 13:01:47,285 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  34641. 2020-08-04 13:01:47,787 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  34642. 2020-08-04 13:01:47,790 [spm_conn :82 ][WARNING ][630] Unable to send noop: Expected ack '12' but got '255'
  34643. 2020-08-04 13:01:48,222 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  34644. Traceback (most recent call last):
  34645. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34646. self._serial.open()
  34647. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34648. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34649. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34650. 2020-08-04 13:01:48,293 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  34651. 2020-08-04 13:01:48,796 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  34652. 2020-08-04 13:01:49,227 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  34653. Traceback (most recent call last):
  34654. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34655. self._serial.open()
  34656. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34657. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34658. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34659. 2020-08-04 13:01:49,300 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  34660. 2020-08-04 13:01:49,302 [spm_conn :82 ][WARNING ][630] Unable to send noop: Expected ack '12' but got '255'
  34661. 2020-08-04 13:01:49,805 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  34662. 2020-08-04 13:01:50,231 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  34663. Traceback (most recent call last):
  34664. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34665. self._serial.open()
  34666. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34667. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34668. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34669. 2020-08-04 13:01:50,235 [messaging :742 ][ERROR ][627] Exception while processing event: {'tag': 'ec2x/req/8bc11c48-8057-47f5-b15c-bab644c04368', 'data': {'_stamp': '2020-08-04T13:01:26.166538', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/8bc11c48-8057-47f5-b15c-bab644c04368', 'kwargs': {'cooldown_delay': None}}}
  34670. Traceback (most recent call last):
  34671. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  34672. res = self.process(message)
  34673. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  34674. result = func(message, **settings)
  34675. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  34676. found, result = self._call_hook_for(message, "workflow", message)
  34677. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34678. return True, func(*args, **kwargs)
  34679. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  34680. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34681. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34682. return True, func(*args, **kwargs)
  34683. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34684. return func(*args, **kwargs)
  34685. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  34686. return _exec(cmd, **kwargs)
  34687. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  34688. conn.write_line(cmd)
  34689. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  34690. self.ensure_open()
  34691. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  34692. self.open()
  34693. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  34694. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  34695. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  34696. raise attempt.get()
  34697. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  34698. six.reraise(self.value[0], self.value[1], self.value[2])
  34699. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  34700. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  34701. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34702. self._serial.open()
  34703. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34704. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34705. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34706. 2020-08-04 13:01:50,308 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  34707. 2020-08-04 13:01:50,811 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  34708. 2020-08-04 13:01:50,813 [spm_conn :82 ][WARNING ][630] Unable to send noop: Expected ack '12' but got '255'
  34709. 2020-08-04 13:01:50,816 [messaging :208 ][ERROR ][630] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  34710. Traceback (most recent call last):
  34711. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  34712. self._call_hook_for(message, "workflow", message)
  34713. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34714. return True, func(*args, **kwargs)
  34715. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  34716. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34717. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34718. return True, func(*args, **kwargs)
  34719. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34720. return func(*args, **kwargs)
  34721. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  34722. conn.heartbeat()
  34723. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  34724. self.noop()
  34725. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  34726. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  34727. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  34728. raise attempt.get()
  34729. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  34730. six.reraise(self.value[0], self.value[1], self.value[2])
  34731. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  34732. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  34733. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  34734. self._begin_message()
  34735. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  34736. self.recv(ack=ACK_MESSAGE_BEGIN)
  34737. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  34738. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  34739. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  34740. raise attempt.get()
  34741. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  34742. six.reraise(self.value[0], self.value[1], self.value[2])
  34743. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  34744. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  34745. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  34746. raise Exception(msg)
  34747. Exception: Expected ack '12' but got '255'
  34748. 2020-08-04 13:01:52,432 [messaging :208 ][ERROR ][628] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  34749. Traceback (most recent call last):
  34750. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  34751. self._call_hook_for(message, "workflow", message)
  34752. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34753. return True, func(*args, **kwargs)
  34754. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  34755. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34756. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34757. return True, func(*args, **kwargs)
  34758. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34759. return func(*args, **kwargs)
  34760. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  34761. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  34762. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  34763. res = query("AT+QGPSLOC={:d}".format(mode))
  34764. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  34765. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  34766. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  34767. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  34768. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  34769. raise salt.exceptions.CommandExecutionError(message["error"])
  34770. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34771. 2020-08-04 13:01:57,497 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  34772. Traceback (most recent call last):
  34773. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34774. self._serial.open()
  34775. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34776. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34777. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34778. 2020-08-04 13:01:58,501 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  34779. Traceback (most recent call last):
  34780. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34781. self._serial.open()
  34782. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34783. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34784. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34785. 2020-08-04 13:01:59,509 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  34786. Traceback (most recent call last):
  34787. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34788. self._serial.open()
  34789. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34790. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34791. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34792. 2020-08-04 13:01:59,512 [messaging :742 ][ERROR ][627] Exception while processing event: {'tag': 'ec2x/req/f698a8ec-7a91-454a-bce5-b34cb8640ba1', 'data': {'_stamp': '2020-08-04T13:01:57.490405', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/f698a8ec-7a91-454a-bce5-b34cb8640ba1', 'kwargs': {'cooldown_delay': None}}}
  34793. Traceback (most recent call last):
  34794. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  34795. res = self.process(message)
  34796. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  34797. result = func(message, **settings)
  34798. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  34799. found, result = self._call_hook_for(message, "workflow", message)
  34800. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34801. return True, func(*args, **kwargs)
  34802. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  34803. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34804. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34805. return True, func(*args, **kwargs)
  34806. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34807. return func(*args, **kwargs)
  34808. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  34809. return _exec(cmd, **kwargs)
  34810. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  34811. conn.write_line(cmd)
  34812. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  34813. self.ensure_open()
  34814. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  34815. self.open()
  34816. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  34817. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  34818. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  34819. raise attempt.get()
  34820. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  34821. six.reraise(self.value[0], self.value[1], self.value[2])
  34822. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  34823. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  34824. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34825. self._serial.open()
  34826. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34827. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34828. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34829. 2020-08-04 13:01:59,541 [messaging :206 ][ERROR ][628] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  34830. Traceback (most recent call last):
  34831. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  34832. self._call_hook_for(message, "workflow", message)
  34833. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34834. return True, func(*args, **kwargs)
  34835. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  34836. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34837. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34838. return True, func(*args, **kwargs)
  34839. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34840. return func(*args, **kwargs)
  34841. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  34842. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  34843. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  34844. res = query("AT+QGPSLOC={:d}".format(mode))
  34845. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  34846. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  34847. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  34848. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  34849. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  34850. raise salt.exceptions.CommandExecutionError(message["error"])
  34851. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34852. 2020-08-04 13:02:02,858 [obd.obd :107 ][ERROR ][717] Failed to use explicit port '/dev/serial0'
  34853. Traceback (most recent call last):
  34854. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  34855. self.interface.open(baudrate, protocol=protocol)
  34856. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  34857. self.set_protocol(prot.pop("id", None), **prot)
  34858. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  34859. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  34860. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  34861. self._protocol = self._auto_protocol(**kwargs)
  34862. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  34863. res_0100 = self._verify_protocol("auto", test=not verify)
  34864. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  34865. for line in self.query("0100", parse=False, read_timeout=10):
  34866. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  34867. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  34868. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  34869. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  34870. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  34871. data = self._port.read(self._port.in_waiting or 1)
  34872. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  34873. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  34874. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  34875. sys.exit(salt.defaults.exitcodes.EX_OK)
  34876. SystemExit: 0
  34877. 2020-08-04 13:02:02,912 [obd.obd :120 ][WARNING ][717] Cannot load commands - no connection to bus
  34878. 2020-08-04 13:02:02,940 [obd.interfaces.elm327:730 ][ERROR ][717] Failed to relay command 'STSLCS' to interface
  34879. Traceback (most recent call last):
  34880. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  34881. lines = self.send(cmd, raw_response=raw_response)
  34882. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  34883. raise ELM327Error(self.ERRORS[line], code=line)
  34884. ELM327Error: Operation interrupted by a received RS232 character
  34885. 2020-08-04 13:02:02,943 [messaging :742 ][ERROR ][717] Exception while processing event: {'tag': 'obd/req/776cd0bc-ba9b-4ae0-b53d-650528056e21', 'data': {'_stamp': '2020-08-04T13:01:57.307082', 'handler': 'execute', '_event_tag': 'obd/req/776cd0bc-ba9b-4ae0-b53d-650528056e21', 'args': ['STSLCS']}}
  34886. Traceback (most recent call last):
  34887. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  34888. res = self.process(message)
  34889. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  34890. result = func(message, **settings)
  34891. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  34892. found, result = self._call_hook_for(message, "workflow", message)
  34893. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34894. return True, func(*args, **kwargs)
  34895. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  34896. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34897. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34898. return True, func(*args, **kwargs)
  34899. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34900. return func(*args, **kwargs)
  34901. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  34902. res = conn.execute(cmd)
  34903. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  34904. return func(self, *args, **kwargs)
  34905. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  34906. return self._obd.execute(cmd, **kwargs)
  34907. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  34908. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  34909. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  34910. lines = self.send(cmd, raw_response=raw_response)
  34911. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  34912. raise ELM327Error(self.ERRORS[line], code=line)
  34913. ELM327Error: Operation interrupted by a received RS232 character
  34914. 2020-08-04 13:02:03,730 [salt.utils.parsers:1050][WARNING ][425] Minion received a SIGTERM. Exiting.
  34915. 2020-08-04 13:02:04,270 [messaging :871 ][WARNING ][827] No reply message with tag 'obd/res/776cd0bc-ba9b-4ae0-b53d-650528056e21' received within timeout of 30 secs
  34916. 2020-08-04 13:02:04,274 [salt.state :292 ][ERROR ][827] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  34917. 2020-08-04 13:02:21,057 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  34918. 2020-08-04 13:02:21,077 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  34919. 2020-08-04 13:02:21,087 [gpio_spi_conn :42 ][WARNING ][620] Unable to clear buffer - got unexpected value: 255
  34920. 2020-08-04 13:02:21,732 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  34921. Traceback (most recent call last):
  34922. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34923. self._serial.open()
  34924. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34925. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34926. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34927. 2020-08-04 13:02:22,754 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  34928. Traceback (most recent call last):
  34929. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34930. self._serial.open()
  34931. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34932. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34933. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34934. 2020-08-04 13:02:23,109 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  34935. 2020-08-04 13:02:23,614 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  34936. 2020-08-04 13:02:23,767 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  34937. Traceback (most recent call last):
  34938. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34939. self._serial.open()
  34940. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34941. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34942. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34943. 2020-08-04 13:02:24,119 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  34944. 2020-08-04 13:02:24,121 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  34945. 2020-08-04 13:02:24,447 [messaging :208 ][ERROR ][617] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  34946. Traceback (most recent call last):
  34947. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  34948. self._call_hook_for(message, "workflow", message)
  34949. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34950. return True, func(*args, **kwargs)
  34951. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  34952. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  34953. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  34954. return True, func(*args, **kwargs)
  34955. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  34956. return func(*args, **kwargs)
  34957. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  34958. res = _exec("AT+CCLK?")
  34959. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  34960. conn.write_line(cmd)
  34961. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  34962. self.ensure_open()
  34963. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  34964. self.open()
  34965. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  34966. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  34967. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  34968. raise attempt.get()
  34969. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  34970. six.reraise(self.value[0], self.value[1], self.value[2])
  34971. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  34972. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  34973. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34974. self._serial.open()
  34975. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34976. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34977. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34978. 2020-08-04 13:02:24,624 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  34979. 2020-08-04 13:02:39,416 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][705] Timeout after 1.28205128205 second(s) waiting for interrupt
  34980. 2020-08-04 13:02:39,491 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  34981. Traceback (most recent call last):
  34982. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34983. self._serial.open()
  34984. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34985. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34986. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34987. 2020-08-04 13:02:39,689 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  34988. 2020-08-04 13:02:40,192 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  34989. 2020-08-04 13:02:40,199 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  34990. 2020-08-04 13:02:40,495 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  34991. Traceback (most recent call last):
  34992. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  34993. self._serial.open()
  34994. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  34995. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  34996. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  34997. 2020-08-04 13:02:40,704 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  34998. 2020-08-04 13:02:41,209 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  34999. 2020-08-04 13:02:41,500 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  35000. Traceback (most recent call last):
  35001. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35002. self._serial.open()
  35003. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35004. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35005. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35006. 2020-08-04 13:02:41,503 [messaging :206 ][ERROR ][617] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  35007. Traceback (most recent call last):
  35008. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  35009. self._call_hook_for(message, "workflow", message)
  35010. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35011. return True, func(*args, **kwargs)
  35012. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  35013. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35014. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35015. return True, func(*args, **kwargs)
  35016. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35017. return func(*args, **kwargs)
  35018. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  35019. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  35020. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  35021. conn.write_line(cmd)
  35022. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  35023. self.ensure_open()
  35024. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  35025. self.open()
  35026. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  35027. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  35028. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  35029. raise attempt.get()
  35030. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  35031. six.reraise(self.value[0], self.value[1], self.value[2])
  35032. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  35033. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  35034. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35035. self._serial.open()
  35036. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35037. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35038. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35039. 2020-08-04 13:02:41,715 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  35040. 2020-08-04 13:02:41,717 [spm_conn :139 ][WARNING ][620] Unable to get status: Expected ack '12' but got '255'
  35041. 2020-08-04 13:02:41,720 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  35042. 2020-08-04 13:02:42,223 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  35043. 2020-08-04 13:02:42,727 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  35044. 2020-08-04 13:02:42,730 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  35045. 2020-08-04 13:02:43,103 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  35046. Traceback (most recent call last):
  35047. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35048. self._serial.open()
  35049. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35050. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35051. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35052. 2020-08-04 13:02:43,236 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  35053. 2020-08-04 13:02:43,744 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  35054. 2020-08-04 13:02:44,107 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  35055. Traceback (most recent call last):
  35056. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35057. self._serial.open()
  35058. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35059. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35060. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35061. 2020-08-04 13:02:44,247 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  35062. 2020-08-04 13:02:44,250 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  35063. 2020-08-04 13:02:44,754 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  35064. 2020-08-04 13:02:45,111 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  35065. Traceback (most recent call last):
  35066. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35067. self._serial.open()
  35068. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35069. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35070. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35071. 2020-08-04 13:02:45,114 [messaging :742 ][ERROR ][617] Exception while processing event: {'tag': 'ec2x/req/9b750669-dfa7-4a32-a7cc-55181b8c2594', 'data': {'_stamp': '2020-08-04T13:02:21.145495', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/9b750669-dfa7-4a32-a7cc-55181b8c2594', 'kwargs': {'cooldown_delay': None}}}
  35072. Traceback (most recent call last):
  35073. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  35074. res = self.process(message)
  35075. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  35076. result = func(message, **settings)
  35077. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  35078. found, result = self._call_hook_for(message, "workflow", message)
  35079. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35080. return True, func(*args, **kwargs)
  35081. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  35082. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35083. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35084. return True, func(*args, **kwargs)
  35085. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35086. return func(*args, **kwargs)
  35087. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  35088. return _exec(cmd, **kwargs)
  35089. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  35090. conn.write_line(cmd)
  35091. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  35092. self.ensure_open()
  35093. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  35094. self.open()
  35095. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  35096. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  35097. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  35098. raise attempt.get()
  35099. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  35100. six.reraise(self.value[0], self.value[1], self.value[2])
  35101. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  35102. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  35103. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35104. self._serial.open()
  35105. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35106. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35107. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35108. 2020-08-04 13:02:45,257 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  35109. 2020-08-04 13:02:45,760 [gpio_spi_conn :109 ][WARNING ][620] Expected ack '12' but got '255'
  35110. 2020-08-04 13:02:45,763 [spm_conn :82 ][WARNING ][620] Unable to send noop: Expected ack '12' but got '255'
  35111. 2020-08-04 13:02:45,766 [messaging :208 ][ERROR ][620] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  35112. Traceback (most recent call last):
  35113. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  35114. self._call_hook_for(message, "workflow", message)
  35115. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35116. return True, func(*args, **kwargs)
  35117. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  35118. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35119. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35120. return True, func(*args, **kwargs)
  35121. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35122. return func(*args, **kwargs)
  35123. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  35124. conn.heartbeat()
  35125. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  35126. self.noop()
  35127. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  35128. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  35129. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  35130. raise attempt.get()
  35131. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  35132. six.reraise(self.value[0], self.value[1], self.value[2])
  35133. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  35134. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  35135. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  35136. self._begin_message()
  35137. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  35138. self.recv(ack=ACK_MESSAGE_BEGIN)
  35139. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  35140. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  35141. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  35142. raise attempt.get()
  35143. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  35144. six.reraise(self.value[0], self.value[1], self.value[2])
  35145. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  35146. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  35147. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  35148. raise Exception(msg)
  35149. Exception: Expected ack '12' but got '255'
  35150. 2020-08-04 13:02:47,217 [messaging :208 ][ERROR ][618] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  35151. Traceback (most recent call last):
  35152. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  35153. self._call_hook_for(message, "workflow", message)
  35154. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35155. return True, func(*args, **kwargs)
  35156. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  35157. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35158. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35159. return True, func(*args, **kwargs)
  35160. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35161. return func(*args, **kwargs)
  35162. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  35163. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  35164. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  35165. res = query("AT+QGPSLOC={:d}".format(mode))
  35166. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  35167. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  35168. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  35169. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  35170. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  35171. raise salt.exceptions.CommandExecutionError(message["error"])
  35172. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35173. 2020-08-04 13:02:52,263 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  35174. Traceback (most recent call last):
  35175. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35176. self._serial.open()
  35177. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35178. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35179. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35180. 2020-08-04 13:02:53,267 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  35181. Traceback (most recent call last):
  35182. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35183. self._serial.open()
  35184. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35185. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35186. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35187. 2020-08-04 13:02:54,271 [serial_conn :79 ][ERROR ][617] Failed to open serial connection
  35188. Traceback (most recent call last):
  35189. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35190. self._serial.open()
  35191. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35192. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35193. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35194. 2020-08-04 13:02:54,274 [messaging :742 ][ERROR ][617] Exception while processing event: {'tag': 'ec2x/req/5301ba4b-3c3f-4412-937b-4ce1adc9d908', 'data': {'_stamp': '2020-08-04T13:02:52.252156', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/5301ba4b-3c3f-4412-937b-4ce1adc9d908', 'kwargs': {'cooldown_delay': None}}}
  35195. Traceback (most recent call last):
  35196. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  35197. res = self.process(message)
  35198. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  35199. result = func(message, **settings)
  35200. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  35201. found, result = self._call_hook_for(message, "workflow", message)
  35202. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35203. return True, func(*args, **kwargs)
  35204. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  35205. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35206. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35207. return True, func(*args, **kwargs)
  35208. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35209. return func(*args, **kwargs)
  35210. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  35211. return _exec(cmd, **kwargs)
  35212. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  35213. conn.write_line(cmd)
  35214. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  35215. self.ensure_open()
  35216. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  35217. self.open()
  35218. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  35219. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  35220. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  35221. raise attempt.get()
  35222. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  35223. six.reraise(self.value[0], self.value[1], self.value[2])
  35224. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  35225. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  35226. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35227. self._serial.open()
  35228. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35229. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35230. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35231. 2020-08-04 13:02:54,292 [messaging :206 ][ERROR ][618] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  35232. Traceback (most recent call last):
  35233. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  35234. self._call_hook_for(message, "workflow", message)
  35235. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35236. return True, func(*args, **kwargs)
  35237. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  35238. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35239. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35240. return True, func(*args, **kwargs)
  35241. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35242. return func(*args, **kwargs)
  35243. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  35244. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  35245. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  35246. res = query("AT+QGPSLOC={:d}".format(mode))
  35247. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  35248. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  35249. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  35250. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  35251. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  35252. raise salt.exceptions.CommandExecutionError(message["error"])
  35253. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35254. 2020-08-04 13:02:57,539 [obd.obd :107 ][ERROR ][704] Failed to use explicit port '/dev/serial0'
  35255. Traceback (most recent call last):
  35256. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  35257. self.interface.open(baudrate, protocol=protocol)
  35258. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  35259. self.set_protocol(prot.pop("id", None), **prot)
  35260. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  35261. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  35262. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  35263. self._protocol = self._auto_protocol(**kwargs)
  35264. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  35265. res_0100 = self._verify_protocol("auto", test=not verify)
  35266. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  35267. for line in self.query("0100", parse=False, read_timeout=10):
  35268. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  35269. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  35270. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  35271. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  35272. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  35273. data = self._port.read(self._port.in_waiting or 1)
  35274. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  35275. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  35276. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  35277. sys.exit(salt.defaults.exitcodes.EX_OK)
  35278. SystemExit: 0
  35279. 2020-08-04 13:02:57,589 [obd.obd :120 ][WARNING ][704] Cannot load commands - no connection to bus
  35280. 2020-08-04 13:02:57,617 [obd.interfaces.elm327:730 ][ERROR ][704] Failed to relay command 'STSLCS' to interface
  35281. Traceback (most recent call last):
  35282. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  35283. lines = self.send(cmd, raw_response=raw_response)
  35284. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  35285. raise ELM327Error(self.ERRORS[line], code=line)
  35286. ELM327Error: Operation interrupted by a received RS232 character
  35287. 2020-08-04 13:02:57,620 [messaging :742 ][ERROR ][704] Exception while processing event: {'tag': 'obd/req/4e254ca8-e0c0-42f2-9be6-d5f33a7b2ea5', 'data': {'_stamp': '2020-08-04T13:02:52.199311', 'handler': 'execute', '_event_tag': 'obd/req/4e254ca8-e0c0-42f2-9be6-d5f33a7b2ea5', 'args': ['STSLCS']}}
  35288. Traceback (most recent call last):
  35289. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  35290. res = self.process(message)
  35291. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  35292. result = func(message, **settings)
  35293. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  35294. found, result = self._call_hook_for(message, "workflow", message)
  35295. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35296. return True, func(*args, **kwargs)
  35297. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  35298. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35299. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35300. return True, func(*args, **kwargs)
  35301. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35302. return func(*args, **kwargs)
  35303. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  35304. res = conn.execute(cmd)
  35305. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  35306. return func(self, *args, **kwargs)
  35307. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  35308. return self._obd.execute(cmd, **kwargs)
  35309. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  35310. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  35311. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  35312. lines = self.send(cmd, raw_response=raw_response)
  35313. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  35314. raise ELM327Error(self.ERRORS[line], code=line)
  35315. ELM327Error: Operation interrupted by a received RS232 character
  35316. 2020-08-04 13:02:58,218 [salt.utils.parsers:1050][WARNING ][415] Minion received a SIGTERM. Exiting.
  35317. 2020-08-04 13:02:58,757 [messaging :871 ][WARNING ][817] No reply message with tag 'obd/res/4e254ca8-e0c0-42f2-9be6-d5f33a7b2ea5' received within timeout of 30 secs
  35318. 2020-08-04 13:02:58,763 [salt.state :292 ][ERROR ][817] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  35319. 2020-08-04 13:03:14,962 [gpio_spi_conn :42 ][WARNING ][617] Unable to clear buffer - got unexpected value: 255
  35320. 2020-08-04 13:03:14,983 [gpio_spi_conn :42 ][WARNING ][617] Unable to clear buffer - got unexpected value: 255
  35321. 2020-08-04 13:03:14,987 [gpio_spi_conn :42 ][WARNING ][617] Unable to clear buffer - got unexpected value: 255
  35322. 2020-08-04 13:03:15,608 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  35323. Traceback (most recent call last):
  35324. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35325. self._serial.open()
  35326. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35327. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35328. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35329. 2020-08-04 13:03:16,624 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  35330. Traceback (most recent call last):
  35331. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35332. self._serial.open()
  35333. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35334. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35335. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35336. 2020-08-04 13:03:17,010 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  35337. 2020-08-04 13:03:17,513 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  35338. 2020-08-04 13:03:17,630 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  35339. Traceback (most recent call last):
  35340. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35341. self._serial.open()
  35342. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35343. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35344. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35345. 2020-08-04 13:03:18,018 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  35346. 2020-08-04 13:03:18,020 [spm_conn :139 ][WARNING ][617] Unable to get status: Expected ack '12' but got '255'
  35347. 2020-08-04 13:03:18,253 [messaging :208 ][ERROR ][614] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  35348. Traceback (most recent call last):
  35349. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  35350. self._call_hook_for(message, "workflow", message)
  35351. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35352. return True, func(*args, **kwargs)
  35353. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  35354. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35355. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35356. return True, func(*args, **kwargs)
  35357. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35358. return func(*args, **kwargs)
  35359. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  35360. res = _exec("AT+CCLK?")
  35361. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  35362. conn.write_line(cmd)
  35363. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  35364. self.ensure_open()
  35365. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  35366. self.open()
  35367. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  35368. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  35369. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  35370. raise attempt.get()
  35371. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  35372. six.reraise(self.value[0], self.value[1], self.value[2])
  35373. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  35374. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  35375. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35376. self._serial.open()
  35377. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35378. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35379. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35380. 2020-08-04 13:03:18,524 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  35381. 2020-08-04 13:03:33,742 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][704] Timeout after 1.28205128205 second(s) waiting for interrupt
  35382. 2020-08-04 13:03:33,794 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  35383. Traceback (most recent call last):
  35384. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35385. self._serial.open()
  35386. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35387. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35388. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35389. 2020-08-04 13:03:34,064 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  35390. 2020-08-04 13:03:34,568 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  35391. 2020-08-04 13:03:34,570 [spm_conn :139 ][WARNING ][617] Unable to get status: Expected ack '12' but got '255'
  35392. 2020-08-04 13:03:34,798 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  35393. Traceback (most recent call last):
  35394. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35395. self._serial.open()
  35396. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35397. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35398. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35399. 2020-08-04 13:03:35,074 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  35400. 2020-08-04 13:03:35,577 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  35401. 2020-08-04 13:03:35,803 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  35402. Traceback (most recent call last):
  35403. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35404. self._serial.open()
  35405. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35406. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35407. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35408. 2020-08-04 13:03:35,806 [messaging :206 ][ERROR ][614] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  35409. Traceback (most recent call last):
  35410. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  35411. self._call_hook_for(message, "workflow", message)
  35412. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35413. return True, func(*args, **kwargs)
  35414. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  35415. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35416. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35417. return True, func(*args, **kwargs)
  35418. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35419. return func(*args, **kwargs)
  35420. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  35421. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  35422. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  35423. conn.write_line(cmd)
  35424. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  35425. self.ensure_open()
  35426. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  35427. self.open()
  35428. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  35429. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  35430. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  35431. raise attempt.get()
  35432. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  35433. six.reraise(self.value[0], self.value[1], self.value[2])
  35434. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  35435. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  35436. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35437. self._serial.open()
  35438. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35439. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35440. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35441. 2020-08-04 13:03:36,081 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  35442. 2020-08-04 13:03:36,083 [spm_conn :139 ][WARNING ][617] Unable to get status: Expected ack '12' but got '255'
  35443. 2020-08-04 13:03:36,087 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  35444. 2020-08-04 13:03:36,591 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  35445. 2020-08-04 13:03:37,094 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  35446. 2020-08-04 13:03:37,099 [spm_conn :82 ][WARNING ][617] Unable to send noop: Expected ack '12' but got '255'
  35447. 2020-08-04 13:03:37,515 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  35448. Traceback (most recent call last):
  35449. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35450. self._serial.open()
  35451. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35452. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35453. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35454. 2020-08-04 13:03:37,605 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  35455. 2020-08-04 13:03:38,108 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  35456. 2020-08-04 13:03:38,535 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  35457. Traceback (most recent call last):
  35458. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35459. self._serial.open()
  35460. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35461. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35462. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35463. 2020-08-04 13:03:38,612 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  35464. 2020-08-04 13:03:38,615 [spm_conn :82 ][WARNING ][617] Unable to send noop: Expected ack '12' but got '255'
  35465. 2020-08-04 13:03:39,119 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  35466. 2020-08-04 13:03:39,540 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  35467. Traceback (most recent call last):
  35468. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35469. self._serial.open()
  35470. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35471. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35472. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35473. 2020-08-04 13:03:39,551 [messaging :742 ][ERROR ][614] Exception while processing event: {'tag': 'ec2x/req/3d0280e9-3f4c-430f-867d-fede612eff48', 'data': {'_stamp': '2020-08-04T13:03:15.038489', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/3d0280e9-3f4c-430f-867d-fede612eff48', 'kwargs': {'cooldown_delay': None}}}
  35474. Traceback (most recent call last):
  35475. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  35476. res = self.process(message)
  35477. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  35478. result = func(message, **settings)
  35479. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  35480. found, result = self._call_hook_for(message, "workflow", message)
  35481. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35482. return True, func(*args, **kwargs)
  35483. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  35484. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35485. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35486. return True, func(*args, **kwargs)
  35487. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35488. return func(*args, **kwargs)
  35489. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  35490. return _exec(cmd, **kwargs)
  35491. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  35492. conn.write_line(cmd)
  35493. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  35494. self.ensure_open()
  35495. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  35496. self.open()
  35497. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  35498. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  35499. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  35500. raise attempt.get()
  35501. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  35502. six.reraise(self.value[0], self.value[1], self.value[2])
  35503. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  35504. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  35505. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35506. self._serial.open()
  35507. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35508. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35509. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35510. 2020-08-04 13:03:39,622 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  35511. 2020-08-04 13:03:40,126 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  35512. 2020-08-04 13:03:40,129 [spm_conn :82 ][WARNING ][617] Unable to send noop: Expected ack '12' but got '255'
  35513. 2020-08-04 13:03:40,132 [messaging :208 ][ERROR ][617] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  35514. Traceback (most recent call last):
  35515. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  35516. self._call_hook_for(message, "workflow", message)
  35517. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35518. return True, func(*args, **kwargs)
  35519. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  35520. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35521. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35522. return True, func(*args, **kwargs)
  35523. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35524. return func(*args, **kwargs)
  35525. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  35526. conn.heartbeat()
  35527. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  35528. self.noop()
  35529. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  35530. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  35531. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  35532. raise attempt.get()
  35533. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  35534. six.reraise(self.value[0], self.value[1], self.value[2])
  35535. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  35536. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  35537. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  35538. self._begin_message()
  35539. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  35540. self.recv(ack=ACK_MESSAGE_BEGIN)
  35541. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  35542. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  35543. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  35544. raise attempt.get()
  35545. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  35546. six.reraise(self.value[0], self.value[1], self.value[2])
  35547. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  35548. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  35549. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  35550. raise Exception(msg)
  35551. Exception: Expected ack '12' but got '255'
  35552. 2020-08-04 13:03:41,692 [messaging :208 ][ERROR ][615] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  35553. Traceback (most recent call last):
  35554. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  35555. self._call_hook_for(message, "workflow", message)
  35556. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35557. return True, func(*args, **kwargs)
  35558. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  35559. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35560. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35561. return True, func(*args, **kwargs)
  35562. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35563. return func(*args, **kwargs)
  35564. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  35565. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  35566. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  35567. res = query("AT+QGPSLOC={:d}".format(mode))
  35568. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  35569. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  35570. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  35571. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  35572. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  35573. raise salt.exceptions.CommandExecutionError(message["error"])
  35574. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35575. 2020-08-04 13:03:46,729 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  35576. Traceback (most recent call last):
  35577. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35578. self._serial.open()
  35579. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35580. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35581. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35582. 2020-08-04 13:03:47,733 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  35583. Traceback (most recent call last):
  35584. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35585. self._serial.open()
  35586. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35587. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35588. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35589. 2020-08-04 13:03:48,738 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  35590. Traceback (most recent call last):
  35591. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35592. self._serial.open()
  35593. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35594. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35595. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35596. 2020-08-04 13:03:48,741 [messaging :742 ][ERROR ][614] Exception while processing event: {'tag': 'ec2x/req/042404c4-a2ad-4a85-a1f8-b0a36f1cf741', 'data': {'_stamp': '2020-08-04T13:03:46.721913', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/042404c4-a2ad-4a85-a1f8-b0a36f1cf741', 'kwargs': {'cooldown_delay': None}}}
  35597. Traceback (most recent call last):
  35598. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  35599. res = self.process(message)
  35600. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  35601. result = func(message, **settings)
  35602. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  35603. found, result = self._call_hook_for(message, "workflow", message)
  35604. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35605. return True, func(*args, **kwargs)
  35606. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  35607. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35608. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35609. return True, func(*args, **kwargs)
  35610. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35611. return func(*args, **kwargs)
  35612. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  35613. return _exec(cmd, **kwargs)
  35614. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  35615. conn.write_line(cmd)
  35616. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  35617. self.ensure_open()
  35618. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  35619. self.open()
  35620. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  35621. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  35622. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  35623. raise attempt.get()
  35624. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  35625. six.reraise(self.value[0], self.value[1], self.value[2])
  35626. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  35627. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  35628. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35629. self._serial.open()
  35630. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35631. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35632. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35633. 2020-08-04 13:03:48,761 [messaging :206 ][ERROR ][615] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  35634. Traceback (most recent call last):
  35635. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  35636. self._call_hook_for(message, "workflow", message)
  35637. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35638. return True, func(*args, **kwargs)
  35639. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  35640. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35641. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35642. return True, func(*args, **kwargs)
  35643. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35644. return func(*args, **kwargs)
  35645. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  35646. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  35647. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  35648. res = query("AT+QGPSLOC={:d}".format(mode))
  35649. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  35650. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  35651. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  35652. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  35653. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  35654. raise salt.exceptions.CommandExecutionError(message["error"])
  35655. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35656. 2020-08-04 13:03:52,223 [obd.obd :107 ][ERROR ][703] Failed to use explicit port '/dev/serial0'
  35657. Traceback (most recent call last):
  35658. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  35659. self.interface.open(baudrate, protocol=protocol)
  35660. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  35661. self.set_protocol(prot.pop("id", None), **prot)
  35662. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  35663. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  35664. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  35665. self._protocol = self._auto_protocol(**kwargs)
  35666. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  35667. res_0100 = self._verify_protocol("auto", test=not verify)
  35668. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  35669. for line in self.query("0100", parse=False, read_timeout=10):
  35670. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  35671. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  35672. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  35673. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  35674. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  35675. data = self._port.read(self._port.in_waiting or 1)
  35676. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  35677. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  35678. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  35679. sys.exit(salt.defaults.exitcodes.EX_OK)
  35680. SystemExit: 0
  35681. 2020-08-04 13:03:52,247 [obd.obd :120 ][WARNING ][703] Cannot load commands - no connection to bus
  35682. 2020-08-04 13:03:52,274 [obd.interfaces.elm327:730 ][ERROR ][703] Failed to relay command 'STSLCS' to interface
  35683. Traceback (most recent call last):
  35684. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  35685. lines = self.send(cmd, raw_response=raw_response)
  35686. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  35687. raise ELM327Error(self.ERRORS[line], code=line)
  35688. ELM327Error: Operation interrupted by a received RS232 character
  35689. 2020-08-04 13:03:52,278 [messaging :742 ][ERROR ][703] Exception while processing event: {'tag': 'obd/req/f7747921-a380-487e-94ce-c624416c0015', 'data': {'_stamp': '2020-08-04T13:03:46.674640', 'handler': 'execute', '_event_tag': 'obd/req/f7747921-a380-487e-94ce-c624416c0015', 'args': ['STSLCS']}}
  35690. Traceback (most recent call last):
  35691. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  35692. res = self.process(message)
  35693. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  35694. result = func(message, **settings)
  35695. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  35696. found, result = self._call_hook_for(message, "workflow", message)
  35697. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35698. return True, func(*args, **kwargs)
  35699. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  35700. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35701. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35702. return True, func(*args, **kwargs)
  35703. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35704. return func(*args, **kwargs)
  35705. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  35706. res = conn.execute(cmd)
  35707. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  35708. return func(self, *args, **kwargs)
  35709. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  35710. return self._obd.execute(cmd, **kwargs)
  35711. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  35712. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  35713. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  35714. lines = self.send(cmd, raw_response=raw_response)
  35715. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  35716. raise ELM327Error(self.ERRORS[line], code=line)
  35717. ELM327Error: Operation interrupted by a received RS232 character
  35718. 2020-08-04 13:03:53,041 [salt.utils.parsers:1050][WARNING ][413] Minion received a SIGTERM. Exiting.
  35719. 2020-08-04 13:03:53,581 [messaging :871 ][WARNING ][814] No reply message with tag 'obd/res/f7747921-a380-487e-94ce-c624416c0015' received within timeout of 30 secs
  35720. 2020-08-04 13:03:53,585 [salt.state :292 ][ERROR ][814] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  35721. 2020-08-04 13:04:10,147 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  35722. 2020-08-04 13:04:10,156 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  35723. 2020-08-04 13:04:10,159 [gpio_spi_conn :42 ][WARNING ][621] Unable to clear buffer - got unexpected value: 255
  35724. 2020-08-04 13:04:10,806 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  35725. Traceback (most recent call last):
  35726. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35727. self._serial.open()
  35728. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35729. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35730. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35731. 2020-08-04 13:04:11,819 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  35732. Traceback (most recent call last):
  35733. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35734. self._serial.open()
  35735. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35736. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35737. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35738. 2020-08-04 13:04:12,195 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  35739. 2020-08-04 13:04:12,698 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  35740. 2020-08-04 13:04:12,834 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  35741. Traceback (most recent call last):
  35742. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35743. self._serial.open()
  35744. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35745. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35746. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35747. 2020-08-04 13:04:13,201 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  35748. 2020-08-04 13:04:13,204 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  35749. 2020-08-04 13:04:13,495 [messaging :208 ][ERROR ][618] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  35750. Traceback (most recent call last):
  35751. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  35752. self._call_hook_for(message, "workflow", message)
  35753. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35754. return True, func(*args, **kwargs)
  35755. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  35756. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35757. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35758. return True, func(*args, **kwargs)
  35759. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35760. return func(*args, **kwargs)
  35761. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  35762. res = _exec("AT+CCLK?")
  35763. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  35764. conn.write_line(cmd)
  35765. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  35766. self.ensure_open()
  35767. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  35768. self.open()
  35769. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  35770. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  35771. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  35772. raise attempt.get()
  35773. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  35774. six.reraise(self.value[0], self.value[1], self.value[2])
  35775. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  35776. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  35777. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35778. self._serial.open()
  35779. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35780. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35781. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35782. 2020-08-04 13:04:13,708 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  35783. 2020-08-04 13:04:14,211 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  35784. 2020-08-04 13:04:14,714 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  35785. 2020-08-04 13:04:14,716 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  35786. 2020-08-04 13:04:15,220 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  35787. 2020-08-04 13:04:15,723 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  35788. 2020-08-04 13:04:16,226 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  35789. 2020-08-04 13:04:16,228 [spm_conn :139 ][WARNING ][621] Unable to get status: Expected ack '12' but got '255'
  35790. 2020-08-04 13:04:16,232 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  35791. 2020-08-04 13:04:16,735 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  35792. 2020-08-04 13:04:17,238 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  35793. 2020-08-04 13:04:17,240 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  35794. 2020-08-04 13:04:17,659 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  35795. Traceback (most recent call last):
  35796. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35797. self._serial.open()
  35798. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35799. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35800. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35801. 2020-08-04 13:04:17,754 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  35802. 2020-08-04 13:04:18,258 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  35803. 2020-08-04 13:04:18,663 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  35804. Traceback (most recent call last):
  35805. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35806. self._serial.open()
  35807. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35808. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35809. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35810. 2020-08-04 13:04:18,761 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  35811. 2020-08-04 13:04:18,763 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  35812. 2020-08-04 13:04:19,266 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  35813. 2020-08-04 13:04:19,668 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  35814. Traceback (most recent call last):
  35815. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35816. self._serial.open()
  35817. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35818. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35819. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35820. 2020-08-04 13:04:19,671 [messaging :742 ][ERROR ][618] Exception while processing event: {'tag': 'ec2x/req/cf32454d-bdcb-4750-a5ec-15f24fae1a72', 'data': {'_stamp': '2020-08-04T13:04:10.217380', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/cf32454d-bdcb-4750-a5ec-15f24fae1a72', 'kwargs': {'cooldown_delay': None}}}
  35821. Traceback (most recent call last):
  35822. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  35823. res = self.process(message)
  35824. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  35825. result = func(message, **settings)
  35826. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  35827. found, result = self._call_hook_for(message, "workflow", message)
  35828. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35829. return True, func(*args, **kwargs)
  35830. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  35831. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35832. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35833. return True, func(*args, **kwargs)
  35834. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35835. return func(*args, **kwargs)
  35836. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  35837. return _exec(cmd, **kwargs)
  35838. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  35839. conn.write_line(cmd)
  35840. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  35841. self.ensure_open()
  35842. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  35843. self.open()
  35844. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  35845. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  35846. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  35847. raise attempt.get()
  35848. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  35849. six.reraise(self.value[0], self.value[1], self.value[2])
  35850. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  35851. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  35852. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35853. self._serial.open()
  35854. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35855. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35856. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35857. 2020-08-04 13:04:19,770 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  35858. 2020-08-04 13:04:20,273 [gpio_spi_conn :109 ][WARNING ][621] Expected ack '12' but got '255'
  35859. 2020-08-04 13:04:20,276 [spm_conn :82 ][WARNING ][621] Unable to send noop: Expected ack '12' but got '255'
  35860. 2020-08-04 13:04:20,278 [messaging :208 ][ERROR ][621] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  35861. Traceback (most recent call last):
  35862. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  35863. self._call_hook_for(message, "workflow", message)
  35864. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35865. return True, func(*args, **kwargs)
  35866. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  35867. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35868. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35869. return True, func(*args, **kwargs)
  35870. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35871. return func(*args, **kwargs)
  35872. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  35873. conn.heartbeat()
  35874. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  35875. self.noop()
  35876. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  35877. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  35878. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  35879. raise attempt.get()
  35880. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  35881. six.reraise(self.value[0], self.value[1], self.value[2])
  35882. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  35883. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  35884. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  35885. self._begin_message()
  35886. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  35887. self.recv(ack=ACK_MESSAGE_BEGIN)
  35888. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  35889. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  35890. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  35891. raise attempt.get()
  35892. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  35893. six.reraise(self.value[0], self.value[1], self.value[2])
  35894. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  35895. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  35896. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  35897. raise Exception(msg)
  35898. Exception: Expected ack '12' but got '255'
  35899. 2020-08-04 13:04:20,315 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  35900. Traceback (most recent call last):
  35901. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35902. self._serial.open()
  35903. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35904. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35905. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35906. 2020-08-04 13:04:21,320 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  35907. Traceback (most recent call last):
  35908. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35909. self._serial.open()
  35910. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35911. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35912. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35913. 2020-08-04 13:04:21,953 [messaging :208 ][ERROR ][619] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  35914. Traceback (most recent call last):
  35915. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  35916. self._call_hook_for(message, "workflow", message)
  35917. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35918. return True, func(*args, **kwargs)
  35919. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  35920. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35921. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35922. return True, func(*args, **kwargs)
  35923. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35924. return func(*args, **kwargs)
  35925. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  35926. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  35927. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  35928. res = query("AT+QGPSLOC={:d}".format(mode))
  35929. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  35930. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  35931. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  35932. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  35933. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  35934. raise salt.exceptions.CommandExecutionError(message["error"])
  35935. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35936. 2020-08-04 13:04:22,334 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  35937. Traceback (most recent call last):
  35938. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35939. self._serial.open()
  35940. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35941. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35942. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35943. 2020-08-04 13:04:22,875 [messaging :206 ][ERROR ][618] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  35944. Traceback (most recent call last):
  35945. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  35946. self._call_hook_for(message, "workflow", message)
  35947. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35948. return True, func(*args, **kwargs)
  35949. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  35950. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  35951. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  35952. return True, func(*args, **kwargs)
  35953. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  35954. return func(*args, **kwargs)
  35955. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  35956. res = _exec("AT+CCLK?")
  35957. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  35958. conn.write_line(cmd)
  35959. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  35960. self.ensure_open()
  35961. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  35962. self.open()
  35963. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  35964. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  35965. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  35966. raise attempt.get()
  35967. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  35968. six.reraise(self.value[0], self.value[1], self.value[2])
  35969. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  35970. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  35971. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35972. self._serial.open()
  35973. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35974. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35975. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35976. 2020-08-04 13:04:38,042 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][708] Timeout after 1.28205128205 second(s) waiting for interrupt
  35977. 2020-08-04 13:04:38,154 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  35978. Traceback (most recent call last):
  35979. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35980. self._serial.open()
  35981. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35982. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35983. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35984. 2020-08-04 13:04:39,164 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  35985. Traceback (most recent call last):
  35986. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35987. self._serial.open()
  35988. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35989. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35990. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35991. 2020-08-04 13:04:40,167 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  35992. Traceback (most recent call last):
  35993. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  35994. self._serial.open()
  35995. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  35996. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  35997. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  35998. 2020-08-04 13:04:40,171 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  35999. Traceback (most recent call last):
  36000. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36001. self._serial.open()
  36002. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36003. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36004. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36005. 2020-08-04 13:04:40,174 [messaging :206 ][ERROR ][618] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  36006. Traceback (most recent call last):
  36007. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  36008. self._call_hook_for(message, "workflow", message)
  36009. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36010. return True, func(*args, **kwargs)
  36011. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  36012. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36013. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36014. return True, func(*args, **kwargs)
  36015. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36016. return func(*args, **kwargs)
  36017. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  36018. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  36019. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  36020. conn.write_line(cmd)
  36021. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  36022. self.ensure_open()
  36023. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  36024. self.open()
  36025. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  36026. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  36027. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  36028. raise attempt.get()
  36029. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  36030. six.reraise(self.value[0], self.value[1], self.value[2])
  36031. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  36032. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  36033. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36034. self._serial.open()
  36035. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36036. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36037. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36038. 2020-08-04 13:04:41,175 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  36039. Traceback (most recent call last):
  36040. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36041. self._serial.open()
  36042. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36043. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36044. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36045. 2020-08-04 13:04:42,179 [serial_conn :79 ][ERROR ][618] Failed to open serial connection
  36046. Traceback (most recent call last):
  36047. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36048. self._serial.open()
  36049. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36050. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36051. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36052. 2020-08-04 13:04:42,183 [messaging :742 ][ERROR ][618] Exception while processing event: {'tag': 'ec2x/req/ea1ea853-2584-470d-9a27-f60593f5cbc3', 'data': {'_stamp': '2020-08-04T13:04:38.070342', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/ea1ea853-2584-470d-9a27-f60593f5cbc3', 'kwargs': {'cooldown_delay': None}}}
  36053. Traceback (most recent call last):
  36054. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  36055. res = self.process(message)
  36056. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  36057. result = func(message, **settings)
  36058. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  36059. found, result = self._call_hook_for(message, "workflow", message)
  36060. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36061. return True, func(*args, **kwargs)
  36062. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  36063. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36064. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36065. return True, func(*args, **kwargs)
  36066. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36067. return func(*args, **kwargs)
  36068. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  36069. return _exec(cmd, **kwargs)
  36070. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  36071. conn.write_line(cmd)
  36072. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  36073. self.ensure_open()
  36074. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  36075. self.open()
  36076. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  36077. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  36078. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  36079. raise attempt.get()
  36080. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  36081. six.reraise(self.value[0], self.value[1], self.value[2])
  36082. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  36083. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  36084. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36085. self._serial.open()
  36086. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36087. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36088. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36089. 2020-08-04 13:04:42,212 [messaging :206 ][ERROR ][619] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  36090. Traceback (most recent call last):
  36091. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  36092. self._call_hook_for(message, "workflow", message)
  36093. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36094. return True, func(*args, **kwargs)
  36095. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  36096. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36097. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36098. return True, func(*args, **kwargs)
  36099. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36100. return func(*args, **kwargs)
  36101. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  36102. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  36103. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  36104. res = query("AT+QGPSLOC={:d}".format(mode))
  36105. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  36106. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  36107. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  36108. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  36109. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  36110. raise salt.exceptions.CommandExecutionError(message["error"])
  36111. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36112. 2020-08-04 13:04:47,254 [obd.obd :107 ][ERROR ][707] Failed to use explicit port '/dev/serial0'
  36113. Traceback (most recent call last):
  36114. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  36115. self.interface.open(baudrate, protocol=protocol)
  36116. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  36117. self.set_protocol(prot.pop("id", None), **prot)
  36118. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  36119. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  36120. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  36121. self._protocol = self._auto_protocol(**kwargs)
  36122. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  36123. res_0100 = self._verify_protocol("auto", test=not verify)
  36124. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  36125. for line in self.query("0100", parse=False, read_timeout=10):
  36126. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  36127. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  36128. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  36129. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  36130. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  36131. data = self._port.read(self._port.in_waiting or 1)
  36132. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  36133. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  36134. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  36135. sys.exit(salt.defaults.exitcodes.EX_OK)
  36136. SystemExit: 0
  36137. 2020-08-04 13:04:47,279 [obd.obd :120 ][WARNING ][707] Cannot load commands - no connection to bus
  36138. 2020-08-04 13:04:47,313 [obd.interfaces.elm327:730 ][ERROR ][707] Failed to relay command 'STSLCS' to interface
  36139. Traceback (most recent call last):
  36140. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  36141. lines = self.send(cmd, raw_response=raw_response)
  36142. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  36143. raise ELM327Error(self.ERRORS[line], code=line)
  36144. ELM327Error: Operation interrupted by a received RS232 character
  36145. 2020-08-04 13:04:47,317 [messaging :742 ][ERROR ][707] Exception while processing event: {'tag': 'obd/req/46dbb9f5-3994-487f-8eea-63cd87c2a02d', 'data': {'_stamp': '2020-08-04T13:04:41.774044', 'handler': 'execute', '_event_tag': 'obd/req/46dbb9f5-3994-487f-8eea-63cd87c2a02d', 'args': ['STSLCS']}}
  36146. Traceback (most recent call last):
  36147. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  36148. res = self.process(message)
  36149. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  36150. result = func(message, **settings)
  36151. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  36152. found, result = self._call_hook_for(message, "workflow", message)
  36153. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36154. return True, func(*args, **kwargs)
  36155. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  36156. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36157. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36158. return True, func(*args, **kwargs)
  36159. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36160. return func(*args, **kwargs)
  36161. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  36162. res = conn.execute(cmd)
  36163. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  36164. return func(self, *args, **kwargs)
  36165. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  36166. return self._obd.execute(cmd, **kwargs)
  36167. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  36168. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  36169. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  36170. lines = self.send(cmd, raw_response=raw_response)
  36171. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  36172. raise ELM327Error(self.ERRORS[line], code=line)
  36173. ELM327Error: Operation interrupted by a received RS232 character
  36174. 2020-08-04 13:04:48,110 [salt.utils.parsers:1050][WARNING ][418] Minion received a SIGTERM. Exiting.
  36175. 2020-08-04 13:04:48,650 [messaging :871 ][WARNING ][832] No reply message with tag 'obd/res/46dbb9f5-3994-487f-8eea-63cd87c2a02d' received within timeout of 30 secs
  36176. 2020-08-04 13:04:48,654 [salt.state :292 ][ERROR ][832] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  36177. 2020-08-04 13:05:05,069 [gpio_spi_conn :42 ][WARNING ][618] Unable to clear buffer - got unexpected value: 255
  36178. 2020-08-04 13:05:05,080 [gpio_spi_conn :42 ][WARNING ][618] Unable to clear buffer - got unexpected value: 255
  36179. 2020-08-04 13:05:05,090 [gpio_spi_conn :42 ][WARNING ][618] Unable to clear buffer - got unexpected value: 255
  36180. 2020-08-04 13:05:05,764 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  36181. Traceback (most recent call last):
  36182. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36183. self._serial.open()
  36184. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36185. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36186. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36187. 2020-08-04 13:05:06,779 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  36188. Traceback (most recent call last):
  36189. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36190. self._serial.open()
  36191. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36192. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36193. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36194. 2020-08-04 13:05:07,112 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  36195. 2020-08-04 13:05:07,615 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  36196. 2020-08-04 13:05:07,783 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  36197. Traceback (most recent call last):
  36198. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36199. self._serial.open()
  36200. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36201. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36202. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36203. 2020-08-04 13:05:08,118 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  36204. 2020-08-04 13:05:08,120 [spm_conn :139 ][WARNING ][618] Unable to get status: Expected ack '12' but got '255'
  36205. 2020-08-04 13:05:08,385 [messaging :208 ][ERROR ][615] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  36206. Traceback (most recent call last):
  36207. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  36208. self._call_hook_for(message, "workflow", message)
  36209. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36210. return True, func(*args, **kwargs)
  36211. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  36212. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36213. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36214. return True, func(*args, **kwargs)
  36215. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36216. return func(*args, **kwargs)
  36217. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  36218. res = _exec("AT+CCLK?")
  36219. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  36220. conn.write_line(cmd)
  36221. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  36222. self.ensure_open()
  36223. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  36224. self.open()
  36225. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  36226. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  36227. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  36228. raise attempt.get()
  36229. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  36230. six.reraise(self.value[0], self.value[1], self.value[2])
  36231. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  36232. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  36233. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36234. self._serial.open()
  36235. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36236. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36237. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36238. 2020-08-04 13:05:08,624 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  36239. 2020-08-04 13:05:09,127 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  36240. 2020-08-04 13:05:09,630 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  36241. 2020-08-04 13:05:09,633 [spm_conn :139 ][WARNING ][618] Unable to get status: Expected ack '12' but got '255'
  36242. 2020-08-04 13:05:10,136 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  36243. 2020-08-04 13:05:10,639 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  36244. 2020-08-04 13:05:11,143 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  36245. 2020-08-04 13:05:11,146 [spm_conn :139 ][WARNING ][618] Unable to get status: Expected ack '12' but got '255'
  36246. 2020-08-04 13:05:11,149 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  36247. 2020-08-04 13:05:11,652 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  36248. 2020-08-04 13:05:12,156 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  36249. 2020-08-04 13:05:12,158 [spm_conn :82 ][WARNING ][618] Unable to send noop: Expected ack '12' but got '255'
  36250. 2020-08-04 13:05:12,499 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  36251. Traceback (most recent call last):
  36252. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36253. self._serial.open()
  36254. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36255. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36256. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36257. 2020-08-04 13:05:12,664 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  36258. 2020-08-04 13:05:13,167 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  36259. 2020-08-04 13:05:13,503 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  36260. Traceback (most recent call last):
  36261. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36262. self._serial.open()
  36263. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36264. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36265. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36266. 2020-08-04 13:05:13,670 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  36267. 2020-08-04 13:05:13,673 [spm_conn :82 ][WARNING ][618] Unable to send noop: Expected ack '12' but got '255'
  36268. 2020-08-04 13:05:14,177 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  36269. 2020-08-04 13:05:14,508 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  36270. Traceback (most recent call last):
  36271. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36272. self._serial.open()
  36273. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36274. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36275. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36276. 2020-08-04 13:05:14,512 [messaging :742 ][ERROR ][615] Exception while processing event: {'tag': 'ec2x/req/83542757-289b-4fbe-822d-3409810daec7', 'data': {'_stamp': '2020-08-04T13:05:05.146375', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/83542757-289b-4fbe-822d-3409810daec7', 'kwargs': {'cooldown_delay': None}}}
  36277. Traceback (most recent call last):
  36278. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  36279. res = self.process(message)
  36280. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  36281. result = func(message, **settings)
  36282. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  36283. found, result = self._call_hook_for(message, "workflow", message)
  36284. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36285. return True, func(*args, **kwargs)
  36286. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  36287. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36288. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36289. return True, func(*args, **kwargs)
  36290. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36291. return func(*args, **kwargs)
  36292. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  36293. return _exec(cmd, **kwargs)
  36294. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  36295. conn.write_line(cmd)
  36296. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  36297. self.ensure_open()
  36298. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  36299. self.open()
  36300. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  36301. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  36302. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  36303. raise attempt.get()
  36304. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  36305. six.reraise(self.value[0], self.value[1], self.value[2])
  36306. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  36307. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  36308. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36309. self._serial.open()
  36310. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36311. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36312. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36313. 2020-08-04 13:05:14,680 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  36314. 2020-08-04 13:05:15,133 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  36315. Traceback (most recent call last):
  36316. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36317. self._serial.open()
  36318. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36319. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36320. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36321. 2020-08-04 13:05:15,186 [gpio_spi_conn :109 ][WARNING ][618] Expected ack '12' but got '255'
  36322. 2020-08-04 13:05:15,188 [spm_conn :82 ][WARNING ][618] Unable to send noop: Expected ack '12' but got '255'
  36323. 2020-08-04 13:05:15,191 [messaging :208 ][ERROR ][618] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  36324. Traceback (most recent call last):
  36325. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  36326. self._call_hook_for(message, "workflow", message)
  36327. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36328. return True, func(*args, **kwargs)
  36329. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  36330. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36331. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36332. return True, func(*args, **kwargs)
  36333. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36334. return func(*args, **kwargs)
  36335. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  36336. conn.heartbeat()
  36337. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  36338. self.noop()
  36339. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  36340. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  36341. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  36342. raise attempt.get()
  36343. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  36344. six.reraise(self.value[0], self.value[1], self.value[2])
  36345. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  36346. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  36347. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  36348. self._begin_message()
  36349. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  36350. self.recv(ack=ACK_MESSAGE_BEGIN)
  36351. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  36352. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  36353. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  36354. raise attempt.get()
  36355. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  36356. six.reraise(self.value[0], self.value[1], self.value[2])
  36357. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  36358. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  36359. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  36360. raise Exception(msg)
  36361. Exception: Expected ack '12' but got '255'
  36362. 2020-08-04 13:05:16,137 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  36363. Traceback (most recent call last):
  36364. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36365. self._serial.open()
  36366. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36367. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36368. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36369. 2020-08-04 13:05:16,749 [messaging :208 ][ERROR ][616] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  36370. Traceback (most recent call last):
  36371. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  36372. self._call_hook_for(message, "workflow", message)
  36373. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36374. return True, func(*args, **kwargs)
  36375. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  36376. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36377. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36378. return True, func(*args, **kwargs)
  36379. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36380. return func(*args, **kwargs)
  36381. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  36382. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  36383. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  36384. res = query("AT+QGPSLOC={:d}".format(mode))
  36385. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  36386. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  36387. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  36388. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  36389. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  36390. raise salt.exceptions.CommandExecutionError(message["error"])
  36391. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36392. 2020-08-04 13:05:17,141 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  36393. Traceback (most recent call last):
  36394. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36395. self._serial.open()
  36396. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36397. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36398. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36399. 2020-08-04 13:05:17,647 [messaging :206 ][ERROR ][615] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  36400. Traceback (most recent call last):
  36401. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  36402. self._call_hook_for(message, "workflow", message)
  36403. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36404. return True, func(*args, **kwargs)
  36405. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  36406. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36407. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36408. return True, func(*args, **kwargs)
  36409. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36410. return func(*args, **kwargs)
  36411. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  36412. res = _exec("AT+CCLK?")
  36413. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  36414. conn.write_line(cmd)
  36415. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  36416. self.ensure_open()
  36417. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  36418. self.open()
  36419. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  36420. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  36421. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  36422. raise attempt.get()
  36423. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  36424. six.reraise(self.value[0], self.value[1], self.value[2])
  36425. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  36426. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  36427. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36428. self._serial.open()
  36429. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36430. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36431. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36432. 2020-08-04 13:05:32,905 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][655] Timeout after 1.28205128205 second(s) waiting for interrupt
  36433. 2020-08-04 13:05:32,981 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  36434. Traceback (most recent call last):
  36435. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36436. self._serial.open()
  36437. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36438. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36439. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36440. 2020-08-04 13:05:33,985 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  36441. Traceback (most recent call last):
  36442. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36443. self._serial.open()
  36444. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36445. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36446. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36447. 2020-08-04 13:05:34,989 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  36448. Traceback (most recent call last):
  36449. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36450. self._serial.open()
  36451. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36452. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36453. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36454. 2020-08-04 13:05:35,003 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  36455. Traceback (most recent call last):
  36456. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36457. self._serial.open()
  36458. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36459. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36460. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36461. 2020-08-04 13:05:35,005 [messaging :206 ][ERROR ][615] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  36462. Traceback (most recent call last):
  36463. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  36464. self._call_hook_for(message, "workflow", message)
  36465. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36466. return True, func(*args, **kwargs)
  36467. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  36468. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36469. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36470. return True, func(*args, **kwargs)
  36471. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36472. return func(*args, **kwargs)
  36473. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  36474. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  36475. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  36476. conn.write_line(cmd)
  36477. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  36478. self.ensure_open()
  36479. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  36480. self.open()
  36481. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  36482. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  36483. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  36484. raise attempt.get()
  36485. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  36486. six.reraise(self.value[0], self.value[1], self.value[2])
  36487. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  36488. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  36489. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36490. self._serial.open()
  36491. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36492. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36493. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36494. 2020-08-04 13:05:36,006 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  36495. Traceback (most recent call last):
  36496. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36497. self._serial.open()
  36498. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36499. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36500. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36501. 2020-08-04 13:05:37,010 [serial_conn :79 ][ERROR ][615] Failed to open serial connection
  36502. Traceback (most recent call last):
  36503. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36504. self._serial.open()
  36505. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36506. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36507. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36508. 2020-08-04 13:05:37,013 [messaging :742 ][ERROR ][615] Exception while processing event: {'tag': 'ec2x/req/5b6aff53-126a-4694-8a57-99af089bd024', 'data': {'_stamp': '2020-08-04T13:05:32.936863', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/5b6aff53-126a-4694-8a57-99af089bd024', 'kwargs': {'cooldown_delay': None}}}
  36509. Traceback (most recent call last):
  36510. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  36511. res = self.process(message)
  36512. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  36513. result = func(message, **settings)
  36514. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  36515. found, result = self._call_hook_for(message, "workflow", message)
  36516. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36517. return True, func(*args, **kwargs)
  36518. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  36519. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36520. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36521. return True, func(*args, **kwargs)
  36522. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36523. return func(*args, **kwargs)
  36524. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  36525. return _exec(cmd, **kwargs)
  36526. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  36527. conn.write_line(cmd)
  36528. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  36529. self.ensure_open()
  36530. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  36531. self.open()
  36532. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  36533. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  36534. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  36535. raise attempt.get()
  36536. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  36537. six.reraise(self.value[0], self.value[1], self.value[2])
  36538. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  36539. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  36540. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36541. self._serial.open()
  36542. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36543. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36544. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36545. 2020-08-04 13:05:37,029 [messaging :206 ][ERROR ][616] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  36546. Traceback (most recent call last):
  36547. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  36548. self._call_hook_for(message, "workflow", message)
  36549. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36550. return True, func(*args, **kwargs)
  36551. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  36552. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36553. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36554. return True, func(*args, **kwargs)
  36555. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36556. return func(*args, **kwargs)
  36557. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  36558. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  36559. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  36560. res = query("AT+QGPSLOC={:d}".format(mode))
  36561. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  36562. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  36563. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  36564. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  36565. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  36566. raise salt.exceptions.CommandExecutionError(message["error"])
  36567. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36568. 2020-08-04 13:05:42,085 [obd.obd :107 ][ERROR ][652] Failed to use explicit port '/dev/serial0'
  36569. Traceback (most recent call last):
  36570. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  36571. self.interface.open(baudrate, protocol=protocol)
  36572. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  36573. self.set_protocol(prot.pop("id", None), **prot)
  36574. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  36575. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  36576. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  36577. self._protocol = self._auto_protocol(**kwargs)
  36578. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  36579. res_0100 = self._verify_protocol("auto", test=not verify)
  36580. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  36581. for line in self.query("0100", parse=False, read_timeout=10):
  36582. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  36583. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  36584. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  36585. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  36586. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  36587. data = self._port.read(self._port.in_waiting or 1)
  36588. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  36589. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  36590. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  36591. sys.exit(salt.defaults.exitcodes.EX_OK)
  36592. SystemExit: 0
  36593. 2020-08-04 13:05:42,122 [obd.obd :120 ][WARNING ][652] Cannot load commands - no connection to bus
  36594. 2020-08-04 13:05:42,156 [obd.interfaces.elm327:730 ][ERROR ][652] Failed to relay command 'STSLCS' to interface
  36595. Traceback (most recent call last):
  36596. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  36597. lines = self.send(cmd, raw_response=raw_response)
  36598. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  36599. raise ELM327Error(self.ERRORS[line], code=line)
  36600. ELM327Error: Operation interrupted by a received RS232 character
  36601. 2020-08-04 13:05:42,159 [messaging :742 ][ERROR ][652] Exception while processing event: {'tag': 'obd/req/cf294648-6e12-4795-a774-0379fd0718a1', 'data': {'_stamp': '2020-08-04T13:05:36.616358', 'handler': 'execute', '_event_tag': 'obd/req/cf294648-6e12-4795-a774-0379fd0718a1', 'args': ['STSLCS']}}
  36602. Traceback (most recent call last):
  36603. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  36604. res = self.process(message)
  36605. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  36606. result = func(message, **settings)
  36607. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  36608. found, result = self._call_hook_for(message, "workflow", message)
  36609. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36610. return True, func(*args, **kwargs)
  36611. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  36612. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36613. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36614. return True, func(*args, **kwargs)
  36615. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36616. return func(*args, **kwargs)
  36617. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  36618. res = conn.execute(cmd)
  36619. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  36620. return func(self, *args, **kwargs)
  36621. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  36622. return self._obd.execute(cmd, **kwargs)
  36623. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  36624. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  36625. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  36626. lines = self.send(cmd, raw_response=raw_response)
  36627. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  36628. raise ELM327Error(self.ERRORS[line], code=line)
  36629. ELM327Error: Operation interrupted by a received RS232 character
  36630. 2020-08-04 13:05:42,928 [salt.utils.parsers:1050][WARNING ][415] Minion received a SIGTERM. Exiting.
  36631. 2020-08-04 13:05:43,467 [messaging :871 ][WARNING ][829] No reply message with tag 'obd/res/cf294648-6e12-4795-a774-0379fd0718a1' received within timeout of 30 secs
  36632. 2020-08-04 13:05:43,471 [salt.state :292 ][ERROR ][829] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  36633. 2020-08-04 13:06:00,025 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  36634. 2020-08-04 13:06:00,034 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  36635. 2020-08-04 13:06:00,038 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  36636. 2020-08-04 13:06:00,736 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  36637. Traceback (most recent call last):
  36638. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36639. self._serial.open()
  36640. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36641. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36642. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36643. 2020-08-04 13:06:01,750 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  36644. Traceback (most recent call last):
  36645. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36646. self._serial.open()
  36647. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36648. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36649. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36650. 2020-08-04 13:06:02,069 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  36651. 2020-08-04 13:06:02,572 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  36652. 2020-08-04 13:06:02,754 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  36653. Traceback (most recent call last):
  36654. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36655. self._serial.open()
  36656. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36657. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36658. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36659. 2020-08-04 13:06:03,075 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  36660. 2020-08-04 13:06:03,078 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  36661. 2020-08-04 13:06:03,356 [messaging :208 ][ERROR ][621] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  36662. Traceback (most recent call last):
  36663. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  36664. self._call_hook_for(message, "workflow", message)
  36665. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36666. return True, func(*args, **kwargs)
  36667. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  36668. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36669. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36670. return True, func(*args, **kwargs)
  36671. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36672. return func(*args, **kwargs)
  36673. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  36674. res = _exec("AT+CCLK?")
  36675. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  36676. conn.write_line(cmd)
  36677. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  36678. self.ensure_open()
  36679. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  36680. self.open()
  36681. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  36682. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  36683. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  36684. raise attempt.get()
  36685. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  36686. six.reraise(self.value[0], self.value[1], self.value[2])
  36687. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  36688. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  36689. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36690. self._serial.open()
  36691. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36692. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36693. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36694. 2020-08-04 13:06:03,582 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  36695. 2020-08-04 13:06:18,456 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][711] Timeout after 1.28205128205 second(s) waiting for interrupt
  36696. 2020-08-04 13:06:18,533 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  36697. Traceback (most recent call last):
  36698. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36699. self._serial.open()
  36700. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36701. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36702. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36703. 2020-08-04 13:06:18,796 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  36704. 2020-08-04 13:06:19,299 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  36705. 2020-08-04 13:06:19,302 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  36706. 2020-08-04 13:06:19,537 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  36707. Traceback (most recent call last):
  36708. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36709. self._serial.open()
  36710. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36711. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36712. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36713. 2020-08-04 13:06:19,806 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  36714. 2020-08-04 13:06:20,309 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  36715. 2020-08-04 13:06:20,542 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  36716. Traceback (most recent call last):
  36717. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36718. self._serial.open()
  36719. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36720. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36721. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36722. 2020-08-04 13:06:20,545 [messaging :206 ][ERROR ][621] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  36723. Traceback (most recent call last):
  36724. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  36725. self._call_hook_for(message, "workflow", message)
  36726. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36727. return True, func(*args, **kwargs)
  36728. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  36729. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36730. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36731. return True, func(*args, **kwargs)
  36732. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36733. return func(*args, **kwargs)
  36734. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  36735. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  36736. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  36737. conn.write_line(cmd)
  36738. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  36739. self.ensure_open()
  36740. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  36741. self.open()
  36742. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  36743. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  36744. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  36745. raise attempt.get()
  36746. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  36747. six.reraise(self.value[0], self.value[1], self.value[2])
  36748. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  36749. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  36750. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36751. self._serial.open()
  36752. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36753. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36754. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36755. 2020-08-04 13:06:20,815 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  36756. 2020-08-04 13:06:20,817 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  36757. 2020-08-04 13:06:20,820 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  36758. 2020-08-04 13:06:21,323 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  36759. 2020-08-04 13:06:21,827 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  36760. 2020-08-04 13:06:21,830 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  36761. 2020-08-04 13:06:22,207 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  36762. Traceback (most recent call last):
  36763. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36764. self._serial.open()
  36765. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36766. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36767. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36768. 2020-08-04 13:06:22,335 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  36769. 2020-08-04 13:06:22,839 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  36770. 2020-08-04 13:06:23,211 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  36771. Traceback (most recent call last):
  36772. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36773. self._serial.open()
  36774. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36775. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36776. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36777. 2020-08-04 13:06:23,342 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  36778. 2020-08-04 13:06:23,344 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  36779. 2020-08-04 13:06:23,847 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  36780. 2020-08-04 13:06:24,215 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  36781. Traceback (most recent call last):
  36782. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36783. self._serial.open()
  36784. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36785. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36786. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36787. 2020-08-04 13:06:24,226 [messaging :742 ][ERROR ][621] Exception while processing event: {'tag': 'ec2x/req/671f9166-6a0a-41da-b858-cef30d414e0f', 'data': {'_stamp': '2020-08-04T13:06:00.115281', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/671f9166-6a0a-41da-b858-cef30d414e0f', 'kwargs': {'cooldown_delay': None}}}
  36788. Traceback (most recent call last):
  36789. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  36790. res = self.process(message)
  36791. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  36792. result = func(message, **settings)
  36793. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  36794. found, result = self._call_hook_for(message, "workflow", message)
  36795. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36796. return True, func(*args, **kwargs)
  36797. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  36798. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36799. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36800. return True, func(*args, **kwargs)
  36801. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36802. return func(*args, **kwargs)
  36803. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  36804. return _exec(cmd, **kwargs)
  36805. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  36806. conn.write_line(cmd)
  36807. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  36808. self.ensure_open()
  36809. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  36810. self.open()
  36811. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  36812. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  36813. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  36814. raise attempt.get()
  36815. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  36816. six.reraise(self.value[0], self.value[1], self.value[2])
  36817. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  36818. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  36819. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36820. self._serial.open()
  36821. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36822. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36823. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36824. 2020-08-04 13:06:24,350 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  36825. 2020-08-04 13:06:24,853 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  36826. 2020-08-04 13:06:24,855 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  36827. 2020-08-04 13:06:24,858 [messaging :208 ][ERROR ][624] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  36828. Traceback (most recent call last):
  36829. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  36830. self._call_hook_for(message, "workflow", message)
  36831. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36832. return True, func(*args, **kwargs)
  36833. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  36834. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36835. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36836. return True, func(*args, **kwargs)
  36837. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36838. return func(*args, **kwargs)
  36839. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  36840. conn.heartbeat()
  36841. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  36842. self.noop()
  36843. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  36844. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  36845. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  36846. raise attempt.get()
  36847. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  36848. six.reraise(self.value[0], self.value[1], self.value[2])
  36849. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  36850. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  36851. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  36852. self._begin_message()
  36853. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  36854. self.recv(ack=ACK_MESSAGE_BEGIN)
  36855. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  36856. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  36857. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  36858. raise attempt.get()
  36859. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  36860. six.reraise(self.value[0], self.value[1], self.value[2])
  36861. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  36862. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  36863. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  36864. raise Exception(msg)
  36865. Exception: Expected ack '12' but got '255'
  36866. 2020-08-04 13:06:26,372 [messaging :208 ][ERROR ][622] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  36867. Traceback (most recent call last):
  36868. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  36869. self._call_hook_for(message, "workflow", message)
  36870. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36871. return True, func(*args, **kwargs)
  36872. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  36873. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36874. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36875. return True, func(*args, **kwargs)
  36876. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36877. return func(*args, **kwargs)
  36878. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  36879. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  36880. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  36881. res = query("AT+QGPSLOC={:d}".format(mode))
  36882. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  36883. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  36884. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  36885. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  36886. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  36887. raise salt.exceptions.CommandExecutionError(message["error"])
  36888. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36889. 2020-08-04 13:06:31,419 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  36890. Traceback (most recent call last):
  36891. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36892. self._serial.open()
  36893. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36894. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36895. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36896. 2020-08-04 13:06:32,428 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  36897. Traceback (most recent call last):
  36898. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36899. self._serial.open()
  36900. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36901. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36902. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36903. 2020-08-04 13:06:33,432 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  36904. Traceback (most recent call last):
  36905. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36906. self._serial.open()
  36907. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36908. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36909. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36910. 2020-08-04 13:06:33,435 [messaging :742 ][ERROR ][621] Exception while processing event: {'tag': 'ec2x/req/e2cd3432-3d04-45cc-bb2a-1b20ce768f12', 'data': {'_stamp': '2020-08-04T13:06:31.412663', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/e2cd3432-3d04-45cc-bb2a-1b20ce768f12', 'kwargs': {'cooldown_delay': None}}}
  36911. Traceback (most recent call last):
  36912. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  36913. res = self.process(message)
  36914. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  36915. result = func(message, **settings)
  36916. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  36917. found, result = self._call_hook_for(message, "workflow", message)
  36918. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36919. return True, func(*args, **kwargs)
  36920. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  36921. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36922. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36923. return True, func(*args, **kwargs)
  36924. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36925. return func(*args, **kwargs)
  36926. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  36927. return _exec(cmd, **kwargs)
  36928. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  36929. conn.write_line(cmd)
  36930. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  36931. self.ensure_open()
  36932. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  36933. self.open()
  36934. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  36935. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  36936. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  36937. raise attempt.get()
  36938. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  36939. six.reraise(self.value[0], self.value[1], self.value[2])
  36940. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  36941. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  36942. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  36943. self._serial.open()
  36944. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  36945. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  36946. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36947. 2020-08-04 13:06:33,461 [messaging :206 ][ERROR ][622] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  36948. Traceback (most recent call last):
  36949. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  36950. self._call_hook_for(message, "workflow", message)
  36951. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36952. return True, func(*args, **kwargs)
  36953. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  36954. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  36955. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  36956. return True, func(*args, **kwargs)
  36957. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  36958. return func(*args, **kwargs)
  36959. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  36960. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  36961. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  36962. res = query("AT+QGPSLOC={:d}".format(mode))
  36963. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  36964. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  36965. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  36966. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  36967. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  36968. raise salt.exceptions.CommandExecutionError(message["error"])
  36969. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  36970. 2020-08-04 13:06:36,717 [obd.obd :107 ][ERROR ][710] Failed to use explicit port '/dev/serial0'
  36971. Traceback (most recent call last):
  36972. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  36973. self.interface.open(baudrate, protocol=protocol)
  36974. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  36975. self.set_protocol(prot.pop("id", None), **prot)
  36976. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  36977. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  36978. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  36979. self._protocol = self._auto_protocol(**kwargs)
  36980. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  36981. res_0100 = self._verify_protocol("auto", test=not verify)
  36982. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  36983. for line in self.query("0100", parse=False, read_timeout=10):
  36984. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  36985. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  36986. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  36987. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  36988. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  36989. data = self._port.read(self._port.in_waiting or 1)
  36990. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  36991. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  36992. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  36993. sys.exit(salt.defaults.exitcodes.EX_OK)
  36994. SystemExit: 0
  36995. 2020-08-04 13:06:36,764 [obd.obd :120 ][WARNING ][710] Cannot load commands - no connection to bus
  36996. 2020-08-04 13:06:36,792 [obd.interfaces.elm327:730 ][ERROR ][710] Failed to relay command 'STSLCS' to interface
  36997. Traceback (most recent call last):
  36998. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  36999. lines = self.send(cmd, raw_response=raw_response)
  37000. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  37001. raise ELM327Error(self.ERRORS[line], code=line)
  37002. ELM327Error: Operation interrupted by a received RS232 character
  37003. 2020-08-04 13:06:36,796 [messaging :742 ][ERROR ][710] Exception while processing event: {'tag': 'obd/req/8564b841-004c-45a7-85c4-5dfa48498c3a', 'data': {'_stamp': '2020-08-04T13:06:31.190477', 'handler': 'execute', '_event_tag': 'obd/req/8564b841-004c-45a7-85c4-5dfa48498c3a', 'args': ['STSLCS']}}
  37004. Traceback (most recent call last):
  37005. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  37006. res = self.process(message)
  37007. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  37008. result = func(message, **settings)
  37009. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  37010. found, result = self._call_hook_for(message, "workflow", message)
  37011. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37012. return True, func(*args, **kwargs)
  37013. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  37014. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37015. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37016. return True, func(*args, **kwargs)
  37017. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37018. return func(*args, **kwargs)
  37019. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  37020. res = conn.execute(cmd)
  37021. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  37022. return func(self, *args, **kwargs)
  37023. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  37024. return self._obd.execute(cmd, **kwargs)
  37025. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  37026. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  37027. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  37028. lines = self.send(cmd, raw_response=raw_response)
  37029. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  37030. raise ELM327Error(self.ERRORS[line], code=line)
  37031. ELM327Error: Operation interrupted by a received RS232 character
  37032. 2020-08-04 13:06:37,485 [salt.utils.parsers:1050][WARNING ][419] Minion received a SIGTERM. Exiting.
  37033. 2020-08-04 13:06:38,025 [messaging :871 ][WARNING ][821] No reply message with tag 'obd/res/8564b841-004c-45a7-85c4-5dfa48498c3a' received within timeout of 30 secs
  37034. 2020-08-04 13:06:38,029 [salt.state :292 ][ERROR ][821] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  37035. 2020-08-04 13:06:55,210 [gpio_spi_conn :42 ][WARNING ][630] Unable to clear buffer - got unexpected value: 255
  37036. 2020-08-04 13:06:55,218 [gpio_spi_conn :42 ][WARNING ][630] Unable to clear buffer - got unexpected value: 255
  37037. 2020-08-04 13:06:55,222 [gpio_spi_conn :42 ][WARNING ][630] Unable to clear buffer - got unexpected value: 255
  37038. 2020-08-04 13:06:55,913 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37039. Traceback (most recent call last):
  37040. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37041. self._serial.open()
  37042. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37043. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37044. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37045. 2020-08-04 13:06:56,928 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37046. Traceback (most recent call last):
  37047. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37048. self._serial.open()
  37049. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37050. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37051. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37052. 2020-08-04 13:06:57,274 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  37053. 2020-08-04 13:06:57,777 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  37054. 2020-08-04 13:06:57,932 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37055. Traceback (most recent call last):
  37056. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37057. self._serial.open()
  37058. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37059. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37060. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37061. 2020-08-04 13:06:58,281 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  37062. 2020-08-04 13:06:58,283 [spm_conn :139 ][WARNING ][630] Unable to get status: Expected ack '12' but got '255'
  37063. 2020-08-04 13:06:58,532 [messaging :208 ][ERROR ][627] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  37064. Traceback (most recent call last):
  37065. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  37066. self._call_hook_for(message, "workflow", message)
  37067. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37068. return True, func(*args, **kwargs)
  37069. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  37070. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37071. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37072. return True, func(*args, **kwargs)
  37073. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37074. return func(*args, **kwargs)
  37075. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  37076. res = _exec("AT+CCLK?")
  37077. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  37078. conn.write_line(cmd)
  37079. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  37080. self.ensure_open()
  37081. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  37082. self.open()
  37083. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  37084. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  37085. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  37086. raise attempt.get()
  37087. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  37088. six.reraise(self.value[0], self.value[1], self.value[2])
  37089. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  37090. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  37091. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37092. self._serial.open()
  37093. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37094. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37095. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37096. 2020-08-04 13:06:58,787 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  37097. 2020-08-04 13:06:59,291 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  37098. 2020-08-04 13:06:59,794 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  37099. 2020-08-04 13:06:59,797 [spm_conn :139 ][WARNING ][630] Unable to get status: Expected ack '12' but got '255'
  37100. 2020-08-04 13:07:00,301 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  37101. 2020-08-04 13:07:00,804 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  37102. 2020-08-04 13:07:01,308 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  37103. 2020-08-04 13:07:01,310 [spm_conn :139 ][WARNING ][630] Unable to get status: Expected ack '12' but got '255'
  37104. 2020-08-04 13:07:01,314 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  37105. 2020-08-04 13:07:01,818 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  37106. 2020-08-04 13:07:02,321 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  37107. 2020-08-04 13:07:02,333 [spm_conn :82 ][WARNING ][630] Unable to send noop: Expected ack '12' but got '255'
  37108. 2020-08-04 13:07:02,381 [salt.utils :831 ][ERROR ][428] DNS lookup or connection check of 'hub' failed.
  37109. 2020-08-04 13:07:02,693 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37110. Traceback (most recent call last):
  37111. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37112. self._serial.open()
  37113. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37114. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37115. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37116. 2020-08-04 13:07:02,843 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  37117. 2020-08-04 13:07:03,347 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  37118. 2020-08-04 13:07:03,704 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37119. Traceback (most recent call last):
  37120. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37121. self._serial.open()
  37122. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37123. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37124. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37125. 2020-08-04 13:07:03,842 [cloud_cache :432 ][WARNING ][668] Temporarily unable to upload batch with 10 entries from queue 'pend': HTTPSConnectionPool(host='api.autopi.io', port=443): Max retries exceeded with url: /logbook/storage (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x735739b0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))
  37126. 2020-08-04 13:07:03,850 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  37127. 2020-08-04 13:07:03,853 [spm_conn :82 ][WARNING ][630] Unable to send noop: Expected ack '12' but got '255'
  37128. 2020-08-04 13:07:04,357 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  37129. 2020-08-04 13:07:04,708 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37130. Traceback (most recent call last):
  37131. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37132. self._serial.open()
  37133. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37134. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37135. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37136. 2020-08-04 13:07:04,711 [messaging :742 ][ERROR ][627] Exception while processing event: {'tag': 'ec2x/req/852f9ec2-52c5-4b59-97ab-69cfbdf18915', 'data': {'_stamp': '2020-08-04T13:06:55.290460', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/852f9ec2-52c5-4b59-97ab-69cfbdf18915', 'kwargs': {'cooldown_delay': None}}}
  37137. Traceback (most recent call last):
  37138. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  37139. res = self.process(message)
  37140. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  37141. result = func(message, **settings)
  37142. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  37143. found, result = self._call_hook_for(message, "workflow", message)
  37144. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37145. return True, func(*args, **kwargs)
  37146. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  37147. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37148. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37149. return True, func(*args, **kwargs)
  37150. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37151. return func(*args, **kwargs)
  37152. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  37153. return _exec(cmd, **kwargs)
  37154. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  37155. conn.write_line(cmd)
  37156. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  37157. self.ensure_open()
  37158. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  37159. self.open()
  37160. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  37161. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  37162. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  37163. raise attempt.get()
  37164. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  37165. six.reraise(self.value[0], self.value[1], self.value[2])
  37166. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  37167. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  37168. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37169. self._serial.open()
  37170. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37171. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37172. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37173. 2020-08-04 13:07:04,743 [messaging :208 ][ERROR ][628] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  37174. Traceback (most recent call last):
  37175. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  37176. self._call_hook_for(message, "workflow", message)
  37177. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37178. return True, func(*args, **kwargs)
  37179. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  37180. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37181. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37182. return True, func(*args, **kwargs)
  37183. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37184. return func(*args, **kwargs)
  37185. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  37186. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  37187. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  37188. res = query("AT+QGPSLOC={:d}".format(mode))
  37189. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  37190. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  37191. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  37192. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  37193. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  37194. raise salt.exceptions.CommandExecutionError(message["error"])
  37195. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37196. 2020-08-04 13:07:04,860 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  37197. 2020-08-04 13:07:05,327 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37198. Traceback (most recent call last):
  37199. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37200. self._serial.open()
  37201. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37202. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37203. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37204. 2020-08-04 13:07:05,364 [gpio_spi_conn :109 ][WARNING ][630] Expected ack '12' but got '255'
  37205. 2020-08-04 13:07:05,366 [spm_conn :82 ][WARNING ][630] Unable to send noop: Expected ack '12' but got '255'
  37206. 2020-08-04 13:07:05,369 [messaging :208 ][ERROR ][630] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  37207. Traceback (most recent call last):
  37208. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  37209. self._call_hook_for(message, "workflow", message)
  37210. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37211. return True, func(*args, **kwargs)
  37212. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  37213. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37214. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37215. return True, func(*args, **kwargs)
  37216. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37217. return func(*args, **kwargs)
  37218. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  37219. conn.heartbeat()
  37220. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  37221. self.noop()
  37222. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  37223. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  37224. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  37225. raise attempt.get()
  37226. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  37227. six.reraise(self.value[0], self.value[1], self.value[2])
  37228. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  37229. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  37230. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  37231. self._begin_message()
  37232. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  37233. self.recv(ack=ACK_MESSAGE_BEGIN)
  37234. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  37235. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  37236. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  37237. raise attempt.get()
  37238. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  37239. six.reraise(self.value[0], self.value[1], self.value[2])
  37240. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  37241. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  37242. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  37243. raise Exception(msg)
  37244. Exception: Expected ack '12' but got '255'
  37245. 2020-08-04 13:07:06,334 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37246. Traceback (most recent call last):
  37247. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37248. self._serial.open()
  37249. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37250. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37251. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37252. 2020-08-04 13:07:07,338 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37253. Traceback (most recent call last):
  37254. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37255. self._serial.open()
  37256. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37257. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37258. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37259. 2020-08-04 13:07:07,840 [messaging :206 ][ERROR ][627] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  37260. Traceback (most recent call last):
  37261. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  37262. self._call_hook_for(message, "workflow", message)
  37263. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37264. return True, func(*args, **kwargs)
  37265. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  37266. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37267. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37268. return True, func(*args, **kwargs)
  37269. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37270. return func(*args, **kwargs)
  37271. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  37272. res = _exec("AT+CCLK?")
  37273. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  37274. conn.write_line(cmd)
  37275. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  37276. self.ensure_open()
  37277. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  37278. self.open()
  37279. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  37280. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  37281. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  37282. raise attempt.get()
  37283. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  37284. six.reraise(self.value[0], self.value[1], self.value[2])
  37285. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  37286. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  37287. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37288. self._serial.open()
  37289. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37290. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37291. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37292. 2020-08-04 13:07:09,802 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37293. Traceback (most recent call last):
  37294. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37295. self._serial.open()
  37296. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37297. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37298. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37299. 2020-08-04 13:07:10,807 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37300. Traceback (most recent call last):
  37301. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37302. self._serial.open()
  37303. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37304. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37305. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37306. 2020-08-04 13:07:11,811 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37307. Traceback (most recent call last):
  37308. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37309. self._serial.open()
  37310. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37311. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37312. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37313. 2020-08-04 13:07:11,813 [messaging :742 ][ERROR ][627] Exception while processing event: {'tag': 'ec2x/req/48e3bc5f-b787-4833-b038-58a7629e7e5f', 'data': {'_stamp': '2020-08-04T13:07:09.786482', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/48e3bc5f-b787-4833-b038-58a7629e7e5f', 'kwargs': {'cooldown_delay': None}}}
  37314. Traceback (most recent call last):
  37315. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  37316. res = self.process(message)
  37317. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  37318. result = func(message, **settings)
  37319. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  37320. found, result = self._call_hook_for(message, "workflow", message)
  37321. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37322. return True, func(*args, **kwargs)
  37323. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  37324. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37325. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37326. return True, func(*args, **kwargs)
  37327. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37328. return func(*args, **kwargs)
  37329. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  37330. return _exec(cmd, **kwargs)
  37331. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  37332. conn.write_line(cmd)
  37333. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  37334. self.ensure_open()
  37335. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  37336. self.open()
  37337. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  37338. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  37339. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  37340. raise attempt.get()
  37341. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  37342. six.reraise(self.value[0], self.value[1], self.value[2])
  37343. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  37344. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  37345. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37346. self._serial.open()
  37347. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37348. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37349. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37350. 2020-08-04 13:07:11,837 [messaging :206 ][ERROR ][628] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  37351. Traceback (most recent call last):
  37352. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  37353. self._call_hook_for(message, "workflow", message)
  37354. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37355. return True, func(*args, **kwargs)
  37356. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  37357. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37358. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37359. return True, func(*args, **kwargs)
  37360. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37361. return func(*args, **kwargs)
  37362. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  37363. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  37364. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  37365. res = query("AT+QGPSLOC={:d}".format(mode))
  37366. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  37367. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  37368. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  37369. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  37370. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  37371. raise salt.exceptions.CommandExecutionError(message["error"])
  37372. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37373. 2020-08-04 13:07:13,420 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37374. Traceback (most recent call last):
  37375. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37376. self._serial.open()
  37377. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37378. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37379. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37380. 2020-08-04 13:07:14,424 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37381. Traceback (most recent call last):
  37382. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37383. self._serial.open()
  37384. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37385. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37386. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37387. 2020-08-04 13:07:15,429 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37388. Traceback (most recent call last):
  37389. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37390. self._serial.open()
  37391. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37392. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37393. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37394. 2020-08-04 13:07:15,981 [messaging :206 ][ERROR ][627] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  37395. Traceback (most recent call last):
  37396. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  37397. self._call_hook_for(message, "workflow", message)
  37398. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37399. return True, func(*args, **kwargs)
  37400. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  37401. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37402. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37403. return True, func(*args, **kwargs)
  37404. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37405. return func(*args, **kwargs)
  37406. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  37407. res = _exec("AT+CCLK?")
  37408. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  37409. conn.write_line(cmd)
  37410. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  37411. self.ensure_open()
  37412. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  37413. self.open()
  37414. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  37415. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  37416. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  37417. raise attempt.get()
  37418. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  37419. six.reraise(self.value[0], self.value[1], self.value[2])
  37420. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  37421. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  37422. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37423. self._serial.open()
  37424. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37425. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37426. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37427. 2020-08-04 13:07:16,880 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37428. Traceback (most recent call last):
  37429. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37430. self._serial.open()
  37431. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37432. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37433. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37434. 2020-08-04 13:07:17,884 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37435. Traceback (most recent call last):
  37436. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37437. self._serial.open()
  37438. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37439. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37440. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37441. 2020-08-04 13:07:18,888 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37442. Traceback (most recent call last):
  37443. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37444. self._serial.open()
  37445. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37446. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37447. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37448. 2020-08-04 13:07:18,891 [messaging :742 ][ERROR ][627] Exception while processing event: {'tag': 'ec2x/req/720fb419-e057-4013-a1f2-60ade210f162', 'data': {'_stamp': '2020-08-04T13:07:16.858593', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/720fb419-e057-4013-a1f2-60ade210f162', 'kwargs': {'cooldown_delay': None}}}
  37449. Traceback (most recent call last):
  37450. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  37451. res = self.process(message)
  37452. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  37453. result = func(message, **settings)
  37454. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  37455. found, result = self._call_hook_for(message, "workflow", message)
  37456. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37457. return True, func(*args, **kwargs)
  37458. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  37459. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37460. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37461. return True, func(*args, **kwargs)
  37462. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37463. return func(*args, **kwargs)
  37464. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  37465. return _exec(cmd, **kwargs)
  37466. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  37467. conn.write_line(cmd)
  37468. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  37469. self.ensure_open()
  37470. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  37471. self.open()
  37472. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  37473. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  37474. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  37475. raise attempt.get()
  37476. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  37477. six.reraise(self.value[0], self.value[1], self.value[2])
  37478. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  37479. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  37480. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37481. self._serial.open()
  37482. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37483. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37484. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37485. 2020-08-04 13:07:18,917 [messaging :206 ][ERROR ][628] Recurring exception (3 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  37486. Traceback (most recent call last):
  37487. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  37488. self._call_hook_for(message, "workflow", message)
  37489. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37490. return True, func(*args, **kwargs)
  37491. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  37492. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37493. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37494. return True, func(*args, **kwargs)
  37495. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37496. return func(*args, **kwargs)
  37497. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  37498. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  37499. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  37500. res = query("AT+QGPSLOC={:d}".format(mode))
  37501. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  37502. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  37503. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  37504. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  37505. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  37506. raise salt.exceptions.CommandExecutionError(message["error"])
  37507. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37508. 2020-08-04 13:07:21,580 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37509. Traceback (most recent call last):
  37510. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37511. self._serial.open()
  37512. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37513. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37514. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37515. 2020-08-04 13:07:22,592 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37516. Traceback (most recent call last):
  37517. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37518. self._serial.open()
  37519. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37520. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37521. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37522. 2020-08-04 13:07:23,597 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37523. Traceback (most recent call last):
  37524. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37525. self._serial.open()
  37526. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37527. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37528. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37529. 2020-08-04 13:07:24,150 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37530. Traceback (most recent call last):
  37531. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37532. self._serial.open()
  37533. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37534. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37535. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37536. 2020-08-04 13:07:38,712 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][667] Timeout after 1.28205128205 second(s) waiting for interrupt
  37537. 2020-08-04 13:07:39,383 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37538. Traceback (most recent call last):
  37539. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37540. self._serial.open()
  37541. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37542. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37543. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37544. 2020-08-04 13:07:40,387 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37545. Traceback (most recent call last):
  37546. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37547. self._serial.open()
  37548. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37549. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37550. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37551. 2020-08-04 13:07:40,390 [messaging :742 ][ERROR ][627] Exception while processing event: {'tag': 'ec2x/req/92f0b331-e030-4fc0-893d-58687fca8ae7', 'data': {'_stamp': '2020-08-04T13:07:23.935027', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/92f0b331-e030-4fc0-893d-58687fca8ae7', 'kwargs': {'cooldown_delay': None}}}
  37552. Traceback (most recent call last):
  37553. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  37554. res = self.process(message)
  37555. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  37556. result = func(message, **settings)
  37557. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  37558. found, result = self._call_hook_for(message, "workflow", message)
  37559. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37560. return True, func(*args, **kwargs)
  37561. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  37562. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37563. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37564. return True, func(*args, **kwargs)
  37565. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37566. return func(*args, **kwargs)
  37567. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  37568. return _exec(cmd, **kwargs)
  37569. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  37570. conn.write_line(cmd)
  37571. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  37572. self.ensure_open()
  37573. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  37574. self.open()
  37575. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  37576. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  37577. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  37578. raise attempt.get()
  37579. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  37580. six.reraise(self.value[0], self.value[1], self.value[2])
  37581. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  37582. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  37583. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37584. self._serial.open()
  37585. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37586. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37587. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37588. 2020-08-04 13:07:41,015 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37589. Traceback (most recent call last):
  37590. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37591. self._serial.open()
  37592. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37593. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37594. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37595. 2020-08-04 13:07:42,020 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37596. Traceback (most recent call last):
  37597. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37598. self._serial.open()
  37599. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37600. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37601. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37602. 2020-08-04 13:07:43,025 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37603. Traceback (most recent call last):
  37604. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37605. self._serial.open()
  37606. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37607. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37608. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37609. 2020-08-04 13:07:45,470 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37610. Traceback (most recent call last):
  37611. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37612. self._serial.open()
  37613. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37614. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37615. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37616. 2020-08-04 13:07:46,486 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37617. Traceback (most recent call last):
  37618. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37619. self._serial.open()
  37620. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37621. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37622. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37623. 2020-08-04 13:07:47,490 [serial_conn :79 ][ERROR ][627] Failed to open serial connection
  37624. Traceback (most recent call last):
  37625. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37626. self._serial.open()
  37627. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37628. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37629. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37630. 2020-08-04 13:07:47,494 [messaging :742 ][ERROR ][627] Exception while processing event: {'tag': 'ec2x/req/4247f66b-a449-4743-81b7-a2801be8299e', 'data': {'_stamp': '2020-08-04T13:07:45.454986', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/4247f66b-a449-4743-81b7-a2801be8299e', 'kwargs': {'cooldown_delay': None}}}
  37631. Traceback (most recent call last):
  37632. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  37633. res = self.process(message)
  37634. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  37635. result = func(message, **settings)
  37636. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  37637. found, result = self._call_hook_for(message, "workflow", message)
  37638. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37639. return True, func(*args, **kwargs)
  37640. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  37641. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37642. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37643. return True, func(*args, **kwargs)
  37644. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37645. return func(*args, **kwargs)
  37646. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  37647. return _exec(cmd, **kwargs)
  37648. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  37649. conn.write_line(cmd)
  37650. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  37651. self.ensure_open()
  37652. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  37653. self.open()
  37654. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  37655. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  37656. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  37657. raise attempt.get()
  37658. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  37659. six.reraise(self.value[0], self.value[1], self.value[2])
  37660. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  37661. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  37662. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37663. self._serial.open()
  37664. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37665. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37666. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37667. 2020-08-04 13:07:48,224 [obd.obd :107 ][ERROR ][666] Failed to use explicit port '/dev/serial0'
  37668. Traceback (most recent call last):
  37669. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  37670. self.interface.open(baudrate, protocol=protocol)
  37671. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  37672. self.set_protocol(prot.pop("id", None), **prot)
  37673. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  37674. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  37675. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  37676. self._protocol = self._auto_protocol(**kwargs)
  37677. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  37678. res_0100 = self._verify_protocol("auto", test=not verify)
  37679. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  37680. for line in self.query("0100", parse=False, read_timeout=10):
  37681. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  37682. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  37683. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  37684. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  37685. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  37686. data = self._port.read(self._port.in_waiting or 1)
  37687. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  37688. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  37689. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  37690. sys.exit(salt.defaults.exitcodes.EX_OK)
  37691. SystemExit: 0
  37692. 2020-08-04 13:07:48,266 [obd.obd :120 ][WARNING ][666] Cannot load commands - no connection to bus
  37693. 2020-08-04 13:07:48,293 [obd.interfaces.elm327:730 ][ERROR ][666] Failed to relay command 'STSLCS' to interface
  37694. Traceback (most recent call last):
  37695. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  37696. lines = self.send(cmd, raw_response=raw_response)
  37697. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  37698. raise ELM327Error(self.ERRORS[line], code=line)
  37699. ELM327Error: Operation interrupted by a received RS232 character
  37700. 2020-08-04 13:07:48,296 [messaging :742 ][ERROR ][666] Exception while processing event: {'tag': 'obd/req/3fe6df61-8966-4819-a7f5-5f2345509cd6', 'data': {'_stamp': '2020-08-04T13:07:42.703613', 'handler': 'execute', '_event_tag': 'obd/req/3fe6df61-8966-4819-a7f5-5f2345509cd6', 'args': ['STSLCS']}}
  37701. Traceback (most recent call last):
  37702. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  37703. res = self.process(message)
  37704. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  37705. result = func(message, **settings)
  37706. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  37707. found, result = self._call_hook_for(message, "workflow", message)
  37708. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37709. return True, func(*args, **kwargs)
  37710. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  37711. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37712. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37713. return True, func(*args, **kwargs)
  37714. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37715. return func(*args, **kwargs)
  37716. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  37717. res = conn.execute(cmd)
  37718. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  37719. return func(self, *args, **kwargs)
  37720. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  37721. return self._obd.execute(cmd, **kwargs)
  37722. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  37723. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  37724. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  37725. lines = self.send(cmd, raw_response=raw_response)
  37726. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  37727. raise ELM327Error(self.ERRORS[line], code=line)
  37728. ELM327Error: Operation interrupted by a received RS232 character
  37729. 2020-08-04 13:07:49,114 [salt.utils.parsers:1050][WARNING ][428] Minion received a SIGTERM. Exiting.
  37730. 2020-08-04 13:07:49,654 [messaging :871 ][WARNING ][898] No reply message with tag 'obd/res/3fe6df61-8966-4819-a7f5-5f2345509cd6' received within timeout of 30 secs
  37731. 2020-08-04 13:07:49,657 [salt.state :292 ][ERROR ][898] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  37732. 2020-08-04 13:08:05,995 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  37733. 2020-08-04 13:08:06,006 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  37734. 2020-08-04 13:08:06,017 [gpio_spi_conn :42 ][WARNING ][624] Unable to clear buffer - got unexpected value: 255
  37735. 2020-08-04 13:08:06,694 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  37736. Traceback (most recent call last):
  37737. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37738. self._serial.open()
  37739. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37740. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37741. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37742. 2020-08-04 13:08:07,712 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  37743. Traceback (most recent call last):
  37744. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37745. self._serial.open()
  37746. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37747. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37748. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37749. 2020-08-04 13:08:08,048 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  37750. 2020-08-04 13:08:08,551 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  37751. 2020-08-04 13:08:08,716 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  37752. Traceback (most recent call last):
  37753. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37754. self._serial.open()
  37755. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37756. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37757. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37758. 2020-08-04 13:08:09,054 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  37759. 2020-08-04 13:08:09,056 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  37760. 2020-08-04 13:08:09,356 [messaging :208 ][ERROR ][621] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  37761. Traceback (most recent call last):
  37762. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  37763. self._call_hook_for(message, "workflow", message)
  37764. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37765. return True, func(*args, **kwargs)
  37766. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  37767. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37768. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37769. return True, func(*args, **kwargs)
  37770. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37771. return func(*args, **kwargs)
  37772. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  37773. res = _exec("AT+CCLK?")
  37774. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  37775. conn.write_line(cmd)
  37776. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  37777. self.ensure_open()
  37778. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  37779. self.open()
  37780. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  37781. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  37782. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  37783. raise attempt.get()
  37784. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  37785. six.reraise(self.value[0], self.value[1], self.value[2])
  37786. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  37787. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  37788. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37789. self._serial.open()
  37790. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37791. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37792. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37793. 2020-08-04 13:08:09,560 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  37794. 2020-08-04 13:08:24,735 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][659] Timeout after 1.28205128205 second(s) waiting for interrupt
  37795. 2020-08-04 13:08:24,768 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  37796. Traceback (most recent call last):
  37797. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37798. self._serial.open()
  37799. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37800. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37801. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37802. 2020-08-04 13:08:25,052 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  37803. 2020-08-04 13:08:25,556 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  37804. 2020-08-04 13:08:25,559 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  37805. 2020-08-04 13:08:25,783 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  37806. Traceback (most recent call last):
  37807. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37808. self._serial.open()
  37809. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37810. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37811. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37812. 2020-08-04 13:08:26,063 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  37813. 2020-08-04 13:08:26,566 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  37814. 2020-08-04 13:08:26,787 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  37815. Traceback (most recent call last):
  37816. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37817. self._serial.open()
  37818. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37819. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37820. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37821. 2020-08-04 13:08:26,790 [messaging :206 ][ERROR ][621] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  37822. Traceback (most recent call last):
  37823. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  37824. self._call_hook_for(message, "workflow", message)
  37825. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37826. return True, func(*args, **kwargs)
  37827. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  37828. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37829. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37830. return True, func(*args, **kwargs)
  37831. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37832. return func(*args, **kwargs)
  37833. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  37834. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  37835. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  37836. conn.write_line(cmd)
  37837. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  37838. self.ensure_open()
  37839. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  37840. self.open()
  37841. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  37842. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  37843. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  37844. raise attempt.get()
  37845. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  37846. six.reraise(self.value[0], self.value[1], self.value[2])
  37847. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  37848. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  37849. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37850. self._serial.open()
  37851. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37852. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37853. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37854. 2020-08-04 13:08:27,070 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  37855. 2020-08-04 13:08:27,073 [spm_conn :139 ][WARNING ][624] Unable to get status: Expected ack '12' but got '255'
  37856. 2020-08-04 13:08:27,079 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  37857. 2020-08-04 13:08:27,582 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  37858. 2020-08-04 13:08:28,087 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  37859. 2020-08-04 13:08:28,092 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  37860. 2020-08-04 13:08:28,501 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  37861. Traceback (most recent call last):
  37862. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37863. self._serial.open()
  37864. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37865. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37866. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37867. 2020-08-04 13:08:28,600 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  37868. 2020-08-04 13:08:29,104 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  37869. 2020-08-04 13:08:29,505 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  37870. Traceback (most recent call last):
  37871. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37872. self._serial.open()
  37873. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37874. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37875. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37876. 2020-08-04 13:08:29,607 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  37877. 2020-08-04 13:08:29,609 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  37878. 2020-08-04 13:08:30,113 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  37879. 2020-08-04 13:08:30,509 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  37880. Traceback (most recent call last):
  37881. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37882. self._serial.open()
  37883. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37884. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37885. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37886. 2020-08-04 13:08:30,512 [messaging :742 ][ERROR ][621] Exception while processing event: {'tag': 'ec2x/req/b6772705-c7da-4940-b036-85d5c6767925', 'data': {'_stamp': '2020-08-04T13:08:06.078555', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/b6772705-c7da-4940-b036-85d5c6767925', 'kwargs': {'cooldown_delay': None}}}
  37887. Traceback (most recent call last):
  37888. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  37889. res = self.process(message)
  37890. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  37891. result = func(message, **settings)
  37892. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  37893. found, result = self._call_hook_for(message, "workflow", message)
  37894. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37895. return True, func(*args, **kwargs)
  37896. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  37897. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37898. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37899. return True, func(*args, **kwargs)
  37900. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37901. return func(*args, **kwargs)
  37902. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  37903. return _exec(cmd, **kwargs)
  37904. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  37905. conn.write_line(cmd)
  37906. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  37907. self.ensure_open()
  37908. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  37909. self.open()
  37910. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  37911. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  37912. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  37913. raise attempt.get()
  37914. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  37915. six.reraise(self.value[0], self.value[1], self.value[2])
  37916. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  37917. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  37918. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37919. self._serial.open()
  37920. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37921. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37922. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37923. 2020-08-04 13:08:30,616 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  37924. 2020-08-04 13:08:31,120 [gpio_spi_conn :109 ][WARNING ][624] Expected ack '12' but got '255'
  37925. 2020-08-04 13:08:31,123 [spm_conn :82 ][WARNING ][624] Unable to send noop: Expected ack '12' but got '255'
  37926. 2020-08-04 13:08:31,126 [messaging :208 ][ERROR ][624] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  37927. Traceback (most recent call last):
  37928. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  37929. self._call_hook_for(message, "workflow", message)
  37930. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37931. return True, func(*args, **kwargs)
  37932. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  37933. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37934. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37935. return True, func(*args, **kwargs)
  37936. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37937. return func(*args, **kwargs)
  37938. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  37939. conn.heartbeat()
  37940. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  37941. self.noop()
  37942. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  37943. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  37944. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  37945. raise attempt.get()
  37946. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  37947. six.reraise(self.value[0], self.value[1], self.value[2])
  37948. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  37949. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  37950. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  37951. self._begin_message()
  37952. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  37953. self.recv(ack=ACK_MESSAGE_BEGIN)
  37954. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  37955. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  37956. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  37957. raise attempt.get()
  37958. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  37959. six.reraise(self.value[0], self.value[1], self.value[2])
  37960. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  37961. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  37962. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  37963. raise Exception(msg)
  37964. Exception: Expected ack '12' but got '255'
  37965. 2020-08-04 13:08:32,688 [messaging :208 ][ERROR ][622] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  37966. Traceback (most recent call last):
  37967. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  37968. self._call_hook_for(message, "workflow", message)
  37969. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37970. return True, func(*args, **kwargs)
  37971. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  37972. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  37973. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  37974. return True, func(*args, **kwargs)
  37975. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  37976. return func(*args, **kwargs)
  37977. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  37978. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  37979. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  37980. res = query("AT+QGPSLOC={:d}".format(mode))
  37981. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  37982. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  37983. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  37984. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  37985. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  37986. raise salt.exceptions.CommandExecutionError(message["error"])
  37987. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37988. 2020-08-04 13:08:37,736 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  37989. Traceback (most recent call last):
  37990. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37991. self._serial.open()
  37992. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  37993. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  37994. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  37995. 2020-08-04 13:08:38,752 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  37996. Traceback (most recent call last):
  37997. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  37998. self._serial.open()
  37999. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38000. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38001. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38002. 2020-08-04 13:08:39,757 [serial_conn :79 ][ERROR ][621] Failed to open serial connection
  38003. Traceback (most recent call last):
  38004. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38005. self._serial.open()
  38006. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38007. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38008. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38009. 2020-08-04 13:08:39,761 [messaging :742 ][ERROR ][621] Exception while processing event: {'tag': 'ec2x/req/0403dd08-df78-4dc1-89ec-a1ec2e71d132', 'data': {'_stamp': '2020-08-04T13:08:37.727759', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/0403dd08-df78-4dc1-89ec-a1ec2e71d132', 'kwargs': {'cooldown_delay': None}}}
  38010. Traceback (most recent call last):
  38011. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  38012. res = self.process(message)
  38013. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  38014. result = func(message, **settings)
  38015. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  38016. found, result = self._call_hook_for(message, "workflow", message)
  38017. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38018. return True, func(*args, **kwargs)
  38019. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  38020. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38021. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38022. return True, func(*args, **kwargs)
  38023. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38024. return func(*args, **kwargs)
  38025. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  38026. return _exec(cmd, **kwargs)
  38027. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  38028. conn.write_line(cmd)
  38029. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  38030. self.ensure_open()
  38031. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  38032. self.open()
  38033. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  38034. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  38035. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  38036. raise attempt.get()
  38037. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  38038. six.reraise(self.value[0], self.value[1], self.value[2])
  38039. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  38040. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  38041. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38042. self._serial.open()
  38043. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38044. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38045. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38046. 2020-08-04 13:08:39,795 [messaging :206 ][ERROR ][622] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  38047. Traceback (most recent call last):
  38048. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  38049. self._call_hook_for(message, "workflow", message)
  38050. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38051. return True, func(*args, **kwargs)
  38052. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  38053. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38054. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38055. return True, func(*args, **kwargs)
  38056. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38057. return func(*args, **kwargs)
  38058. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  38059. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  38060. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  38061. res = query("AT+QGPSLOC={:d}".format(mode))
  38062. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  38063. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  38064. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  38065. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  38066. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  38067. raise salt.exceptions.CommandExecutionError(message["error"])
  38068. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38069. 2020-08-04 13:08:43,166 [obd.obd :107 ][ERROR ][658] Failed to use explicit port '/dev/serial0'
  38070. Traceback (most recent call last):
  38071. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  38072. self.interface.open(baudrate, protocol=protocol)
  38073. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  38074. self.set_protocol(prot.pop("id", None), **prot)
  38075. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  38076. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  38077. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  38078. self._protocol = self._auto_protocol(**kwargs)
  38079. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  38080. res_0100 = self._verify_protocol("auto", test=not verify)
  38081. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  38082. for line in self.query("0100", parse=False, read_timeout=10):
  38083. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  38084. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  38085. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  38086. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  38087. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  38088. data = self._port.read(self._port.in_waiting or 1)
  38089. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  38090. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  38091. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  38092. sys.exit(salt.defaults.exitcodes.EX_OK)
  38093. SystemExit: 0
  38094. 2020-08-04 13:08:43,207 [obd.obd :120 ][WARNING ][658] Cannot load commands - no connection to bus
  38095. 2020-08-04 13:08:43,239 [obd.interfaces.elm327:730 ][ERROR ][658] Failed to relay command 'STSLCS' to interface
  38096. Traceback (most recent call last):
  38097. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  38098. lines = self.send(cmd, raw_response=raw_response)
  38099. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  38100. raise ELM327Error(self.ERRORS[line], code=line)
  38101. ELM327Error: Operation interrupted by a received RS232 character
  38102. 2020-08-04 13:08:43,242 [messaging :742 ][ERROR ][658] Exception while processing event: {'tag': 'obd/req/5ff0638d-f09b-4436-9343-0e5de25325b9', 'data': {'_stamp': '2020-08-04T13:08:37.665663', 'handler': 'execute', '_event_tag': 'obd/req/5ff0638d-f09b-4436-9343-0e5de25325b9', 'args': ['STSLCS']}}
  38103. Traceback (most recent call last):
  38104. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  38105. res = self.process(message)
  38106. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  38107. result = func(message, **settings)
  38108. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  38109. found, result = self._call_hook_for(message, "workflow", message)
  38110. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38111. return True, func(*args, **kwargs)
  38112. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  38113. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38114. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38115. return True, func(*args, **kwargs)
  38116. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38117. return func(*args, **kwargs)
  38118. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  38119. res = conn.execute(cmd)
  38120. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  38121. return func(self, *args, **kwargs)
  38122. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  38123. return self._obd.execute(cmd, **kwargs)
  38124. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  38125. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  38126. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  38127. lines = self.send(cmd, raw_response=raw_response)
  38128. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  38129. raise ELM327Error(self.ERRORS[line], code=line)
  38130. ELM327Error: Operation interrupted by a received RS232 character
  38131. 2020-08-04 13:08:43,981 [salt.utils.parsers:1050][WARNING ][421] Minion received a SIGTERM. Exiting.
  38132. 2020-08-04 13:08:44,521 [messaging :871 ][WARNING ][821] No reply message with tag 'obd/res/5ff0638d-f09b-4436-9343-0e5de25325b9' received within timeout of 30 secs
  38133. 2020-08-04 13:08:44,525 [salt.state :292 ][ERROR ][821] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  38134. 2020-08-04 13:09:01,142 [gpio_spi_conn :42 ][WARNING ][617] Unable to clear buffer - got unexpected value: 255
  38135. 2020-08-04 13:09:01,160 [gpio_spi_conn :42 ][WARNING ][617] Unable to clear buffer - got unexpected value: 255
  38136. 2020-08-04 13:09:01,166 [gpio_spi_conn :42 ][WARNING ][617] Unable to clear buffer - got unexpected value: 255
  38137. 2020-08-04 13:09:01,816 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38138. Traceback (most recent call last):
  38139. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38140. self._serial.open()
  38141. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38142. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38143. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38144. 2020-08-04 13:09:02,828 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38145. Traceback (most recent call last):
  38146. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38147. self._serial.open()
  38148. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38149. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38150. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38151. 2020-08-04 13:09:03,213 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  38152. 2020-08-04 13:09:03,717 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  38153. 2020-08-04 13:09:03,832 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38154. Traceback (most recent call last):
  38155. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38156. self._serial.open()
  38157. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38158. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38159. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38160. 2020-08-04 13:09:04,220 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  38161. 2020-08-04 13:09:04,223 [spm_conn :139 ][WARNING ][617] Unable to get status: Expected ack '12' but got '255'
  38162. 2020-08-04 13:09:04,440 [messaging :208 ][ERROR ][614] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  38163. Traceback (most recent call last):
  38164. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  38165. self._call_hook_for(message, "workflow", message)
  38166. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38167. return True, func(*args, **kwargs)
  38168. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  38169. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38170. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38171. return True, func(*args, **kwargs)
  38172. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38173. return func(*args, **kwargs)
  38174. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  38175. res = _exec("AT+CCLK?")
  38176. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  38177. conn.write_line(cmd)
  38178. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  38179. self.ensure_open()
  38180. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  38181. self.open()
  38182. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  38183. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  38184. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  38185. raise attempt.get()
  38186. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  38187. six.reraise(self.value[0], self.value[1], self.value[2])
  38188. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  38189. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  38190. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38191. self._serial.open()
  38192. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38193. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38194. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38195. 2020-08-04 13:09:04,727 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  38196. 2020-08-04 13:09:05,230 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  38197. 2020-08-04 13:09:05,734 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  38198. 2020-08-04 13:09:05,736 [spm_conn :139 ][WARNING ][617] Unable to get status: Expected ack '12' but got '255'
  38199. 2020-08-04 13:09:06,240 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  38200. 2020-08-04 13:09:06,744 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  38201. 2020-08-04 13:09:07,248 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  38202. 2020-08-04 13:09:07,250 [spm_conn :139 ][WARNING ][617] Unable to get status: Expected ack '12' but got '255'
  38203. 2020-08-04 13:09:07,254 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  38204. 2020-08-04 13:09:07,757 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  38205. 2020-08-04 13:09:08,220 [salt.utils :831 ][ERROR ][415] DNS lookup or connection check of 'hub' failed.
  38206. 2020-08-04 13:09:08,260 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  38207. 2020-08-04 13:09:08,263 [spm_conn :82 ][WARNING ][617] Unable to send noop: Expected ack '12' but got '255'
  38208. 2020-08-04 13:09:08,539 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38209. Traceback (most recent call last):
  38210. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38211. self._serial.open()
  38212. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38213. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38214. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38215. 2020-08-04 13:09:08,766 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  38216. 2020-08-04 13:09:09,270 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  38217. 2020-08-04 13:09:09,543 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38218. Traceback (most recent call last):
  38219. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38220. self._serial.open()
  38221. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38222. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38223. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38224. 2020-08-04 13:09:09,760 [cloud_cache :432 ][WARNING ][655] Temporarily unable to upload batch with 10 entries from queue 'pend': HTTPSConnectionPool(host='api.autopi.io', port=443): Max retries exceeded with url: /logbook/storage (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x735c69b0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))
  38225. 2020-08-04 13:09:09,773 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  38226. 2020-08-04 13:09:09,776 [spm_conn :82 ][WARNING ][617] Unable to send noop: Expected ack '12' but got '255'
  38227. 2020-08-04 13:09:10,279 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  38228. 2020-08-04 13:09:10,547 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38229. Traceback (most recent call last):
  38230. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38231. self._serial.open()
  38232. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38233. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38234. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38235. 2020-08-04 13:09:10,550 [messaging :742 ][ERROR ][614] Exception while processing event: {'tag': 'ec2x/req/0a620134-fbf4-410d-81fb-bf5d88decbc3', 'data': {'_stamp': '2020-08-04T13:09:01.202428', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/0a620134-fbf4-410d-81fb-bf5d88decbc3', 'kwargs': {'cooldown_delay': None}}}
  38236. Traceback (most recent call last):
  38237. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  38238. res = self.process(message)
  38239. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  38240. result = func(message, **settings)
  38241. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  38242. found, result = self._call_hook_for(message, "workflow", message)
  38243. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38244. return True, func(*args, **kwargs)
  38245. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  38246. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38247. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38248. return True, func(*args, **kwargs)
  38249. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38250. return func(*args, **kwargs)
  38251. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  38252. return _exec(cmd, **kwargs)
  38253. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  38254. conn.write_line(cmd)
  38255. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  38256. self.ensure_open()
  38257. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  38258. self.open()
  38259. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  38260. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  38261. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  38262. raise attempt.get()
  38263. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  38264. six.reraise(self.value[0], self.value[1], self.value[2])
  38265. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  38266. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  38267. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38268. self._serial.open()
  38269. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38270. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38271. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38272. 2020-08-04 13:09:10,609 [messaging :208 ][ERROR ][615] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  38273. Traceback (most recent call last):
  38274. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  38275. self._call_hook_for(message, "workflow", message)
  38276. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38277. return True, func(*args, **kwargs)
  38278. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  38279. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38280. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38281. return True, func(*args, **kwargs)
  38282. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38283. return func(*args, **kwargs)
  38284. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  38285. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  38286. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  38287. res = query("AT+QGPSLOC={:d}".format(mode))
  38288. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  38289. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  38290. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  38291. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  38292. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  38293. raise salt.exceptions.CommandExecutionError(message["error"])
  38294. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38295. 2020-08-04 13:09:10,783 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  38296. 2020-08-04 13:09:11,147 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38297. Traceback (most recent call last):
  38298. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38299. self._serial.open()
  38300. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38301. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38302. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38303. 2020-08-04 13:09:11,286 [gpio_spi_conn :109 ][WARNING ][617] Expected ack '12' but got '255'
  38304. 2020-08-04 13:09:11,297 [spm_conn :82 ][WARNING ][617] Unable to send noop: Expected ack '12' but got '255'
  38305. 2020-08-04 13:09:11,300 [messaging :208 ][ERROR ][617] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  38306. Traceback (most recent call last):
  38307. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  38308. self._call_hook_for(message, "workflow", message)
  38309. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38310. return True, func(*args, **kwargs)
  38311. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  38312. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38313. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38314. return True, func(*args, **kwargs)
  38315. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38316. return func(*args, **kwargs)
  38317. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  38318. conn.heartbeat()
  38319. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  38320. self.noop()
  38321. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  38322. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  38323. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  38324. raise attempt.get()
  38325. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  38326. six.reraise(self.value[0], self.value[1], self.value[2])
  38327. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  38328. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  38329. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  38330. self._begin_message()
  38331. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  38332. self.recv(ack=ACK_MESSAGE_BEGIN)
  38333. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  38334. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  38335. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  38336. raise attempt.get()
  38337. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  38338. six.reraise(self.value[0], self.value[1], self.value[2])
  38339. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  38340. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  38341. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  38342. raise Exception(msg)
  38343. Exception: Expected ack '12' but got '255'
  38344. 2020-08-04 13:09:12,152 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38345. Traceback (most recent call last):
  38346. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38347. self._serial.open()
  38348. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38349. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38350. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38351. 2020-08-04 13:09:13,156 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38352. Traceback (most recent call last):
  38353. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38354. self._serial.open()
  38355. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38356. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38357. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38358. 2020-08-04 13:09:13,656 [messaging :206 ][ERROR ][614] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  38359. Traceback (most recent call last):
  38360. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  38361. self._call_hook_for(message, "workflow", message)
  38362. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38363. return True, func(*args, **kwargs)
  38364. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  38365. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38366. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38367. return True, func(*args, **kwargs)
  38368. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38369. return func(*args, **kwargs)
  38370. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  38371. res = _exec("AT+CCLK?")
  38372. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  38373. conn.write_line(cmd)
  38374. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  38375. self.ensure_open()
  38376. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  38377. self.open()
  38378. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  38379. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  38380. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  38381. raise attempt.get()
  38382. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  38383. six.reraise(self.value[0], self.value[1], self.value[2])
  38384. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  38385. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  38386. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38387. self._serial.open()
  38388. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38389. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38390. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38391. 2020-08-04 13:09:15,672 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38392. Traceback (most recent call last):
  38393. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38394. self._serial.open()
  38395. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38396. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38397. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38398. 2020-08-04 13:09:16,680 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38399. Traceback (most recent call last):
  38400. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38401. self._serial.open()
  38402. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38403. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38404. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38405. 2020-08-04 13:09:17,685 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38406. Traceback (most recent call last):
  38407. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38408. self._serial.open()
  38409. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38410. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38411. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38412. 2020-08-04 13:09:17,688 [messaging :742 ][ERROR ][614] Exception while processing event: {'tag': 'ec2x/req/5b0f8db7-476b-4bc5-820d-1d648fad638c', 'data': {'_stamp': '2020-08-04T13:09:15.649312', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/5b0f8db7-476b-4bc5-820d-1d648fad638c', 'kwargs': {'cooldown_delay': None}}}
  38413. Traceback (most recent call last):
  38414. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  38415. res = self.process(message)
  38416. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  38417. result = func(message, **settings)
  38418. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  38419. found, result = self._call_hook_for(message, "workflow", message)
  38420. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38421. return True, func(*args, **kwargs)
  38422. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  38423. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38424. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38425. return True, func(*args, **kwargs)
  38426. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38427. return func(*args, **kwargs)
  38428. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  38429. return _exec(cmd, **kwargs)
  38430. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  38431. conn.write_line(cmd)
  38432. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  38433. self.ensure_open()
  38434. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  38435. self.open()
  38436. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  38437. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  38438. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  38439. raise attempt.get()
  38440. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  38441. six.reraise(self.value[0], self.value[1], self.value[2])
  38442. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  38443. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  38444. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38445. self._serial.open()
  38446. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38447. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38448. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38449. 2020-08-04 13:09:17,717 [messaging :206 ][ERROR ][615] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  38450. Traceback (most recent call last):
  38451. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  38452. self._call_hook_for(message, "workflow", message)
  38453. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38454. return True, func(*args, **kwargs)
  38455. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  38456. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38457. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38458. return True, func(*args, **kwargs)
  38459. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38460. return func(*args, **kwargs)
  38461. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  38462. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  38463. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  38464. res = query("AT+QGPSLOC={:d}".format(mode))
  38465. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  38466. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  38467. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  38468. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  38469. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  38470. raise salt.exceptions.CommandExecutionError(message["error"])
  38471. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38472. 2020-08-04 13:09:19,266 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38473. Traceback (most recent call last):
  38474. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38475. self._serial.open()
  38476. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38477. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38478. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38479. 2020-08-04 13:09:20,271 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38480. Traceback (most recent call last):
  38481. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38482. self._serial.open()
  38483. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38484. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38485. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38486. 2020-08-04 13:09:21,275 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38487. Traceback (most recent call last):
  38488. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38489. self._serial.open()
  38490. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38491. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38492. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38493. 2020-08-04 13:09:21,826 [messaging :206 ][ERROR ][614] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  38494. Traceback (most recent call last):
  38495. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  38496. self._call_hook_for(message, "workflow", message)
  38497. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38498. return True, func(*args, **kwargs)
  38499. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  38500. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38501. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38502. return True, func(*args, **kwargs)
  38503. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38504. return func(*args, **kwargs)
  38505. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  38506. res = _exec("AT+CCLK?")
  38507. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  38508. conn.write_line(cmd)
  38509. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  38510. self.ensure_open()
  38511. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  38512. self.open()
  38513. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  38514. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  38515. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  38516. raise attempt.get()
  38517. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  38518. six.reraise(self.value[0], self.value[1], self.value[2])
  38519. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  38520. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  38521. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38522. self._serial.open()
  38523. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38524. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38525. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38526. 2020-08-04 13:09:22,759 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38527. Traceback (most recent call last):
  38528. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38529. self._serial.open()
  38530. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38531. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38532. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38533. 2020-08-04 13:09:23,764 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38534. Traceback (most recent call last):
  38535. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38536. self._serial.open()
  38537. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38538. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38539. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38540. 2020-08-04 13:09:24,768 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38541. Traceback (most recent call last):
  38542. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38543. self._serial.open()
  38544. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38545. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38546. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38547. 2020-08-04 13:09:24,771 [messaging :742 ][ERROR ][614] Exception while processing event: {'tag': 'ec2x/req/1b791eb1-ca3d-4740-8046-8e634bbdf311', 'data': {'_stamp': '2020-08-04T13:09:22.742427', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/1b791eb1-ca3d-4740-8046-8e634bbdf311', 'kwargs': {'cooldown_delay': None}}}
  38548. Traceback (most recent call last):
  38549. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  38550. res = self.process(message)
  38551. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  38552. result = func(message, **settings)
  38553. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  38554. found, result = self._call_hook_for(message, "workflow", message)
  38555. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38556. return True, func(*args, **kwargs)
  38557. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  38558. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38559. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38560. return True, func(*args, **kwargs)
  38561. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38562. return func(*args, **kwargs)
  38563. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  38564. return _exec(cmd, **kwargs)
  38565. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  38566. conn.write_line(cmd)
  38567. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  38568. self.ensure_open()
  38569. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  38570. self.open()
  38571. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  38572. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  38573. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  38574. raise attempt.get()
  38575. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  38576. six.reraise(self.value[0], self.value[1], self.value[2])
  38577. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  38578. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  38579. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38580. self._serial.open()
  38581. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38582. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38583. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38584. 2020-08-04 13:09:24,802 [messaging :206 ][ERROR ][615] Recurring exception (3 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  38585. Traceback (most recent call last):
  38586. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  38587. self._call_hook_for(message, "workflow", message)
  38588. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38589. return True, func(*args, **kwargs)
  38590. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  38591. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38592. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38593. return True, func(*args, **kwargs)
  38594. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38595. return func(*args, **kwargs)
  38596. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  38597. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  38598. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  38599. res = query("AT+QGPSLOC={:d}".format(mode))
  38600. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  38601. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  38602. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  38603. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  38604. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  38605. raise salt.exceptions.CommandExecutionError(message["error"])
  38606. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38607. 2020-08-04 13:09:27,470 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38608. Traceback (most recent call last):
  38609. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38610. self._serial.open()
  38611. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38612. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38613. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38614. 2020-08-04 13:09:28,475 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38615. Traceback (most recent call last):
  38616. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38617. self._serial.open()
  38618. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38619. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38620. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38621. 2020-08-04 13:09:29,489 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38622. Traceback (most recent call last):
  38623. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38624. self._serial.open()
  38625. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38626. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38627. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38628. 2020-08-04 13:09:30,042 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38629. Traceback (most recent call last):
  38630. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38631. self._serial.open()
  38632. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38633. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38634. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38635. 2020-08-04 13:09:45,138 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][654] Timeout after 1.28205128205 second(s) waiting for interrupt
  38636. 2020-08-04 13:09:45,781 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38637. Traceback (most recent call last):
  38638. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38639. self._serial.open()
  38640. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38641. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38642. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38643. 2020-08-04 13:09:46,795 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38644. Traceback (most recent call last):
  38645. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38646. self._serial.open()
  38647. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38648. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38649. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38650. 2020-08-04 13:09:46,819 [messaging :742 ][ERROR ][614] Exception while processing event: {'tag': 'ec2x/req/4923db22-3b24-40f3-a797-12f45756a6cc', 'data': {'_stamp': '2020-08-04T13:09:29.816375', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/4923db22-3b24-40f3-a797-12f45756a6cc', 'kwargs': {'cooldown_delay': None}}}
  38651. Traceback (most recent call last):
  38652. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  38653. res = self.process(message)
  38654. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  38655. result = func(message, **settings)
  38656. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  38657. found, result = self._call_hook_for(message, "workflow", message)
  38658. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38659. return True, func(*args, **kwargs)
  38660. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  38661. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38662. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38663. return True, func(*args, **kwargs)
  38664. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38665. return func(*args, **kwargs)
  38666. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  38667. return _exec(cmd, **kwargs)
  38668. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  38669. conn.write_line(cmd)
  38670. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  38671. self.ensure_open()
  38672. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  38673. self.open()
  38674. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  38675. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  38676. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  38677. raise attempt.get()
  38678. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  38679. six.reraise(self.value[0], self.value[1], self.value[2])
  38680. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  38681. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  38682. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38683. self._serial.open()
  38684. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38685. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38686. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38687. 2020-08-04 13:09:47,488 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38688. Traceback (most recent call last):
  38689. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38690. self._serial.open()
  38691. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38692. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38693. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38694. 2020-08-04 13:09:48,494 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38695. Traceback (most recent call last):
  38696. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38697. self._serial.open()
  38698. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38699. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38700. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38701. 2020-08-04 13:09:49,498 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38702. Traceback (most recent call last):
  38703. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38704. self._serial.open()
  38705. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38706. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38707. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38708. 2020-08-04 13:09:51,912 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38709. Traceback (most recent call last):
  38710. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38711. self._serial.open()
  38712. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38713. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38714. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38715. 2020-08-04 13:09:52,918 [serial_conn :79 ][ERROR ][614] Failed to open serial connection
  38716. Traceback (most recent call last):
  38717. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38718. self._serial.open()
  38719. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38720. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38721. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38722. 2020-08-04 13:09:54,095 [obd.obd :107 ][ERROR ][653] Failed to use explicit port '/dev/serial0'
  38723. Traceback (most recent call last):
  38724. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  38725. self.interface.open(baudrate, protocol=protocol)
  38726. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  38727. self.set_protocol(prot.pop("id", None), **prot)
  38728. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  38729. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  38730. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  38731. self._protocol = self._auto_protocol(**kwargs)
  38732. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  38733. res_0100 = self._verify_protocol("auto", test=not verify)
  38734. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  38735. for line in self.query("0100", parse=False, read_timeout=10):
  38736. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  38737. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  38738. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  38739. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  38740. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  38741. data = self._port.read(self._port.in_waiting or 1)
  38742. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  38743. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  38744. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  38745. sys.exit(salt.defaults.exitcodes.EX_OK)
  38746. SystemExit: 0
  38747. 2020-08-04 13:09:54,124 [obd.obd :120 ][WARNING ][653] Cannot load commands - no connection to bus
  38748. 2020-08-04 13:09:54,161 [obd.interfaces.elm327:730 ][ERROR ][653] Failed to relay command 'STSLCS' to interface
  38749. Traceback (most recent call last):
  38750. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  38751. lines = self.send(cmd, raw_response=raw_response)
  38752. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  38753. raise ELM327Error(self.ERRORS[line], code=line)
  38754. ELM327Error: Operation interrupted by a received RS232 character
  38755. 2020-08-04 13:09:54,163 [messaging :742 ][ERROR ][653] Exception while processing event: {'tag': 'obd/req/a5a55577-cef8-475f-916e-26fa522eaf83', 'data': {'_stamp': '2020-08-04T13:09:49.012382', 'handler': 'execute', '_event_tag': 'obd/req/a5a55577-cef8-475f-916e-26fa522eaf83', 'args': ['STSLCS']}}
  38756. Traceback (most recent call last):
  38757. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  38758. res = self.process(message)
  38759. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  38760. result = func(message, **settings)
  38761. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  38762. found, result = self._call_hook_for(message, "workflow", message)
  38763. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38764. return True, func(*args, **kwargs)
  38765. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  38766. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38767. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38768. return True, func(*args, **kwargs)
  38769. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38770. return func(*args, **kwargs)
  38771. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  38772. res = conn.execute(cmd)
  38773. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  38774. return func(self, *args, **kwargs)
  38775. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  38776. return self._obd.execute(cmd, **kwargs)
  38777. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  38778. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  38779. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  38780. lines = self.send(cmd, raw_response=raw_response)
  38781. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  38782. raise ELM327Error(self.ERRORS[line], code=line)
  38783. ELM327Error: Operation interrupted by a received RS232 character
  38784. 2020-08-04 13:09:54,347 [messaging :753 ][WARNING ][614] No reply to send back for event: {'tag': 'ec2x/req/dd1f47a9-033f-4286-a157-0ec9ad4f79c1', 'data': {'_stamp': '2020-08-04T13:09:51.893744', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/dd1f47a9-033f-4286-a157-0ec9ad4f79c1', 'kwargs': {'cooldown_delay': None}}}
  38785. 2020-08-04 13:09:54,927 [salt.utils.parsers:1050][WARNING ][415] Minion received a SIGTERM. Exiting.
  38786. 2020-08-04 13:09:55,467 [messaging :871 ][WARNING ][885] No reply message with tag 'obd/res/a5a55577-cef8-475f-916e-26fa522eaf83' received within timeout of 30 secs
  38787. 2020-08-04 13:09:55,471 [salt.state :292 ][ERROR ][885] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  38788. 2020-08-04 13:10:11,950 [gpio_spi_conn :42 ][WARNING ][627] Unable to clear buffer - got unexpected value: 255
  38789. 2020-08-04 13:10:11,962 [gpio_spi_conn :42 ][WARNING ][627] Unable to clear buffer - got unexpected value: 255
  38790. 2020-08-04 13:10:11,971 [gpio_spi_conn :42 ][WARNING ][627] Unable to clear buffer - got unexpected value: 255
  38791. 2020-08-04 13:10:12,616 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  38792. Traceback (most recent call last):
  38793. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38794. self._serial.open()
  38795. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38796. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38797. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38798. 2020-08-04 13:10:13,629 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  38799. Traceback (most recent call last):
  38800. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38801. self._serial.open()
  38802. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38803. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38804. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38805. 2020-08-04 13:10:14,011 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  38806. 2020-08-04 13:10:14,514 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  38807. 2020-08-04 13:10:14,634 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  38808. Traceback (most recent call last):
  38809. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38810. self._serial.open()
  38811. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38812. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38813. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38814. 2020-08-04 13:10:15,017 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  38815. 2020-08-04 13:10:15,019 [spm_conn :139 ][WARNING ][627] Unable to get status: Expected ack '12' but got '255'
  38816. 2020-08-04 13:10:15,283 [messaging :208 ][ERROR ][624] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  38817. Traceback (most recent call last):
  38818. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  38819. self._call_hook_for(message, "workflow", message)
  38820. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38821. return True, func(*args, **kwargs)
  38822. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  38823. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38824. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38825. return True, func(*args, **kwargs)
  38826. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38827. return func(*args, **kwargs)
  38828. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  38829. res = _exec("AT+CCLK?")
  38830. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  38831. conn.write_line(cmd)
  38832. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  38833. self.ensure_open()
  38834. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  38835. self.open()
  38836. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  38837. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  38838. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  38839. raise attempt.get()
  38840. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  38841. six.reraise(self.value[0], self.value[1], self.value[2])
  38842. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  38843. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  38844. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38845. self._serial.open()
  38846. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38847. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38848. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38849. 2020-08-04 13:10:15,524 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  38850. 2020-08-04 13:10:30,395 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][712] Timeout after 1.28205128205 second(s) waiting for interrupt
  38851. 2020-08-04 13:10:30,470 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  38852. Traceback (most recent call last):
  38853. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38854. self._serial.open()
  38855. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38856. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38857. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38858. 2020-08-04 13:10:30,786 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  38859. 2020-08-04 13:10:31,290 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  38860. 2020-08-04 13:10:31,293 [spm_conn :139 ][WARNING ][627] Unable to get status: Expected ack '12' but got '255'
  38861. 2020-08-04 13:10:31,475 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  38862. Traceback (most recent call last):
  38863. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38864. self._serial.open()
  38865. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38866. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38867. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38868. 2020-08-04 13:10:31,797 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  38869. 2020-08-04 13:10:32,300 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  38870. 2020-08-04 13:10:32,478 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  38871. Traceback (most recent call last):
  38872. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38873. self._serial.open()
  38874. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38875. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38876. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38877. 2020-08-04 13:10:32,482 [messaging :206 ][ERROR ][624] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  38878. Traceback (most recent call last):
  38879. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  38880. self._call_hook_for(message, "workflow", message)
  38881. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38882. return True, func(*args, **kwargs)
  38883. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  38884. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38885. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38886. return True, func(*args, **kwargs)
  38887. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38888. return func(*args, **kwargs)
  38889. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  38890. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  38891. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  38892. conn.write_line(cmd)
  38893. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  38894. self.ensure_open()
  38895. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  38896. self.open()
  38897. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  38898. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  38899. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  38900. raise attempt.get()
  38901. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  38902. six.reraise(self.value[0], self.value[1], self.value[2])
  38903. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  38904. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  38905. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38906. self._serial.open()
  38907. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38908. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38909. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38910. 2020-08-04 13:10:32,804 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  38911. 2020-08-04 13:10:32,806 [spm_conn :139 ][WARNING ][627] Unable to get status: Expected ack '12' but got '255'
  38912. 2020-08-04 13:10:32,809 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  38913. 2020-08-04 13:10:33,312 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  38914. 2020-08-04 13:10:33,815 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  38915. 2020-08-04 13:10:33,817 [spm_conn :82 ][WARNING ][627] Unable to send noop: Expected ack '12' but got '255'
  38916. 2020-08-04 13:10:34,258 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  38917. Traceback (most recent call last):
  38918. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38919. self._serial.open()
  38920. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38921. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38922. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38923. 2020-08-04 13:10:34,321 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  38924. 2020-08-04 13:10:34,824 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  38925. 2020-08-04 13:10:35,263 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  38926. Traceback (most recent call last):
  38927. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38928. self._serial.open()
  38929. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38930. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38931. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38932. 2020-08-04 13:10:35,327 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  38933. 2020-08-04 13:10:35,329 [spm_conn :82 ][WARNING ][627] Unable to send noop: Expected ack '12' but got '255'
  38934. 2020-08-04 13:10:35,833 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  38935. 2020-08-04 13:10:36,267 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  38936. Traceback (most recent call last):
  38937. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38938. self._serial.open()
  38939. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38940. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38941. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38942. 2020-08-04 13:10:36,279 [messaging :742 ][ERROR ][624] Exception while processing event: {'tag': 'ec2x/req/575b727f-7e77-46a0-8767-91e94e0a6840', 'data': {'_stamp': '2020-08-04T13:10:12.038983', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/575b727f-7e77-46a0-8767-91e94e0a6840', 'kwargs': {'cooldown_delay': None}}}
  38943. Traceback (most recent call last):
  38944. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  38945. res = self.process(message)
  38946. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  38947. result = func(message, **settings)
  38948. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  38949. found, result = self._call_hook_for(message, "workflow", message)
  38950. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38951. return True, func(*args, **kwargs)
  38952. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  38953. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38954. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38955. return True, func(*args, **kwargs)
  38956. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38957. return func(*args, **kwargs)
  38958. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  38959. return _exec(cmd, **kwargs)
  38960. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  38961. conn.write_line(cmd)
  38962. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  38963. self.ensure_open()
  38964. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  38965. self.open()
  38966. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  38967. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  38968. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  38969. raise attempt.get()
  38970. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  38971. six.reraise(self.value[0], self.value[1], self.value[2])
  38972. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  38973. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  38974. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  38975. self._serial.open()
  38976. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  38977. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  38978. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  38979. 2020-08-04 13:10:36,336 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  38980. 2020-08-04 13:10:36,839 [gpio_spi_conn :109 ][WARNING ][627] Expected ack '12' but got '255'
  38981. 2020-08-04 13:10:36,842 [spm_conn :82 ][WARNING ][627] Unable to send noop: Expected ack '12' but got '255'
  38982. 2020-08-04 13:10:36,844 [messaging :208 ][ERROR ][627] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  38983. Traceback (most recent call last):
  38984. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  38985. self._call_hook_for(message, "workflow", message)
  38986. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38987. return True, func(*args, **kwargs)
  38988. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  38989. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  38990. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  38991. return True, func(*args, **kwargs)
  38992. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  38993. return func(*args, **kwargs)
  38994. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  38995. conn.heartbeat()
  38996. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  38997. self.noop()
  38998. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  38999. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  39000. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  39001. raise attempt.get()
  39002. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  39003. six.reraise(self.value[0], self.value[1], self.value[2])
  39004. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  39005. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  39006. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  39007. self._begin_message()
  39008. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  39009. self.recv(ack=ACK_MESSAGE_BEGIN)
  39010. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  39011. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  39012. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  39013. raise attempt.get()
  39014. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  39015. six.reraise(self.value[0], self.value[1], self.value[2])
  39016. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  39017. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  39018. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  39019. raise Exception(msg)
  39020. Exception: Expected ack '12' but got '255'
  39021. 2020-08-04 13:10:38,443 [messaging :208 ][ERROR ][625] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  39022. Traceback (most recent call last):
  39023. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  39024. self._call_hook_for(message, "workflow", message)
  39025. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39026. return True, func(*args, **kwargs)
  39027. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  39028. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39029. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39030. return True, func(*args, **kwargs)
  39031. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39032. return func(*args, **kwargs)
  39033. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  39034. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  39035. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  39036. res = query("AT+QGPSLOC={:d}".format(mode))
  39037. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  39038. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  39039. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  39040. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  39041. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  39042. raise salt.exceptions.CommandExecutionError(message["error"])
  39043. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39044. 2020-08-04 13:10:43,489 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  39045. Traceback (most recent call last):
  39046. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39047. self._serial.open()
  39048. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39049. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39050. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39051. 2020-08-04 13:10:44,493 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  39052. Traceback (most recent call last):
  39053. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39054. self._serial.open()
  39055. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39056. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39057. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39058. 2020-08-04 13:10:45,497 [serial_conn :79 ][ERROR ][624] Failed to open serial connection
  39059. Traceback (most recent call last):
  39060. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39061. self._serial.open()
  39062. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39063. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39064. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39065. 2020-08-04 13:10:45,500 [messaging :742 ][ERROR ][624] Exception while processing event: {'tag': 'ec2x/req/5894b9fb-476b-4a1a-9640-fdfdfb32b669', 'data': {'_stamp': '2020-08-04T13:10:43.477954', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/5894b9fb-476b-4a1a-9640-fdfdfb32b669', 'kwargs': {'cooldown_delay': None}}}
  39066. Traceback (most recent call last):
  39067. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  39068. res = self.process(message)
  39069. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  39070. result = func(message, **settings)
  39071. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  39072. found, result = self._call_hook_for(message, "workflow", message)
  39073. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39074. return True, func(*args, **kwargs)
  39075. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  39076. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39077. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39078. return True, func(*args, **kwargs)
  39079. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39080. return func(*args, **kwargs)
  39081. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  39082. return _exec(cmd, **kwargs)
  39083. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  39084. conn.write_line(cmd)
  39085. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  39086. self.ensure_open()
  39087. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  39088. self.open()
  39089. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  39090. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  39091. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  39092. raise attempt.get()
  39093. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  39094. six.reraise(self.value[0], self.value[1], self.value[2])
  39095. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  39096. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  39097. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39098. self._serial.open()
  39099. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39100. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39101. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39102. 2020-08-04 13:10:45,524 [messaging :206 ][ERROR ][625] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  39103. Traceback (most recent call last):
  39104. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  39105. self._call_hook_for(message, "workflow", message)
  39106. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39107. return True, func(*args, **kwargs)
  39108. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  39109. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39110. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39111. return True, func(*args, **kwargs)
  39112. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39113. return func(*args, **kwargs)
  39114. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  39115. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  39116. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  39117. res = query("AT+QGPSLOC={:d}".format(mode))
  39118. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  39119. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  39120. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  39121. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  39122. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  39123. raise salt.exceptions.CommandExecutionError(message["error"])
  39124. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39125. 2020-08-04 13:10:48,734 [obd.obd :107 ][ERROR ][711] Failed to use explicit port '/dev/serial0'
  39126. Traceback (most recent call last):
  39127. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  39128. self.interface.open(baudrate, protocol=protocol)
  39129. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  39130. self.set_protocol(prot.pop("id", None), **prot)
  39131. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  39132. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  39133. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  39134. self._protocol = self._auto_protocol(**kwargs)
  39135. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  39136. res_0100 = self._verify_protocol("auto", test=not verify)
  39137. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  39138. for line in self.query("0100", parse=False, read_timeout=10):
  39139. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  39140. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  39141. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  39142. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  39143. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  39144. data = self._port.read(self._port.in_waiting or 1)
  39145. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  39146. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  39147. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  39148. sys.exit(salt.defaults.exitcodes.EX_OK)
  39149. SystemExit: 0
  39150. 2020-08-04 13:10:48,776 [obd.obd :120 ][WARNING ][711] Cannot load commands - no connection to bus
  39151. 2020-08-04 13:10:48,809 [obd.interfaces.elm327:730 ][ERROR ][711] Failed to relay command 'STSLCS' to interface
  39152. Traceback (most recent call last):
  39153. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  39154. lines = self.send(cmd, raw_response=raw_response)
  39155. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  39156. raise ELM327Error(self.ERRORS[line], code=line)
  39157. ELM327Error: Operation interrupted by a received RS232 character
  39158. 2020-08-04 13:10:48,813 [messaging :742 ][ERROR ][711] Exception while processing event: {'tag': 'obd/req/e20c9969-f8ca-4a6e-a408-257a1d8df158', 'data': {'_stamp': '2020-08-04T13:10:43.261002', 'handler': 'execute', '_event_tag': 'obd/req/e20c9969-f8ca-4a6e-a408-257a1d8df158', 'args': ['STSLCS']}}
  39159. Traceback (most recent call last):
  39160. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  39161. res = self.process(message)
  39162. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  39163. result = func(message, **settings)
  39164. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  39165. found, result = self._call_hook_for(message, "workflow", message)
  39166. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39167. return True, func(*args, **kwargs)
  39168. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  39169. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39170. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39171. return True, func(*args, **kwargs)
  39172. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39173. return func(*args, **kwargs)
  39174. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  39175. res = conn.execute(cmd)
  39176. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  39177. return func(self, *args, **kwargs)
  39178. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  39179. return self._obd.execute(cmd, **kwargs)
  39180. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  39181. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  39182. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  39183. lines = self.send(cmd, raw_response=raw_response)
  39184. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  39185. raise ELM327Error(self.ERRORS[line], code=line)
  39186. ELM327Error: Operation interrupted by a received RS232 character
  39187. 2020-08-04 13:10:49,599 [salt.utils.parsers:1050][WARNING ][423] Minion received a SIGTERM. Exiting.
  39188. 2020-08-04 13:10:50,139 [messaging :871 ][WARNING ][824] No reply message with tag 'obd/res/e20c9969-f8ca-4a6e-a408-257a1d8df158' received within timeout of 30 secs
  39189. 2020-08-04 13:10:50,142 [salt.state :292 ][ERROR ][824] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  39190. 2020-08-04 13:11:07,285 [gpio_spi_conn :42 ][WARNING ][623] Unable to clear buffer - got unexpected value: 255
  39191. 2020-08-04 13:11:07,292 [gpio_spi_conn :42 ][WARNING ][623] Unable to clear buffer - got unexpected value: 255
  39192. 2020-08-04 13:11:07,298 [gpio_spi_conn :42 ][WARNING ][623] Unable to clear buffer - got unexpected value: 255
  39193. 2020-08-04 13:11:07,982 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  39194. Traceback (most recent call last):
  39195. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39196. self._serial.open()
  39197. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39198. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39199. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39200. 2020-08-04 13:11:08,996 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  39201. Traceback (most recent call last):
  39202. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39203. self._serial.open()
  39204. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39205. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39206. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39207. 2020-08-04 13:11:09,330 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  39208. 2020-08-04 13:11:09,833 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  39209. 2020-08-04 13:11:10,001 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  39210. Traceback (most recent call last):
  39211. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39212. self._serial.open()
  39213. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39214. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39215. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39216. 2020-08-04 13:11:10,336 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  39217. 2020-08-04 13:11:10,338 [spm_conn :139 ][WARNING ][623] Unable to get status: Expected ack '12' but got '255'
  39218. 2020-08-04 13:11:10,661 [messaging :208 ][ERROR ][620] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  39219. Traceback (most recent call last):
  39220. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  39221. self._call_hook_for(message, "workflow", message)
  39222. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39223. return True, func(*args, **kwargs)
  39224. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  39225. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39226. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39227. return True, func(*args, **kwargs)
  39228. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39229. return func(*args, **kwargs)
  39230. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  39231. res = _exec("AT+CCLK?")
  39232. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  39233. conn.write_line(cmd)
  39234. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  39235. self.ensure_open()
  39236. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  39237. self.open()
  39238. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  39239. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  39240. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  39241. raise attempt.get()
  39242. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  39243. six.reraise(self.value[0], self.value[1], self.value[2])
  39244. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  39245. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  39246. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39247. self._serial.open()
  39248. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39249. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39250. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39251. 2020-08-04 13:11:10,843 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  39252. 2020-08-04 13:11:25,502 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][660] Timeout after 1.28205128205 second(s) waiting for interrupt
  39253. 2020-08-04 13:11:25,550 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  39254. Traceback (most recent call last):
  39255. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39256. self._serial.open()
  39257. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39258. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39259. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39260. 2020-08-04 13:11:25,800 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  39261. 2020-08-04 13:11:26,302 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  39262. 2020-08-04 13:11:26,305 [spm_conn :139 ][WARNING ][623] Unable to get status: Expected ack '12' but got '255'
  39263. 2020-08-04 13:11:26,555 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  39264. Traceback (most recent call last):
  39265. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39266. self._serial.open()
  39267. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39268. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39269. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39270. 2020-08-04 13:11:26,808 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  39271. 2020-08-04 13:11:27,312 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  39272. 2020-08-04 13:11:27,559 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  39273. Traceback (most recent call last):
  39274. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39275. self._serial.open()
  39276. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39277. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39278. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39279. 2020-08-04 13:11:27,565 [messaging :206 ][ERROR ][620] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  39280. Traceback (most recent call last):
  39281. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  39282. self._call_hook_for(message, "workflow", message)
  39283. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39284. return True, func(*args, **kwargs)
  39285. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  39286. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39287. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39288. return True, func(*args, **kwargs)
  39289. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39290. return func(*args, **kwargs)
  39291. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  39292. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  39293. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  39294. conn.write_line(cmd)
  39295. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  39296. self.ensure_open()
  39297. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  39298. self.open()
  39299. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  39300. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  39301. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  39302. raise attempt.get()
  39303. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  39304. six.reraise(self.value[0], self.value[1], self.value[2])
  39305. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  39306. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  39307. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39308. self._serial.open()
  39309. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39310. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39311. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39312. 2020-08-04 13:11:27,818 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  39313. 2020-08-04 13:11:27,822 [spm_conn :139 ][WARNING ][623] Unable to get status: Expected ack '12' but got '255'
  39314. 2020-08-04 13:11:27,828 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  39315. 2020-08-04 13:11:28,332 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  39316. 2020-08-04 13:11:28,835 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  39317. 2020-08-04 13:11:28,838 [spm_conn :82 ][WARNING ][623] Unable to send noop: Expected ack '12' but got '255'
  39318. 2020-08-04 13:11:29,342 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  39319. 2020-08-04 13:11:29,473 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  39320. Traceback (most recent call last):
  39321. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39322. self._serial.open()
  39323. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39324. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39325. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39326. 2020-08-04 13:11:29,845 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  39327. 2020-08-04 13:11:30,349 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  39328. 2020-08-04 13:11:30,351 [spm_conn :82 ][WARNING ][623] Unable to send noop: Expected ack '12' but got '255'
  39329. 2020-08-04 13:11:30,477 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  39330. Traceback (most recent call last):
  39331. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39332. self._serial.open()
  39333. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39334. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39335. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39336. 2020-08-04 13:11:30,855 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  39337. 2020-08-04 13:11:31,359 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  39338. 2020-08-04 13:11:31,481 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  39339. Traceback (most recent call last):
  39340. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39341. self._serial.open()
  39342. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39343. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39344. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39345. 2020-08-04 13:11:31,484 [messaging :742 ][ERROR ][620] Exception while processing event: {'tag': 'ec2x/req/01cfe57c-4c8c-4394-993b-cfc6e7f4025f', 'data': {'_stamp': '2020-08-04T13:11:07.327828', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/01cfe57c-4c8c-4394-993b-cfc6e7f4025f', 'kwargs': {'cooldown_delay': None}}}
  39346. Traceback (most recent call last):
  39347. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  39348. res = self.process(message)
  39349. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  39350. result = func(message, **settings)
  39351. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  39352. found, result = self._call_hook_for(message, "workflow", message)
  39353. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39354. return True, func(*args, **kwargs)
  39355. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  39356. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39357. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39358. return True, func(*args, **kwargs)
  39359. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39360. return func(*args, **kwargs)
  39361. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  39362. return _exec(cmd, **kwargs)
  39363. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  39364. conn.write_line(cmd)
  39365. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  39366. self.ensure_open()
  39367. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  39368. self.open()
  39369. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  39370. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  39371. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  39372. raise attempt.get()
  39373. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  39374. six.reraise(self.value[0], self.value[1], self.value[2])
  39375. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  39376. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  39377. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39378. self._serial.open()
  39379. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39380. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39381. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39382. 2020-08-04 13:11:31,529 [messaging :208 ][ERROR ][621] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  39383. Traceback (most recent call last):
  39384. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  39385. self._call_hook_for(message, "workflow", message)
  39386. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39387. return True, func(*args, **kwargs)
  39388. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  39389. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39390. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39391. return True, func(*args, **kwargs)
  39392. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39393. return func(*args, **kwargs)
  39394. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  39395. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  39396. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  39397. res = query("AT+QGPSLOC={:d}".format(mode))
  39398. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  39399. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  39400. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  39401. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  39402. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  39403. raise salt.exceptions.CommandExecutionError(message["error"])
  39404. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39405. 2020-08-04 13:11:31,871 [gpio_spi_conn :109 ][WARNING ][623] Expected ack '12' but got '255'
  39406. 2020-08-04 13:11:31,875 [spm_conn :82 ][WARNING ][623] Unable to send noop: Expected ack '12' but got '255'
  39407. 2020-08-04 13:11:31,880 [messaging :208 ][ERROR ][623] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  39408. Traceback (most recent call last):
  39409. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  39410. self._call_hook_for(message, "workflow", message)
  39411. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39412. return True, func(*args, **kwargs)
  39413. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  39414. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39415. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39416. return True, func(*args, **kwargs)
  39417. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39418. return func(*args, **kwargs)
  39419. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  39420. conn.heartbeat()
  39421. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  39422. self.noop()
  39423. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  39424. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  39425. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  39426. raise attempt.get()
  39427. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  39428. six.reraise(self.value[0], self.value[1], self.value[2])
  39429. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  39430. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  39431. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  39432. self._begin_message()
  39433. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  39434. self.recv(ack=ACK_MESSAGE_BEGIN)
  39435. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  39436. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  39437. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  39438. raise attempt.get()
  39439. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  39440. six.reraise(self.value[0], self.value[1], self.value[2])
  39441. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  39442. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  39443. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  39444. raise Exception(msg)
  39445. Exception: Expected ack '12' but got '255'
  39446. 2020-08-04 13:11:36,585 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  39447. Traceback (most recent call last):
  39448. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39449. self._serial.open()
  39450. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39451. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39452. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39453. 2020-08-04 13:11:37,593 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  39454. Traceback (most recent call last):
  39455. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39456. self._serial.open()
  39457. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39458. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39459. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39460. 2020-08-04 13:11:38,597 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  39461. Traceback (most recent call last):
  39462. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39463. self._serial.open()
  39464. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39465. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39466. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39467. 2020-08-04 13:11:38,600 [messaging :742 ][ERROR ][620] Exception while processing event: {'tag': 'ec2x/req/23ae19af-60b2-4e72-9501-d9421b27613c', 'data': {'_stamp': '2020-08-04T13:11:36.577695', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/23ae19af-60b2-4e72-9501-d9421b27613c', 'kwargs': {'cooldown_delay': None}}}
  39468. Traceback (most recent call last):
  39469. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  39470. res = self.process(message)
  39471. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  39472. result = func(message, **settings)
  39473. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  39474. found, result = self._call_hook_for(message, "workflow", message)
  39475. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39476. return True, func(*args, **kwargs)
  39477. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  39478. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39479. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39480. return True, func(*args, **kwargs)
  39481. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39482. return func(*args, **kwargs)
  39483. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  39484. return _exec(cmd, **kwargs)
  39485. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  39486. conn.write_line(cmd)
  39487. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  39488. self.ensure_open()
  39489. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  39490. self.open()
  39491. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  39492. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  39493. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  39494. raise attempt.get()
  39495. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  39496. six.reraise(self.value[0], self.value[1], self.value[2])
  39497. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  39498. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  39499. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39500. self._serial.open()
  39501. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39502. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39503. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39504. 2020-08-04 13:11:38,619 [messaging :206 ][ERROR ][621] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  39505. Traceback (most recent call last):
  39506. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  39507. self._call_hook_for(message, "workflow", message)
  39508. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39509. return True, func(*args, **kwargs)
  39510. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  39511. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39512. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39513. return True, func(*args, **kwargs)
  39514. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39515. return func(*args, **kwargs)
  39516. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  39517. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  39518. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  39519. res = query("AT+QGPSLOC={:d}".format(mode))
  39520. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  39521. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  39522. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  39523. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  39524. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  39525. raise salt.exceptions.CommandExecutionError(message["error"])
  39526. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39527. 2020-08-04 13:11:43,653 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  39528. Traceback (most recent call last):
  39529. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39530. self._serial.open()
  39531. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39532. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39533. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39534. 2020-08-04 13:11:44,670 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  39535. Traceback (most recent call last):
  39536. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39537. self._serial.open()
  39538. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39539. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39540. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39541. 2020-08-04 13:11:45,675 [serial_conn :79 ][ERROR ][620] Failed to open serial connection
  39542. Traceback (most recent call last):
  39543. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39544. self._serial.open()
  39545. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39546. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39547. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39548. 2020-08-04 13:11:45,678 [messaging :742 ][ERROR ][620] Exception while processing event: {'tag': 'ec2x/req/c5701512-53b0-40c3-92f4-f653bfb9b7fd', 'data': {'_stamp': '2020-08-04T13:11:43.645949', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/c5701512-53b0-40c3-92f4-f653bfb9b7fd', 'kwargs': {'cooldown_delay': None}}}
  39549. Traceback (most recent call last):
  39550. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  39551. res = self.process(message)
  39552. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  39553. result = func(message, **settings)
  39554. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  39555. found, result = self._call_hook_for(message, "workflow", message)
  39556. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39557. return True, func(*args, **kwargs)
  39558. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  39559. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39560. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39561. return True, func(*args, **kwargs)
  39562. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39563. return func(*args, **kwargs)
  39564. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  39565. return _exec(cmd, **kwargs)
  39566. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  39567. conn.write_line(cmd)
  39568. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  39569. self.ensure_open()
  39570. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  39571. self.open()
  39572. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  39573. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  39574. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  39575. raise attempt.get()
  39576. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  39577. six.reraise(self.value[0], self.value[1], self.value[2])
  39578. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  39579. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  39580. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39581. self._serial.open()
  39582. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39583. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39584. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39585. 2020-08-04 13:11:45,709 [messaging :206 ][ERROR ][621] Recurring exception (3 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  39586. Traceback (most recent call last):
  39587. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  39588. self._call_hook_for(message, "workflow", message)
  39589. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39590. return True, func(*args, **kwargs)
  39591. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  39592. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39593. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39594. return True, func(*args, **kwargs)
  39595. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39596. return func(*args, **kwargs)
  39597. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  39598. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  39599. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  39600. res = query("AT+QGPSLOC={:d}".format(mode))
  39601. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  39602. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  39603. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  39604. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  39605. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  39606. raise salt.exceptions.CommandExecutionError(message["error"])
  39607. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39608. 2020-08-04 13:11:46,974 [obd.obd :107 ][ERROR ][659] Failed to use explicit port '/dev/serial0'
  39609. Traceback (most recent call last):
  39610. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  39611. self.interface.open(baudrate, protocol=protocol)
  39612. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  39613. self.set_protocol(prot.pop("id", None), **prot)
  39614. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  39615. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  39616. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  39617. self._protocol = self._auto_protocol(**kwargs)
  39618. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  39619. res_0100 = self._verify_protocol("auto", test=not verify)
  39620. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  39621. for line in self.query("0100", parse=False, read_timeout=10):
  39622. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  39623. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  39624. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  39625. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  39626. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  39627. data = self._port.read(self._port.in_waiting or 1)
  39628. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  39629. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  39630. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  39631. sys.exit(salt.defaults.exitcodes.EX_OK)
  39632. SystemExit: 0
  39633. 2020-08-04 13:11:46,999 [obd.obd :120 ][WARNING ][659] Cannot load commands - no connection to bus
  39634. 2020-08-04 13:11:47,028 [obd.interfaces.elm327:730 ][ERROR ][659] Failed to relay command 'STSLCS' to interface
  39635. Traceback (most recent call last):
  39636. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  39637. lines = self.send(cmd, raw_response=raw_response)
  39638. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  39639. raise ELM327Error(self.ERRORS[line], code=line)
  39640. ELM327Error: Operation interrupted by a received RS232 character
  39641. 2020-08-04 13:11:47,032 [messaging :742 ][ERROR ][659] Exception while processing event: {'tag': 'obd/req/091e0f98-996e-4946-8075-6500951edb60', 'data': {'_stamp': '2020-08-04T13:11:41.438333', 'handler': 'execute', '_event_tag': 'obd/req/091e0f98-996e-4946-8075-6500951edb60', 'args': ['STSLCS']}}
  39642. Traceback (most recent call last):
  39643. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  39644. res = self.process(message)
  39645. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  39646. result = func(message, **settings)
  39647. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  39648. found, result = self._call_hook_for(message, "workflow", message)
  39649. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39650. return True, func(*args, **kwargs)
  39651. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  39652. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39653. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39654. return True, func(*args, **kwargs)
  39655. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39656. return func(*args, **kwargs)
  39657. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  39658. res = conn.execute(cmd)
  39659. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  39660. return func(self, *args, **kwargs)
  39661. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  39662. return self._obd.execute(cmd, **kwargs)
  39663. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  39664. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  39665. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  39666. lines = self.send(cmd, raw_response=raw_response)
  39667. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  39668. raise ELM327Error(self.ERRORS[line], code=line)
  39669. ELM327Error: Operation interrupted by a received RS232 character
  39670. 2020-08-04 13:11:47,731 [salt.utils.parsers:1050][WARNING ][420] Minion received a SIGTERM. Exiting.
  39671. 2020-08-04 13:11:48,271 [messaging :871 ][WARNING ][837] No reply message with tag 'obd/res/091e0f98-996e-4946-8075-6500951edb60' received within timeout of 30 secs
  39672. 2020-08-04 13:11:48,274 [salt.state :292 ][ERROR ][837] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  39673. 2020-08-04 13:12:05,168 [gpio_spi_conn :42 ][WARNING ][625] Unable to clear buffer - got unexpected value: 255
  39674. 2020-08-04 13:12:05,177 [gpio_spi_conn :42 ][WARNING ][625] Unable to clear buffer - got unexpected value: 255
  39675. 2020-08-04 13:12:05,183 [gpio_spi_conn :42 ][WARNING ][625] Unable to clear buffer - got unexpected value: 255
  39676. 2020-08-04 13:12:05,898 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  39677. Traceback (most recent call last):
  39678. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39679. self._serial.open()
  39680. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39681. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39682. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39683. 2020-08-04 13:12:06,913 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  39684. Traceback (most recent call last):
  39685. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39686. self._serial.open()
  39687. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39688. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39689. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39690. 2020-08-04 13:12:07,206 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39691. 2020-08-04 13:12:07,708 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39692. 2020-08-04 13:12:07,918 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  39693. Traceback (most recent call last):
  39694. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39695. self._serial.open()
  39696. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39697. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39698. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39699. 2020-08-04 13:12:08,211 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39700. 2020-08-04 13:12:08,213 [spm_conn :139 ][WARNING ][625] Unable to get status: Expected ack '12' but got '255'
  39701. 2020-08-04 13:12:08,525 [messaging :208 ][ERROR ][622] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  39702. Traceback (most recent call last):
  39703. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  39704. self._call_hook_for(message, "workflow", message)
  39705. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39706. return True, func(*args, **kwargs)
  39707. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  39708. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39709. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39710. return True, func(*args, **kwargs)
  39711. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39712. return func(*args, **kwargs)
  39713. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  39714. res = _exec("AT+CCLK?")
  39715. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  39716. conn.write_line(cmd)
  39717. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  39718. self.ensure_open()
  39719. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  39720. self.open()
  39721. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  39722. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  39723. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  39724. raise attempt.get()
  39725. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  39726. six.reraise(self.value[0], self.value[1], self.value[2])
  39727. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  39728. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  39729. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39730. self._serial.open()
  39731. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39732. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39733. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39734. 2020-08-04 13:12:08,720 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39735. 2020-08-04 13:12:09,225 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39736. 2020-08-04 13:12:09,730 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39737. 2020-08-04 13:12:09,735 [spm_conn :139 ][WARNING ][625] Unable to get status: Expected ack '12' but got '255'
  39738. 2020-08-04 13:12:10,241 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39739. 2020-08-04 13:12:10,745 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39740. 2020-08-04 13:12:11,251 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39741. 2020-08-04 13:12:11,254 [spm_conn :139 ][WARNING ][625] Unable to get status: Expected ack '12' but got '255'
  39742. 2020-08-04 13:12:11,258 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39743. 2020-08-04 13:12:11,761 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39744. 2020-08-04 13:12:12,264 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39745. 2020-08-04 13:12:12,266 [spm_conn :82 ][WARNING ][625] Unable to send noop: Expected ack '12' but got '255'
  39746. 2020-08-04 13:12:12,378 [salt.utils :831 ][ERROR ][423] DNS lookup or connection check of 'hub' failed.
  39747. 2020-08-04 13:12:12,730 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  39748. Traceback (most recent call last):
  39749. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39750. self._serial.open()
  39751. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39752. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39753. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39754. 2020-08-04 13:12:12,770 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39755. 2020-08-04 13:12:13,273 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39756. 2020-08-04 13:12:13,750 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  39757. Traceback (most recent call last):
  39758. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39759. self._serial.open()
  39760. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39761. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39762. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39763. 2020-08-04 13:12:13,777 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39764. 2020-08-04 13:12:13,779 [spm_conn :82 ][WARNING ][625] Unable to send noop: Expected ack '12' but got '255'
  39765. 2020-08-04 13:12:13,866 [cloud_cache :432 ][WARNING ][663] Temporarily unable to upload batch with 10 entries from queue 'pend': HTTPSConnectionPool(host='api.autopi.io', port=443): Max retries exceeded with url: /logbook/storage (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x735659b0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))
  39766. 2020-08-04 13:12:14,284 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39767. 2020-08-04 13:12:14,754 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  39768. Traceback (most recent call last):
  39769. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39770. self._serial.open()
  39771. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39772. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39773. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39774. 2020-08-04 13:12:14,757 [messaging :742 ][ERROR ][622] Exception while processing event: {'tag': 'ec2x/req/58a4f606-efd6-4da0-8bc0-1723ee0bb8bb', 'data': {'_stamp': '2020-08-04T13:12:05.240299', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/58a4f606-efd6-4da0-8bc0-1723ee0bb8bb', 'kwargs': {'cooldown_delay': None}}}
  39775. Traceback (most recent call last):
  39776. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  39777. res = self.process(message)
  39778. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  39779. result = func(message, **settings)
  39780. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  39781. found, result = self._call_hook_for(message, "workflow", message)
  39782. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39783. return True, func(*args, **kwargs)
  39784. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  39785. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39786. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39787. return True, func(*args, **kwargs)
  39788. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39789. return func(*args, **kwargs)
  39790. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  39791. return _exec(cmd, **kwargs)
  39792. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  39793. conn.write_line(cmd)
  39794. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  39795. self.ensure_open()
  39796. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  39797. self.open()
  39798. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  39799. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  39800. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  39801. raise attempt.get()
  39802. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  39803. six.reraise(self.value[0], self.value[1], self.value[2])
  39804. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  39805. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  39806. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39807. self._serial.open()
  39808. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39809. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39810. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39811. 2020-08-04 13:12:14,788 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39812. 2020-08-04 13:12:14,808 [messaging :208 ][ERROR ][623] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  39813. Traceback (most recent call last):
  39814. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  39815. self._call_hook_for(message, "workflow", message)
  39816. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39817. return True, func(*args, **kwargs)
  39818. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  39819. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39820. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39821. return True, func(*args, **kwargs)
  39822. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39823. return func(*args, **kwargs)
  39824. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  39825. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  39826. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  39827. res = query("AT+QGPSLOC={:d}".format(mode))
  39828. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  39829. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  39830. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  39831. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  39832. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  39833. raise salt.exceptions.CommandExecutionError(message["error"])
  39834. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39835. 2020-08-04 13:12:15,291 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39836. 2020-08-04 13:12:15,296 [spm_conn :82 ][WARNING ][625] Unable to send noop: Expected ack '12' but got '255'
  39837. 2020-08-04 13:12:15,298 [messaging :208 ][ERROR ][625] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  39838. Traceback (most recent call last):
  39839. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  39840. self._call_hook_for(message, "workflow", message)
  39841. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39842. return True, func(*args, **kwargs)
  39843. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  39844. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39845. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39846. return True, func(*args, **kwargs)
  39847. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39848. return func(*args, **kwargs)
  39849. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  39850. conn.heartbeat()
  39851. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  39852. self.noop()
  39853. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  39854. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  39855. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  39856. raise attempt.get()
  39857. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  39858. six.reraise(self.value[0], self.value[1], self.value[2])
  39859. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  39860. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  39861. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  39862. self._begin_message()
  39863. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  39864. self.recv(ack=ACK_MESSAGE_BEGIN)
  39865. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  39866. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  39867. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  39868. raise attempt.get()
  39869. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  39870. six.reraise(self.value[0], self.value[1], self.value[2])
  39871. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  39872. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  39873. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  39874. raise Exception(msg)
  39875. Exception: Expected ack '12' but got '255'
  39876. 2020-08-04 13:12:15,368 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  39877. Traceback (most recent call last):
  39878. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39879. self._serial.open()
  39880. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39881. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39882. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39883. 2020-08-04 13:12:16,373 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  39884. Traceback (most recent call last):
  39885. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39886. self._serial.open()
  39887. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39888. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39889. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39890. 2020-08-04 13:12:17,377 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  39891. Traceback (most recent call last):
  39892. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39893. self._serial.open()
  39894. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39895. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39896. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39897. 2020-08-04 13:12:17,874 [messaging :206 ][ERROR ][622] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  39898. Traceback (most recent call last):
  39899. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  39900. self._call_hook_for(message, "workflow", message)
  39901. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39902. return True, func(*args, **kwargs)
  39903. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  39904. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39905. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39906. return True, func(*args, **kwargs)
  39907. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39908. return func(*args, **kwargs)
  39909. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  39910. res = _exec("AT+CCLK?")
  39911. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  39912. conn.write_line(cmd)
  39913. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  39914. self.ensure_open()
  39915. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  39916. self.open()
  39917. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  39918. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  39919. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  39920. raise attempt.get()
  39921. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  39922. six.reraise(self.value[0], self.value[1], self.value[2])
  39923. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  39924. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  39925. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39926. self._serial.open()
  39927. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39928. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39929. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39930. 2020-08-04 13:12:19,862 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  39931. Traceback (most recent call last):
  39932. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39933. self._serial.open()
  39934. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39935. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39936. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39937. 2020-08-04 13:12:20,499 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39938. 2020-08-04 13:12:20,865 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  39939. Traceback (most recent call last):
  39940. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39941. self._serial.open()
  39942. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39943. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39944. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39945. 2020-08-04 13:12:21,004 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39946. 2020-08-04 13:12:21,507 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  39947. 2020-08-04 13:12:21,510 [spm_conn :139 ][WARNING ][625] Unable to get status: Expected ack '12' but got '255'
  39948. 2020-08-04 13:12:21,869 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  39949. Traceback (most recent call last):
  39950. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39951. self._serial.open()
  39952. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39953. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39954. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39955. 2020-08-04 13:12:21,872 [messaging :742 ][ERROR ][622] Exception while processing event: {'tag': 'ec2x/req/59f17dcd-938a-4fb3-8def-27eb4afeae12', 'data': {'_stamp': '2020-08-04T13:12:19.841519', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/59f17dcd-938a-4fb3-8def-27eb4afeae12', 'kwargs': {'cooldown_delay': None}}}
  39956. Traceback (most recent call last):
  39957. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  39958. res = self.process(message)
  39959. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  39960. result = func(message, **settings)
  39961. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  39962. found, result = self._call_hook_for(message, "workflow", message)
  39963. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39964. return True, func(*args, **kwargs)
  39965. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  39966. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  39967. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39968. return True, func(*args, **kwargs)
  39969. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  39970. return func(*args, **kwargs)
  39971. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  39972. return _exec(cmd, **kwargs)
  39973. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  39974. conn.write_line(cmd)
  39975. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  39976. self.ensure_open()
  39977. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  39978. self.open()
  39979. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  39980. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  39981. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  39982. raise attempt.get()
  39983. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  39984. six.reraise(self.value[0], self.value[1], self.value[2])
  39985. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  39986. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  39987. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  39988. self._serial.open()
  39989. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  39990. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  39991. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  39992. 2020-08-04 13:12:21,901 [messaging :206 ][ERROR ][623] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  39993. Traceback (most recent call last):
  39994. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  39995. self._call_hook_for(message, "workflow", message)
  39996. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  39997. return True, func(*args, **kwargs)
  39998. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  39999. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40000. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40001. return True, func(*args, **kwargs)
  40002. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40003. return func(*args, **kwargs)
  40004. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  40005. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  40006. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  40007. res = query("AT+QGPSLOC={:d}".format(mode))
  40008. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  40009. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  40010. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  40011. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  40012. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  40013. raise salt.exceptions.CommandExecutionError(message["error"])
  40014. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40015. 2020-08-04 13:12:22,013 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40016. 2020-08-04 13:12:22,516 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40017. 2020-08-04 13:12:23,019 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40018. 2020-08-04 13:12:23,022 [spm_conn :139 ][WARNING ][625] Unable to get status: Expected ack '12' but got '255'
  40019. 2020-08-04 13:12:23,453 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40020. Traceback (most recent call last):
  40021. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40022. self._serial.open()
  40023. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40024. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40025. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40026. 2020-08-04 13:12:23,525 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40027. 2020-08-04 13:12:24,029 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40028. 2020-08-04 13:12:24,457 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40029. Traceback (most recent call last):
  40030. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40031. self._serial.open()
  40032. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40033. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40034. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40035. 2020-08-04 13:12:24,532 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40036. 2020-08-04 13:12:24,535 [spm_conn :139 ][WARNING ][625] Unable to get status: Expected ack '12' but got '255'
  40037. 2020-08-04 13:12:24,537 [messaging :742 ][ERROR ][625] Exception while processing event: {'tag': 'spm/req/0bac8189-0135-4acb-803f-409ef2248b14', 'data': {'_stamp': '2020-08-04T13:12:20.489678', 'args': ['status'], '_event_tag': 'spm/req/0bac8189-0135-4acb-803f-409ef2248b14'}}
  40038. Traceback (most recent call last):
  40039. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  40040. res = self.process(message)
  40041. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  40042. result = func(message, **settings)
  40043. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  40044. found, result = self._call_hook_for(message, "workflow", message)
  40045. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40046. return True, func(*args, **kwargs)
  40047. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  40048. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40049. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40050. return True, func(*args, **kwargs)
  40051. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40052. return func(*args, **kwargs)
  40053. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 46, in query_handler
  40054. res = func(**kwargs)
  40055. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  40056. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  40057. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  40058. raise attempt.get()
  40059. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  40060. six.reraise(self.value[0], self.value[1], self.value[2])
  40061. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  40062. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  40063. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 111, in status
  40064. self._begin_message()
  40065. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  40066. self.recv(ack=ACK_MESSAGE_BEGIN)
  40067. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  40068. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  40069. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  40070. raise attempt.get()
  40071. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  40072. six.reraise(self.value[0], self.value[1], self.value[2])
  40073. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  40074. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  40075. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  40076. raise Exception(msg)
  40077. Exception: Expected ack '12' but got '255'
  40078. 2020-08-04 13:12:24,581 [salt.loaded.ext.engines.api_service:27 ][ERROR ][678] exception occurred: Expected ack '12' but got '255'
  40079. 2020-08-04 13:12:25,461 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40080. Traceback (most recent call last):
  40081. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40082. self._serial.open()
  40083. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40084. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40085. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40086. 2020-08-04 13:12:25,951 [messaging :206 ][ERROR ][622] Recurring exception (3 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  40087. Traceback (most recent call last):
  40088. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  40089. self._call_hook_for(message, "workflow", message)
  40090. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40091. return True, func(*args, **kwargs)
  40092. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  40093. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40094. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40095. return True, func(*args, **kwargs)
  40096. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40097. return func(*args, **kwargs)
  40098. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  40099. res = _exec("AT+CCLK?")
  40100. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  40101. conn.write_line(cmd)
  40102. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  40103. self.ensure_open()
  40104. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  40105. self.open()
  40106. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  40107. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  40108. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  40109. raise attempt.get()
  40110. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  40111. six.reraise(self.value[0], self.value[1], self.value[2])
  40112. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  40113. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  40114. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40115. self._serial.open()
  40116. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40117. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40118. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40119. 2020-08-04 13:12:26,937 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40120. Traceback (most recent call last):
  40121. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40122. self._serial.open()
  40123. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40124. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40125. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40126. 2020-08-04 13:12:27,941 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40127. Traceback (most recent call last):
  40128. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40129. self._serial.open()
  40130. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40131. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40132. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40133. 2020-08-04 13:12:28,945 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40134. Traceback (most recent call last):
  40135. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40136. self._serial.open()
  40137. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40138. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40139. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40140. 2020-08-04 13:12:28,948 [messaging :742 ][ERROR ][622] Exception while processing event: {'tag': 'ec2x/req/c04a44f4-9673-479b-9fef-7d9bb77fbf96', 'data': {'_stamp': '2020-08-04T13:12:26.914988', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/c04a44f4-9673-479b-9fef-7d9bb77fbf96', 'kwargs': {'cooldown_delay': None}}}
  40141. Traceback (most recent call last):
  40142. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  40143. res = self.process(message)
  40144. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  40145. result = func(message, **settings)
  40146. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  40147. found, result = self._call_hook_for(message, "workflow", message)
  40148. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40149. return True, func(*args, **kwargs)
  40150. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  40151. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40152. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40153. return True, func(*args, **kwargs)
  40154. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40155. return func(*args, **kwargs)
  40156. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  40157. return _exec(cmd, **kwargs)
  40158. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  40159. conn.write_line(cmd)
  40160. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  40161. self.ensure_open()
  40162. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  40163. self.open()
  40164. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  40165. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  40166. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  40167. raise attempt.get()
  40168. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  40169. six.reraise(self.value[0], self.value[1], self.value[2])
  40170. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  40171. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  40172. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40173. self._serial.open()
  40174. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40175. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40176. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40177. 2020-08-04 13:12:28,971 [messaging :206 ][ERROR ][623] Recurring exception (3 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  40178. Traceback (most recent call last):
  40179. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  40180. self._call_hook_for(message, "workflow", message)
  40181. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40182. return True, func(*args, **kwargs)
  40183. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  40184. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40185. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40186. return True, func(*args, **kwargs)
  40187. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40188. return func(*args, **kwargs)
  40189. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  40190. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  40191. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  40192. res = query("AT+QGPSLOC={:d}".format(mode))
  40193. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  40194. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  40195. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  40196. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  40197. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  40198. raise salt.exceptions.CommandExecutionError(message["error"])
  40199. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40200. 2020-08-04 13:12:31,574 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40201. Traceback (most recent call last):
  40202. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40203. self._serial.open()
  40204. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40205. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40206. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40207. 2020-08-04 13:12:32,578 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40208. Traceback (most recent call last):
  40209. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40210. self._serial.open()
  40211. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40212. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40213. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40214. 2020-08-04 13:12:33,592 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40215. Traceback (most recent call last):
  40216. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40217. self._serial.open()
  40218. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40219. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40220. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40221. 2020-08-04 13:12:34,148 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40222. Traceback (most recent call last):
  40223. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40224. self._serial.open()
  40225. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40226. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40227. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40228. 2020-08-04 13:12:49,130 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][662] Timeout after 1.28205128205 second(s) waiting for interrupt
  40229. 2020-08-04 13:12:49,771 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40230. Traceback (most recent call last):
  40231. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40232. self._serial.open()
  40233. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40234. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40235. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40236. 2020-08-04 13:12:50,775 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40237. Traceback (most recent call last):
  40238. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40239. self._serial.open()
  40240. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40241. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40242. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40243. 2020-08-04 13:12:50,778 [messaging :742 ][ERROR ][622] Exception while processing event: {'tag': 'ec2x/req/9b2f3f5b-e30e-450d-be25-68b7d6dfe987', 'data': {'_stamp': '2020-08-04T13:12:33.987229', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/9b2f3f5b-e30e-450d-be25-68b7d6dfe987', 'kwargs': {'cooldown_delay': None}}}
  40244. Traceback (most recent call last):
  40245. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  40246. res = self.process(message)
  40247. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  40248. result = func(message, **settings)
  40249. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  40250. found, result = self._call_hook_for(message, "workflow", message)
  40251. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40252. return True, func(*args, **kwargs)
  40253. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  40254. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40255. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40256. return True, func(*args, **kwargs)
  40257. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40258. return func(*args, **kwargs)
  40259. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  40260. return _exec(cmd, **kwargs)
  40261. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  40262. conn.write_line(cmd)
  40263. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  40264. self.ensure_open()
  40265. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  40266. self.open()
  40267. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  40268. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  40269. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  40270. raise attempt.get()
  40271. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  40272. six.reraise(self.value[0], self.value[1], self.value[2])
  40273. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  40274. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  40275. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40276. self._serial.open()
  40277. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40278. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40279. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40280. 2020-08-04 13:12:51,473 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40281. Traceback (most recent call last):
  40282. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40283. self._serial.open()
  40284. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40285. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40286. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40287. 2020-08-04 13:12:52,478 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40288. Traceback (most recent call last):
  40289. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40290. self._serial.open()
  40291. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40292. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40293. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40294. 2020-08-04 13:12:53,482 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40295. Traceback (most recent call last):
  40296. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40297. self._serial.open()
  40298. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40299. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40300. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40301. 2020-08-04 13:12:55,837 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40302. Traceback (most recent call last):
  40303. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40304. self._serial.open()
  40305. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40306. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40307. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40308. 2020-08-04 13:12:56,087 [salt.loaded.int.module.cmdmod:693 ][ERROR ][678] Command '['ping', 'google.com', '-I', 'wwan0', '-c', '1', '-q']' failed with return code: 2
  40309. 2020-08-04 13:12:56,090 [salt.loaded.int.module.cmdmod:697 ][ERROR ][678] stderr: ping: SO_BINDTODEVICE: Invalid argument
  40310. 2020-08-04 13:12:56,092 [salt.loaded.int.module.cmdmod:699 ][ERROR ][678] retcode: 2
  40311. 2020-08-04 13:12:56,842 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40312. Traceback (most recent call last):
  40313. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40314. self._serial.open()
  40315. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40316. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40317. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40318. 2020-08-04 13:12:57,862 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40319. Traceback (most recent call last):
  40320. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40321. self._serial.open()
  40322. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40323. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40324. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40325. 2020-08-04 13:12:57,865 [messaging :742 ][ERROR ][622] Exception while processing event: {'tag': 'ec2x/req/fb72c163-4183-4fdc-ac4d-efab0e6efe9a', 'data': {'_stamp': '2020-08-04T13:12:55.820097', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/fb72c163-4183-4fdc-ac4d-efab0e6efe9a', 'kwargs': {'cooldown_delay': None}}}
  40326. Traceback (most recent call last):
  40327. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  40328. res = self.process(message)
  40329. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  40330. result = func(message, **settings)
  40331. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  40332. found, result = self._call_hook_for(message, "workflow", message)
  40333. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40334. return True, func(*args, **kwargs)
  40335. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  40336. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40337. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40338. return True, func(*args, **kwargs)
  40339. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40340. return func(*args, **kwargs)
  40341. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  40342. return _exec(cmd, **kwargs)
  40343. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  40344. conn.write_line(cmd)
  40345. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  40346. self.ensure_open()
  40347. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  40348. self.open()
  40349. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  40350. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  40351. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  40352. raise attempt.get()
  40353. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  40354. six.reraise(self.value[0], self.value[1], self.value[2])
  40355. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  40356. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  40357. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40358. self._serial.open()
  40359. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40360. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40361. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40362. 2020-08-04 13:12:58,728 [obd.obd :107 ][ERROR ][661] Failed to use explicit port '/dev/serial0'
  40363. Traceback (most recent call last):
  40364. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  40365. self.interface.open(baudrate, protocol=protocol)
  40366. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  40367. self.set_protocol(prot.pop("id", None), **prot)
  40368. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  40369. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  40370. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  40371. self._protocol = self._auto_protocol(**kwargs)
  40372. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  40373. res_0100 = self._verify_protocol("auto", test=not verify)
  40374. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  40375. for line in self.query("0100", parse=False, read_timeout=10):
  40376. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  40377. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  40378. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  40379. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  40380. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  40381. data = self._port.read(self._port.in_waiting or 1)
  40382. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  40383. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  40384. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  40385. sys.exit(salt.defaults.exitcodes.EX_OK)
  40386. SystemExit: 0
  40387. 2020-08-04 13:12:58,777 [obd.obd :120 ][WARNING ][661] Cannot load commands - no connection to bus
  40388. 2020-08-04 13:12:58,805 [obd.interfaces.elm327:730 ][ERROR ][661] Failed to relay command 'STSLCS' to interface
  40389. Traceback (most recent call last):
  40390. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  40391. lines = self.send(cmd, raw_response=raw_response)
  40392. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  40393. raise ELM327Error(self.ERRORS[line], code=line)
  40394. ELM327Error: Operation interrupted by a received RS232 character
  40395. 2020-08-04 13:12:58,808 [messaging :742 ][ERROR ][661] Exception while processing event: {'tag': 'obd/req/19354673-233e-4c8c-96f5-b6a4ce8bd817', 'data': {'_stamp': '2020-08-04T13:12:53.163594', 'handler': 'execute', '_event_tag': 'obd/req/19354673-233e-4c8c-96f5-b6a4ce8bd817', 'args': ['STSLCS']}}
  40396. Traceback (most recent call last):
  40397. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  40398. res = self.process(message)
  40399. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  40400. result = func(message, **settings)
  40401. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  40402. found, result = self._call_hook_for(message, "workflow", message)
  40403. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40404. return True, func(*args, **kwargs)
  40405. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  40406. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40407. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40408. return True, func(*args, **kwargs)
  40409. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40410. return func(*args, **kwargs)
  40411. File "/var/cache/salt/minion/extmods/engines/obd_manager.py", line 252, in execute_handler
  40412. res = conn.execute(cmd)
  40413. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 27, in decorator
  40414. return func(self, *args, **kwargs)
  40415. File "/var/cache/salt/minion/extmods/utils/obd_conn.py", line 323, in execute
  40416. return self._obd.execute(cmd, **kwargs)
  40417. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 361, in execute
  40418. lines = self.interface.relay(cmd_string, raw_response=raw_response)
  40419. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 727, in relay
  40420. lines = self.send(cmd, raw_response=raw_response)
  40421. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 779, in send
  40422. raise ELM327Error(self.ERRORS[line], code=line)
  40423. ELM327Error: Operation interrupted by a received RS232 character
  40424. 2020-08-04 13:12:59,534 [salt.utils.parsers:1050][WARNING ][423] Minion received a SIGTERM. Exiting.
  40425. 2020-08-04 13:13:00,073 [messaging :871 ][WARNING ][954] No reply message with tag 'obd/res/19354673-233e-4c8c-96f5-b6a4ce8bd817' received within timeout of 30 secs
  40426. 2020-08-04 13:13:00,076 [salt.state :292 ][ERROR ][954] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  40427. 2020-08-04 13:13:17,130 [gpio_spi_conn :42 ][WARNING ][625] Unable to clear buffer - got unexpected value: 255
  40428. 2020-08-04 13:13:17,142 [gpio_spi_conn :42 ][WARNING ][625] Unable to clear buffer - got unexpected value: 255
  40429. 2020-08-04 13:13:17,148 [gpio_spi_conn :42 ][WARNING ][625] Unable to clear buffer - got unexpected value: 255
  40430. 2020-08-04 13:13:17,857 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40431. Traceback (most recent call last):
  40432. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40433. self._serial.open()
  40434. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40435. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40436. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40437. 2020-08-04 13:13:18,871 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40438. Traceback (most recent call last):
  40439. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40440. self._serial.open()
  40441. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40442. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40443. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40444. 2020-08-04 13:13:19,183 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40445. 2020-08-04 13:13:19,686 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40446. 2020-08-04 13:13:19,876 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40447. Traceback (most recent call last):
  40448. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40449. self._serial.open()
  40450. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40451. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40452. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40453. 2020-08-04 13:13:20,189 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40454. 2020-08-04 13:13:20,192 [spm_conn :139 ][WARNING ][625] Unable to get status: Expected ack '12' but got '255'
  40455. 2020-08-04 13:13:20,613 [messaging :208 ][ERROR ][622] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  40456. Traceback (most recent call last):
  40457. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  40458. self._call_hook_for(message, "workflow", message)
  40459. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40460. return True, func(*args, **kwargs)
  40461. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  40462. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40463. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40464. return True, func(*args, **kwargs)
  40465. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40466. return func(*args, **kwargs)
  40467. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  40468. res = _exec("AT+CCLK?")
  40469. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  40470. conn.write_line(cmd)
  40471. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  40472. self.ensure_open()
  40473. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  40474. self.open()
  40475. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  40476. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  40477. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  40478. raise attempt.get()
  40479. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  40480. six.reraise(self.value[0], self.value[1], self.value[2])
  40481. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  40482. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  40483. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40484. self._serial.open()
  40485. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40486. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40487. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40488. 2020-08-04 13:13:20,711 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40489. 2020-08-04 13:13:35,335 [salt.loaded.ext.engines.acc_manager:116 ][WARNING ][712] Timeout after 1.28205128205 second(s) waiting for interrupt
  40490. 2020-08-04 13:13:35,361 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40491. Traceback (most recent call last):
  40492. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40493. self._serial.open()
  40494. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40495. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40496. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40497. 2020-08-04 13:13:35,562 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40498. 2020-08-04 13:13:36,066 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40499. 2020-08-04 13:13:36,068 [spm_conn :139 ][WARNING ][625] Unable to get status: Expected ack '12' but got '255'
  40500. 2020-08-04 13:13:36,366 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40501. Traceback (most recent call last):
  40502. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40503. self._serial.open()
  40504. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40505. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40506. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40507. 2020-08-04 13:13:36,572 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40508. 2020-08-04 13:13:37,076 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40509. 2020-08-04 13:13:37,369 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40510. Traceback (most recent call last):
  40511. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40512. self._serial.open()
  40513. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40514. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40515. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40516. 2020-08-04 13:13:37,372 [messaging :206 ][ERROR ][622] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  40517. Traceback (most recent call last):
  40518. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  40519. self._call_hook_for(message, "workflow", message)
  40520. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40521. return True, func(*args, **kwargs)
  40522. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  40523. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40524. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40525. return True, func(*args, **kwargs)
  40526. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40527. return func(*args, **kwargs)
  40528. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 305, in sync_time_handler
  40529. res = _exec("AT+CCLK=\"{0:%y/%m/%d,%H:%M:%S}+00\"".format(datetime.utcnow()))
  40530. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  40531. conn.write_line(cmd)
  40532. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  40533. self.ensure_open()
  40534. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  40535. self.open()
  40536. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  40537. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  40538. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  40539. raise attempt.get()
  40540. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  40541. six.reraise(self.value[0], self.value[1], self.value[2])
  40542. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  40543. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  40544. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40545. self._serial.open()
  40546. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40547. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40548. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40549. 2020-08-04 13:13:37,579 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40550. 2020-08-04 13:13:37,582 [spm_conn :139 ][WARNING ][625] Unable to get status: Expected ack '12' but got '255'
  40551. 2020-08-04 13:13:37,585 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40552. 2020-08-04 13:13:38,088 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40553. 2020-08-04 13:13:38,591 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40554. 2020-08-04 13:13:38,593 [spm_conn :82 ][WARNING ][625] Unable to send noop: Expected ack '12' but got '255'
  40555. 2020-08-04 13:13:39,015 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40556. Traceback (most recent call last):
  40557. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40558. self._serial.open()
  40559. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40560. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40561. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40562. 2020-08-04 13:13:39,097 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40563. 2020-08-04 13:13:39,600 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40564. 2020-08-04 13:13:40,020 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40565. Traceback (most recent call last):
  40566. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40567. self._serial.open()
  40568. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40569. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40570. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40571. 2020-08-04 13:13:40,104 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40572. 2020-08-04 13:13:40,106 [spm_conn :82 ][WARNING ][625] Unable to send noop: Expected ack '12' but got '255'
  40573. 2020-08-04 13:13:40,610 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40574. 2020-08-04 13:13:41,024 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40575. Traceback (most recent call last):
  40576. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40577. self._serial.open()
  40578. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40579. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40580. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40581. 2020-08-04 13:13:41,027 [messaging :742 ][ERROR ][622] Exception while processing event: {'tag': 'ec2x/req/451883fb-8079-4ac4-a640-757bdacb2ee2', 'data': {'_stamp': '2020-08-04T13:13:17.211812', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/451883fb-8079-4ac4-a640-757bdacb2ee2', 'kwargs': {'cooldown_delay': None}}}
  40582. Traceback (most recent call last):
  40583. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  40584. res = self.process(message)
  40585. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  40586. result = func(message, **settings)
  40587. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  40588. found, result = self._call_hook_for(message, "workflow", message)
  40589. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40590. return True, func(*args, **kwargs)
  40591. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  40592. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40593. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40594. return True, func(*args, **kwargs)
  40595. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40596. return func(*args, **kwargs)
  40597. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  40598. return _exec(cmd, **kwargs)
  40599. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  40600. conn.write_line(cmd)
  40601. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  40602. self.ensure_open()
  40603. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  40604. self.open()
  40605. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  40606. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  40607. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  40608. raise attempt.get()
  40609. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  40610. six.reraise(self.value[0], self.value[1], self.value[2])
  40611. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  40612. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  40613. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40614. self._serial.open()
  40615. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40616. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40617. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40618. 2020-08-04 13:13:41,113 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40619. 2020-08-04 13:13:41,616 [gpio_spi_conn :109 ][WARNING ][625] Expected ack '12' but got '255'
  40620. 2020-08-04 13:13:41,619 [spm_conn :82 ][WARNING ][625] Unable to send noop: Expected ack '12' but got '255'
  40621. 2020-08-04 13:13:41,621 [messaging :208 ][ERROR ][625] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  40622. Traceback (most recent call last):
  40623. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  40624. self._call_hook_for(message, "workflow", message)
  40625. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40626. return True, func(*args, **kwargs)
  40627. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  40628. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40629. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40630. return True, func(*args, **kwargs)
  40631. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40632. return func(*args, **kwargs)
  40633. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  40634. conn.heartbeat()
  40635. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  40636. self.noop()
  40637. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  40638. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  40639. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  40640. raise attempt.get()
  40641. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  40642. six.reraise(self.value[0], self.value[1], self.value[2])
  40643. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  40644. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  40645. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  40646. self._begin_message()
  40647. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  40648. self.recv(ack=ACK_MESSAGE_BEGIN)
  40649. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  40650. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  40651. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  40652. raise attempt.get()
  40653. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  40654. six.reraise(self.value[0], self.value[1], self.value[2])
  40655. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  40656. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  40657. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  40658. raise Exception(msg)
  40659. Exception: Expected ack '12' but got '255'
  40660. 2020-08-04 13:13:43,295 [messaging :208 ][ERROR ][623] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  40661. Traceback (most recent call last):
  40662. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  40663. self._call_hook_for(message, "workflow", message)
  40664. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40665. return True, func(*args, **kwargs)
  40666. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  40667. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40668. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40669. return True, func(*args, **kwargs)
  40670. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40671. return func(*args, **kwargs)
  40672. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  40673. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  40674. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  40675. res = query("AT+QGPSLOC={:d}".format(mode))
  40676. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  40677. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  40678. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  40679. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  40680. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  40681. raise salt.exceptions.CommandExecutionError(message["error"])
  40682. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40683. 2020-08-04 13:13:48,347 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40684. Traceback (most recent call last):
  40685. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40686. self._serial.open()
  40687. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40688. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40689. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40690. 2020-08-04 13:13:49,351 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40691. Traceback (most recent call last):
  40692. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40693. self._serial.open()
  40694. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40695. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40696. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40697. 2020-08-04 13:13:50,355 [serial_conn :79 ][ERROR ][622] Failed to open serial connection
  40698. Traceback (most recent call last):
  40699. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40700. self._serial.open()
  40701. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40702. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40703. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40704. 2020-08-04 13:13:50,359 [messaging :742 ][ERROR ][622] Exception while processing event: {'tag': 'ec2x/req/c09671d4-ed41-4309-9fb5-a7cb773b658f', 'data': {'_stamp': '2020-08-04T13:13:48.340199', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/c09671d4-ed41-4309-9fb5-a7cb773b658f', 'kwargs': {'cooldown_delay': None}}}
  40705. Traceback (most recent call last):
  40706. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  40707. res = self.process(message)
  40708. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  40709. result = func(message, **settings)
  40710. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  40711. found, result = self._call_hook_for(message, "workflow", message)
  40712. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40713. return True, func(*args, **kwargs)
  40714. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  40715. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40716. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40717. return True, func(*args, **kwargs)
  40718. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40719. return func(*args, **kwargs)
  40720. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  40721. return _exec(cmd, **kwargs)
  40722. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  40723. conn.write_line(cmd)
  40724. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  40725. self.ensure_open()
  40726. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  40727. self.open()
  40728. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  40729. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  40730. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  40731. raise attempt.get()
  40732. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  40733. six.reraise(self.value[0], self.value[1], self.value[2])
  40734. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  40735. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  40736. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40737. self._serial.open()
  40738. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40739. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40740. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40741. 2020-08-04 13:13:50,385 [messaging :206 ][ERROR ][623] Recurring exception (2 times) in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  40742. Traceback (most recent call last):
  40743. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  40744. self._call_hook_for(message, "workflow", message)
  40745. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40746. return True, func(*args, **kwargs)
  40747. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  40748. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40749. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40750. return True, func(*args, **kwargs)
  40751. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40752. return func(*args, **kwargs)
  40753. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  40754. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  40755. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  40756. res = query("AT+QGPSLOC={:d}".format(mode))
  40757. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  40758. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  40759. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  40760. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  40761. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  40762. raise salt.exceptions.CommandExecutionError(message["error"])
  40763. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40764. 2020-08-04 13:13:54,735 [obd.obd :107 ][ERROR ][711] Failed to use explicit port '/dev/serial0'
  40765. Traceback (most recent call last):
  40766. File "/usr/local/lib/python2.7/dist-packages/obd/obd.py", line 105, in __connect
  40767. self.interface.open(baudrate, protocol=protocol)
  40768. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 340, in open
  40769. self.set_protocol(prot.pop("id", None), **prot)
  40770. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/stn11xx.py", line 266, in set_protocol
  40771. ret = super(STN11XX, self).set_protocol(ident, **kwargs)
  40772. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 471, in set_protocol
  40773. self._protocol = self._auto_protocol(**kwargs)
  40774. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 893, in _auto_protocol
  40775. res_0100 = self._verify_protocol("auto", test=not verify)
  40776. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 827, in _verify_protocol
  40777. for line in self.query("0100", parse=False, read_timeout=10):
  40778. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 697, in query
  40779. lines = self.send(cmd, read_timeout=read_timeout, raw_response=not parse)
  40780. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 759, in send
  40781. lines = self._read(timeout=read_timeout, interrupt_delay=interrupt_delay)
  40782. File "/usr/local/lib/python2.7/dist-packages/obd/interfaces/elm327.py", line 1057, in _read
  40783. data = self._port.read(self._port.in_waiting or 1)
  40784. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 483, in read
  40785. ready, _, _ = select.select([self.fd, self.pipe_abort_read_r], [], [], timeout.time_left())
  40786. File "/usr/lib/python2.7/dist-packages/salt/utils/process.py", line 713, in _handle_signals
  40787. sys.exit(salt.defaults.exitcodes.EX_OK)
  40788. SystemExit: 0
  40789. 2020-08-04 13:13:54,767 [obd.obd :120 ][WARNING ][711] Cannot load commands - no connection to bus
  40790. 2020-08-04 13:13:55,580 [salt.utils.parsers:1050][WARNING ][422] Minion received a SIGTERM. Exiting.
  40791. 2020-08-04 13:13:56,118 [messaging :871 ][WARNING ][822] No reply message with tag 'obd/res/5988e2d2-6fd1-46a2-8ee8-440820b34d97' received within timeout of 30 secs
  40792. 2020-08-04 13:13:56,122 [salt.state :292 ][ERROR ][822] Failed to get current status of trigger: No reply message received within timeout of 30 secs - please try again and maybe increase timeout value
  40793. 2020-08-04 13:14:13,303 [gpio_spi_conn :42 ][WARNING ][622] Unable to clear buffer - got unexpected value: 255
  40794. 2020-08-04 13:14:13,324 [gpio_spi_conn :42 ][WARNING ][622] Unable to clear buffer - got unexpected value: 255
  40795. 2020-08-04 13:14:13,327 [gpio_spi_conn :42 ][WARNING ][622] Unable to clear buffer - got unexpected value: 255
  40796. 2020-08-04 13:14:14,018 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  40797. Traceback (most recent call last):
  40798. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40799. self._serial.open()
  40800. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40801. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40802. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40803. 2020-08-04 13:14:15,031 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  40804. Traceback (most recent call last):
  40805. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40806. self._serial.open()
  40807. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40808. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40809. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40810. 2020-08-04 13:14:15,363 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  40811. 2020-08-04 13:14:15,866 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  40812. 2020-08-04 13:14:16,035 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  40813. Traceback (most recent call last):
  40814. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40815. self._serial.open()
  40816. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40817. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40818. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40819. 2020-08-04 13:14:16,369 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  40820. 2020-08-04 13:14:16,371 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  40821. 2020-08-04 13:14:16,649 [messaging :208 ][ERROR ][619] Exception in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  40822. Traceback (most recent call last):
  40823. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  40824. self._call_hook_for(message, "workflow", message)
  40825. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40826. return True, func(*args, **kwargs)
  40827. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  40828. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40829. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40830. return True, func(*args, **kwargs)
  40831. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40832. return func(*args, **kwargs)
  40833. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  40834. res = _exec("AT+CCLK?")
  40835. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  40836. conn.write_line(cmd)
  40837. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  40838. self.ensure_open()
  40839. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  40840. self.open()
  40841. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  40842. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  40843. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  40844. raise attempt.get()
  40845. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  40846. six.reraise(self.value[0], self.value[1], self.value[2])
  40847. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  40848. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  40849. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40850. self._serial.open()
  40851. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40852. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40853. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40854. 2020-08-04 13:14:16,880 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  40855. 2020-08-04 13:14:17,384 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  40856. 2020-08-04 13:14:17,886 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  40857. 2020-08-04 13:14:17,889 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  40858. 2020-08-04 13:14:18,392 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  40859. 2020-08-04 13:14:18,904 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  40860. 2020-08-04 13:14:19,407 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  40861. 2020-08-04 13:14:19,409 [spm_conn :139 ][WARNING ][622] Unable to get status: Expected ack '12' but got '255'
  40862. 2020-08-04 13:14:19,420 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  40863. 2020-08-04 13:14:19,924 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  40864. 2020-08-04 13:14:20,428 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  40865. 2020-08-04 13:14:20,432 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  40866. 2020-08-04 13:14:20,513 [salt.utils :831 ][ERROR ][422] DNS lookup or connection check of 'hub' failed.
  40867. 2020-08-04 13:14:20,837 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  40868. Traceback (most recent call last):
  40869. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40870. self._serial.open()
  40871. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40872. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40873. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40874. 2020-08-04 13:14:20,938 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  40875. 2020-08-04 13:14:21,443 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  40876. 2020-08-04 13:14:21,841 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  40877. Traceback (most recent call last):
  40878. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40879. self._serial.open()
  40880. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40881. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40882. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40883. 2020-08-04 13:14:21,950 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  40884. 2020-08-04 13:14:21,953 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  40885. 2020-08-04 13:14:21,982 [cloud_cache :432 ][WARNING ][661] Temporarily unable to upload batch with 10 entries from queue 'pend': HTTPSConnectionPool(host='api.autopi.io', port=443): Max retries exceeded with url: /logbook/storage (Caused by NewConnectionError('<requests.packages.urllib3.connection.VerifiedHTTPSConnection object at 0x735c79b0>: Failed to establish a new connection: [Errno -3] Temporary failure in name resolution',))
  40886. 2020-08-04 13:14:22,459 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  40887. 2020-08-04 13:14:22,846 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  40888. Traceback (most recent call last):
  40889. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40890. self._serial.open()
  40891. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40892. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40893. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40894. 2020-08-04 13:14:22,849 [messaging :742 ][ERROR ][619] Exception while processing event: {'tag': 'ec2x/req/0ccb5fe3-fd68-4002-b1e5-023722ab6227', 'data': {'_stamp': '2020-08-04T13:14:13.390679', 'args': ['AT+QGPSLOC=2'], '_event_tag': 'ec2x/req/0ccb5fe3-fd68-4002-b1e5-023722ab6227', 'kwargs': {'cooldown_delay': None}}}
  40895. Traceback (most recent call last):
  40896. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 739, in process_event
  40897. res = self.process(message)
  40898. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 106, in process
  40899. result = func(message, **settings)
  40900. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 117, in shared_worker
  40901. found, result = self._call_hook_for(message, "workflow", message)
  40902. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40903. return True, func(*args, **kwargs)
  40904. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  40905. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40906. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40907. return True, func(*args, **kwargs)
  40908. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40909. return func(*args, **kwargs)
  40910. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 102, in exec_handler
  40911. return _exec(cmd, **kwargs)
  40912. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  40913. conn.write_line(cmd)
  40914. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  40915. self.ensure_open()
  40916. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  40917. self.open()
  40918. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  40919. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  40920. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  40921. raise attempt.get()
  40922. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  40923. six.reraise(self.value[0], self.value[1], self.value[2])
  40924. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  40925. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  40926. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40927. self._serial.open()
  40928. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40929. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40930. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40931. 2020-08-04 13:14:22,909 [messaging :208 ][ERROR ][620] Exception in worker thread 'poll_logger' while running workflow for message: {'returner': 'cloud', 'converter': 'gnss_location_to_position', 'trigger': 'position_event', 'args': ['location'], 'filter': 'significant_position', 'handler': 'gnss_query', 'kwargs': {'mode': 2}}
  40932. Traceback (most recent call last):
  40933. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  40934. self._call_hook_for(message, "workflow", message)
  40935. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40936. return True, func(*args, **kwargs)
  40937. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 317, in extended_workflow
  40938. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40939. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40940. return True, func(*args, **kwargs)
  40941. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40942. return func(*args, **kwargs)
  40943. File "/var/cache/salt/minion/extmods/engines/tracking_manager.py", line 128, in gnss_query_handler
  40944. return __salt__["ec2x.gnss_{:s}".format(cmd)](*args, **kwargs)
  40945. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 726, in gnss_location
  40946. res = query("AT+QGPSLOC={:d}".format(mode))
  40947. File "/var/cache/salt/minion/extmods/modules/ec2x.py", line 75, in query
  40948. return client.send_sync(_msg_pack(cmd, cooldown_delay=cooldown_delay, **kwargs))
  40949. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 853, in send_sync
  40950. reply = self._recv_reply(bus, timeout=timeout, tag=res_tag, match_type="startswith")
  40951. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 880, in _recv_reply
  40952. raise salt.exceptions.CommandExecutionError(message["error"])
  40953. CommandExecutionError: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40954. 2020-08-04 13:14:22,962 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  40955. 2020-08-04 13:14:23,449 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  40956. Traceback (most recent call last):
  40957. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  40958. self._serial.open()
  40959. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  40960. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  40961. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  40962. 2020-08-04 13:14:23,466 [gpio_spi_conn :109 ][WARNING ][622] Expected ack '12' but got '255'
  40963. 2020-08-04 13:14:23,469 [spm_conn :82 ][WARNING ][622] Unable to send noop: Expected ack '12' but got '255'
  40964. 2020-08-04 13:14:23,471 [messaging :208 ][ERROR ][622] Exception in worker thread '_heartbeat' while running workflow for message: {'handler': 'heartbeat'}
  40965. Traceback (most recent call last):
  40966. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  40967. self._call_hook_for(message, "workflow", message)
  40968. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40969. return True, func(*args, **kwargs)
  40970. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  40971. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  40972. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  40973. return True, func(*args, **kwargs)
  40974. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  40975. return func(*args, **kwargs)
  40976. File "/var/cache/salt/minion/extmods/engines/spm_manager.py", line 110, in heartbeat_handler
  40977. conn.heartbeat()
  40978. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 87, in heartbeat
  40979. self.noop()
  40980. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  40981. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  40982. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  40983. raise attempt.get()
  40984. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  40985. six.reraise(self.value[0], self.value[1], self.value[2])
  40986. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  40987. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  40988. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 77, in noop
  40989. self._begin_message()
  40990. File "/var/cache/salt/minion/extmods/utils/spm_conn.py", line 68, in _begin_message
  40991. self.recv(ack=ACK_MESSAGE_BEGIN)
  40992. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  40993. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  40994. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  40995. raise attempt.get()
  40996. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  40997. six.reraise(self.value[0], self.value[1], self.value[2])
  40998. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  40999. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  41000. File "/var/cache/salt/minion/extmods/utils/gpio_spi_conn.py", line 111, in recv
  41001. raise Exception(msg)
  41002. Exception: Expected ack '12' but got '255'
  41003. 2020-08-04 13:14:24,454 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  41004. Traceback (most recent call last):
  41005. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  41006. self._serial.open()
  41007. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  41008. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  41009. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  41010. 2020-08-04 13:14:25,458 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  41011. Traceback (most recent call last):
  41012. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  41013. self._serial.open()
  41014. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  41015. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  41016. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  41017. 2020-08-04 13:14:25,991 [messaging :206 ][ERROR ][619] Recurring exception (2 times) in worker thread 'sync_time' while running workflow for message: {'handler': 'sync_time', 'kwargs': {'force': False}}
  41018. Traceback (most recent call last):
  41019. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 162, in do_work
  41020. self._call_hook_for(message, "workflow", message)
  41021. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  41022. return True, func(*args, **kwargs)
  41023. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 271, in simple_workflow
  41024. _, result = self._call_hook_for(message, "handler", *args, **kwargs)
  41025. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 433, in _call_hook_for
  41026. return True, func(*args, **kwargs)
  41027. File "/var/cache/salt/minion/extmods/utils/messaging.py", line 522, in synchronizer
  41028. return func(*args, **kwargs)
  41029. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 238, in sync_time_handler
  41030. res = _exec("AT+CCLK?")
  41031. File "/var/cache/salt/minion/extmods/engines/ec2x_manager.py", line 70, in _exec
  41032. conn.write_line(cmd)
  41033. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 20, in decorator
  41034. self.ensure_open()
  41035. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 88, in ensure_open
  41036. self.open()
  41037. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 49, in wrapped_f
  41038. return Retrying(*dargs, **dkw).call(f, *args, **kw)
  41039. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 212, in call
  41040. raise attempt.get()
  41041. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 247, in get
  41042. six.reraise(self.value[0], self.value[1], self.value[2])
  41043. File "/usr/local/lib/python2.7/dist-packages/retrying.py", line 200, in call
  41044. attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
  41045. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  41046. self._serial.open()
  41047. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  41048. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  41049. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  41050. 2020-08-04 13:14:27,969 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  41051. Traceback (most recent call last):
  41052. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  41053. self._serial.open()
  41054. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  41055. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  41056. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  41057. 2020-08-04 13:14:28,973 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  41058. Traceback (most recent call last):
  41059. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  41060. self._serial.open()
  41061. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  41062. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  41063. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  41064. 2020-08-04 13:14:29,977 [serial_conn :79 ][ERROR ][619] Failed to open serial connection
  41065. Traceback (most recent call last):
  41066. File "/var/cache/salt/minion/extmods/utils/serial_conn.py", line 75, in open
  41067. self._serial.open()
  41068. File "/usr/local/lib/python2.7/dist-packages/serial/serialposix.py", line 268, in open
  41069. raise SerialException(msg.errno, "could not open port {}: {}".format(self._port, msg))
  41070. SerialException: [Errno 2] could not open port /dev/ttyUSB2: [Errno 2] No such file or directory: '/dev/ttyUSB2'
  41071. 2
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!