API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Jul 19th, 2018
67
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 38.75 KB | None | 0 0
raw download clone embed print report
  1. Using TensorFlow backend.
  2. INFO 00:15:38.042 1 database_service.py ------------ Register collections: {'PresenceInfo': 'presence_info', 'SoundChunk': 'sounds', 'TelegramChat': 'telegram', 'AnomalyTrainerParam': 'trainer_params', 'TreadedVideo': 'treaded_videos', 'HumanStateInfo': 'human_state_info', 'Anomaly': 'anomaly', 'Room': 'rooms', 'Camera': 'cameras', 'Human': 'humans', 'AnomalyTrainerData': 'trainer_data'}
  3. INFO 00:15:38.045 1 shared_array.py ------------ Init shared image segment of 170 images
  4. Using TensorFlow backend.
  5. INFO 10:40:06.371 1 database_service.py ------------ Register collections: {'PresenceInfo': 'presence_info', 'TelegramChat': 'telegram', 'Human': 'humans', 'AnomalyTrainerData': 'trainer_data', 'Room': 'rooms', 'TreadedVideo': 'treaded_videos', 'AnomalyTrainerParam': 'trainer_params', 'SoundChunk': 'sounds', 'HumanStateInfo': 'human_state_info', 'Anomaly': 'anomaly', 'Camera': 'cameras'}
  6. INFO 10:40:06.744 1 shared_array.py ------------ Init shared image segment of 170 images
  7. INFO 10:42:15.485 20 command.py ------------ Loading module core.anomality.AnomalyWorker ...
  8. INFO 10:43:15.270 20 gpu.py ------------ Set gpu memory to 768
  9. INFO 10:43:15.295 20 command.py ------------ Loading module core.anomality.AnomalyWorker 59.811 sec ...OK
  10. INFO 10:43:15.308 47 command.py ------------ Loading module core.tracker.worker ...
  11. INFO 10:43:15.603 47 gpu.py ------------ Set gpu memory to 768
  12. Using TensorFlow backend.
  13. INFO 10:45:19.144 1 database_service.py ------------ Register collections: {'Camera': 'cameras', 'AnomalyTrainerParam': 'trainer_params', 'AnomalyTrainerData': 'trainer_data', 'HumanStateInfo': 'human_state_info', 'Human': 'humans', 'Room': 'rooms', 'SoundChunk': 'sounds', 'TelegramChat': 'telegram', 'Anomaly': 'anomaly', 'TreadedVideo': 'treaded_videos', 'PresenceInfo': 'presence_info'}
  14. INFO 10:45:19.147 1 shared_array.py ------------ Init shared image segment of 170 images
  15. INFO 10:48:11.858 19 command.py ------------ Loading module core.anomality.AnomalyWorker ...
  16. INFO 10:48:12.218 19 gpu.py ------------ Set gpu memory to 768
  17. INFO 10:48:12.220 19 command.py ------------ Loading module core.anomality.AnomalyWorker 0.362 sec ...OK
  18. INFO 10:48:12.226 46 command.py ------------ Loading module core.show_video.save_video_worker ...
  19. INFO 10:48:12.275 46 command.py ------------ Loading module core.show_video.save_video_worker 0.049 sec ...OK
  20. INFO 10:48:12.310 48 command.py ------------ Loading module core.cnn.worker ...
  21. INFO 10:48:12.786 48 pose_estimation.py ------------ Caffe init with GPU model /code/beta1/core/cnn/../../data/pose/pose_iter_440000.caffemodel deploy /code/beta1/core/cnn/../../data/pose/pose_deploy.prototxt
  22. INFO 10:49:43.357 48 command.py ------------ Loading module core.cnn.worker 91.047 sec ...OK
  23. INFO 10:49:43.362 1 command.py ------------ Loading module core.show_video.save_track_worker ...
  24. INFO 10:49:43.398 1 command.py ------------ Loading module core.show_video.save_track_worker 0.036 sec ...OK
  25. INFO 10:49:43.404 53 command.py ------------ Loading module core.tracker.worker ...
  26. INFO 10:49:43.722 53 gpu.py ------------ Set gpu memory to 768
  27. INFO 10:50:09.698 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  28. INFO 10:50:10.910 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  29. INFO 10:50:10.939 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  30. INFO 10:50:11.096 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  31. INFO 10:50:11.351 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  32. INFO 10:50:11.377 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  33. INFO 10:50:11.404 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  34. INFO 10:50:11.419 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  35. INFO 10:50:11.428 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  36. INFO 10:50:11.432 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  37. INFO 10:50:11.441 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  38. INFO 10:50:11.449 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  39. INFO 10:50:11.894 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  40. INFO 10:50:11.986 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  41. INFO 10:50:12.020 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  42. INFO 10:50:12.037 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  43. INFO 10:50:12.109 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  44. INFO 10:50:12.111 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  45. INFO 10:50:12.114 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  46. INFO 10:50:12.150 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  47. INFO 10:50:12.187 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  48. INFO 10:50:12.188 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  49. INFO 10:50:12.191 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  50. INFO 10:50:12.273 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  51. INFO 10:50:12.279 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  52. INFO 10:50:12.314 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  53. INFO 10:50:12.870 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  54. INFO 10:50:12.890 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  55. INFO 10:50:12.912 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  56. INFO 10:50:12.993 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  57. INFO 10:50:13.382 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  58. INFO 10:50:13.385 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  59. INFO 10:50:13.388 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  60. INFO 10:50:13.390 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  61. INFO 10:50:13.415 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  62. INFO 10:50:13.417 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  63. INFO 10:50:13.419 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  64. INFO 10:50:13.420 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  65. INFO 10:50:13.422 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  66. INFO 10:50:13.424 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  67. INFO 10:50:13.425 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  68. INFO 10:50:13.426 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  69. INFO 10:50:13.517 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  70. INFO 10:50:13.768 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  71. INFO 10:50:13.772 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  72. INFO 10:50:13.782 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  73. INFO 10:50:13.870 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  74. INFO 10:50:13.916 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  75. INFO 10:50:13.919 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  76. INFO 10:50:13.925 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  77. INFO 10:50:13.994 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  78. INFO 10:50:14.639 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  79. INFO 10:50:14.650 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  80. INFO 10:50:14.652 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  81. INFO 10:50:14.691 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  82. INFO 10:50:14.774 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  83. INFO 10:50:15.162 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  84. INFO 10:50:15.194 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  85. INFO 10:50:15.206 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  86. INFO 10:50:15.208 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  87. INFO 10:50:15.229 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  88. INFO 10:50:15.273 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  89. INFO 10:50:15.656 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  90. INFO 10:50:15.660 53 HumanService.py ------------ No faces found on facial image for STRANGER_1
  91. INFO 10:50:45.548 53 worker.py ------------ [TrackerWorker_prepare] Time info :
  92. body_module: 0.1302(0.1302) sec for 1/0 c/f; 7.68/0.00 fps c/f
  93. body_verifier: 29.8871(29.8871) sec for 1/0 c/f; 0.03/0.00 fps c/f
  94. close_presence: 0.0024(0.0024) sec for 1/0 c/f; 418.00/0.00 fps c/f
  95. face_module: 23.6779(23.6779) sec for 1/0 c/f; 0.04/0.00 fps c/f
  96. human_service: 7.7886(7.7886) sec for 1/0 c/f; 0.13/0.00 fps c/f
  97. track_manager: 0.0000(0.0000) sec for 1/0 c/f; 115968.92/0.00 fps c/f
  98.  
  99. INFO 10:50:45.548 53 worker.py ------------ [TrackerWorker_prepare] Summary time info :
  100. Total time: 61.4861 sec
  101. Min/Max time: 0.0000 / 29.8871 sec
  102.  
  103. INFO 10:50:45.548 53 command.py ------------ Loading module core.tracker.worker 62.144 sec ...OK
  104. INFO 10:50:45.551 1 command.py ------------ Loading module core.video_process_worker ...
  105. INFO 10:50:46.182 1 command.py ------------ Loading module core.video_process_worker 0.631 sec ...OK
  106. INFO 10:50:46.182 1 aiservice.py ------------ Starting...
  107. INFO 10:50:46.188 1 aiservice.py ------------ Starting...OK
  108. INFO 10:50:46.190 84 aiservice.py ------------ Dispatch images...
  109. INFO 10:50:46.792 1 command.py ------------ Start watching file ./work_dir/anomaly/sync.json of module core.anomality.AnomalyWorker
  110. INFO 10:50:47.629 1 aiservice.py 40578d472fc0 Put batch for camera laptop request to queue, spend 0.835 sec
  111. INFO 10:50:47.629 84 aiservice.py 40578d472fc0 Start collecting batch for camera laptop, spend 0.836 sec
  112. INFO 10:50:47.630 84 batch_reader.py 40578d472fc0 Create stream to laptop, args {'qid': '40578d472fc0', 'started': 1531986647.6300972, 'fps': 4.0, 'camera_name': 'laptop', 'camera_db': <pylib.db.models.Camera object at 0x7f749091be10>, 'restart': True}
  113. INFO 10:50:47.631 1 aiservice.py ec99702a5007 Put batch for camera laptop request to queue, spend 0.001 sec
  114. INFO 10:50:47.631 1 aiservice.py ------------ Start processing batches, 1 active
  115. INFO 10:50:47.631 1 aiservice.py ------------ Start processing batches, 2 active
  116. INFO 10:50:47.632 1 aiservice.py ------------ Start processing batches, 3 active
  117. INFO 10:50:47.632 1 aiservice.py ------------ Start processing batches, 4 active
  118. INFO 10:50:47.632 1 aiservice.py ------------ Start processing batches, 5 active
  119. WARNING 10:50:47.632 1 conclusion.py ------------ HACK!!! Call anomaly retrain from main loop in conclusion!
  120. INFO 10:50:47.637 89 AnomalyService.py ------------ Start for retrain
  121. INFO 10:50:53.029 84 aiservice.py ec99702a5007 Start collecting batch for camera laptop, spend 5.400 sec
  122. INFO 10:50:53.075 1 aiservice.py f1c23a36b4c3 Put batch for camera laptop request to queue, spend 0.002 sec
  123. INFO 10:50:53.083 1 aiservice.py 40578d472fc0 (#1) Start processing batch #0, camera laptop, spend 5.454 sec
  124. INFO 10:50:53.258 1 command.py 40578d472fc0 core.video_process_worker finished. Spend 0.175 sec. FPS 137.483
  125. WARNING: Logging before InitGoogleLogging() is written to STDERR
  126. F0719 10:50:53.442028 48 syncedmem.cpp:71] Check failed: error == cudaSuccess (2 vs. 0) out of memory
  127. *** Check failure stack trace: ***
  128. INFO 10:50:56.936 89 MLAnomalityRecognizer.py ------------ ML anomaly detector weights update: APPROVED
  129. INFO 10:50:57.169 89 BaseAnomalyTrainer.py ------------ MLAnomalyTrainer train with 1.0
  130. INFO 10:50:58.636 84 aiservice.py f1c23a36b4c3 Start collecting batch for camera laptop, spend 5.564 sec
  131. INFO 10:50:58.726 1 aiservice.py ec99702a5007 (#2) Start processing batch #1, camera laptop, spend 5.697 sec
  132. INFO 10:50:58.748 1 command.py ec99702a5007 core.video_process_worker finished. Spend 0.020 sec. FPS 1175.259
  133. INFO 10:50:58.754 1 aiservice.py 12da6c9f14a1 Put batch for camera laptop request to queue, spend 0.003 sec
  134. WARNING 10:50:58.757 1 foreman.py ec99702a5007 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  135. INFO 10:51:00.721 89 BaseAnomalyTrainer.py ------------ StatisticAnomalyTrainer train with 0.22727272727272724
  136. INFO 10:51:00.721 89 AnomalyService.py ------------ Retrain finished 13.0837(13.0837) sec for 1/0 c/f; 0.08/0.00 fps c/f
  137. INFO 10:51:04.237 84 aiservice.py 12da6c9f14a1 Start collecting batch for camera laptop, spend 5.486 sec
  138. CRITICAL 10:51:04.769 1 aiservice.py ec99702a5007 Exception in one of the workers
  139. INFO 10:51:04.771 1 aiservice.py f1c23a36b4c3 (#2) Start processing batch #2, camera laptop, spend 6.134 sec
  140. INFO 10:51:04.780 1 command.py f1c23a36b4c3 core.video_process_worker finished. Spend 0.009 sec. FPS 2624.995
  141. INFO 10:51:04.785 1 aiservice.py 0f7a668fa9d1 Put batch for camera laptop request to queue, spend 0.001 sec
  142. WARNING 10:51:04.787 1 foreman.py f1c23a36b4c3 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  143. CRITICAL 10:51:06.185 1 aiservice.py f1c23a36b4c3 Exception in one of the workers
  144. WARNING 10:51:06.794 1 command.py ------------ File modified! Restart core.anomality.AnomalyWorker
  145. INFO 10:51:06.796 19 command.py ------------ Stop core.anomality.AnomalyWorker thread
  146. INFO 10:51:06.862 139 command.py ------------ Loading module core.anomality.AnomalyWorker ...
  147. INFO 10:51:07.168 139 gpu.py ------------ Set gpu memory to 768
  148. INFO 10:51:07.170 139 command.py ------------ Loading module core.anomality.AnomalyWorker 0.309 sec ...OK
  149. INFO 10:51:09.837 84 aiservice.py 0f7a668fa9d1 Start collecting batch for camera laptop, spend 5.053 sec
  150. INFO 10:51:09.902 1 aiservice.py 12da6c9f14a1 (#2) Start processing batch #3, camera laptop, spend 5.664 sec
  151. INFO 10:51:09.926 1 command.py 12da6c9f14a1 core.video_process_worker finished. Spend 0.022 sec. FPS 1081.726
  152. WARNING 10:51:09.928 1 foreman.py 12da6c9f14a1 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  153. CRITICAL 10:51:10.763 1 aiservice.py 12da6c9f14a1 Exception in one of the workers
  154. INFO 10:51:10.766 1 aiservice.py 858c5107570c Put batch for camera laptop request to queue, spend 0.001 sec
  155. INFO 10:51:15.437 84 aiservice.py 858c5107570c Start collecting batch for camera laptop, spend 4.673 sec
  156. INFO 10:51:15.519 1 aiservice.py 0f7a668fa9d1 (#2) Start processing batch #4, camera laptop, spend 5.681 sec
  157. INFO 10:51:15.540 1 command.py 0f7a668fa9d1 core.video_process_worker finished. Spend 0.020 sec. FPS 1218.654
  158. WARNING 10:51:15.542 1 foreman.py 0f7a668fa9d1 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  159. CRITICAL 10:51:16.608 1 aiservice.py 0f7a668fa9d1 Exception in one of the workers
  160. INFO 10:51:16.611 1 aiservice.py 0e0543d0332b Put batch for camera laptop request to queue, spend 0.002 sec
  161. INFO 10:51:21.039 84 aiservice.py 0e0543d0332b Start collecting batch for camera laptop, spend 4.430 sec
  162. INFO 10:51:21.056 1 aiservice.py 858c5107570c (#2) Start processing batch #5, camera laptop, spend 5.618 sec
  163. INFO 10:51:21.077 1 command.py 858c5107570c core.video_process_worker finished. Spend 0.020 sec. FPS 1209.299
  164. INFO 10:51:21.081 1 aiservice.py 53727f9f9683 Put batch for camera laptop request to queue, spend 0.002 sec
  165. WARNING 10:51:21.084 1 foreman.py 858c5107570c Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  166. CRITICAL 10:51:23.044 1 aiservice.py 858c5107570c Exception in one of the workers
  167. INFO 10:51:26.638 84 aiservice.py 53727f9f9683 Start collecting batch for camera laptop, spend 5.559 sec
  168. INFO 10:51:26.693 1 aiservice.py 0258e8427db0 Put batch for camera laptop request to queue, spend 0.003 sec
  169. INFO 10:51:26.696 1 aiservice.py 0e0543d0332b (#2) Start processing batch #6, camera laptop, spend 5.656 sec
  170. INFO 10:51:26.706 1 command.py 0e0543d0332b core.video_process_worker finished. Spend 0.010 sec. FPS 2377.330
  171. WARNING 10:51:26.707 1 foreman.py 0e0543d0332b Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  172. CRITICAL 10:51:29.491 1 aiservice.py 0e0543d0332b Exception in one of the workers
  173. INFO 10:51:32.239 84 aiservice.py 0258e8427db0 Start collecting batch for camera laptop, spend 5.549 sec
  174. INFO 10:51:32.334 1 aiservice.py ee37425030b8 Put batch for camera laptop request to queue, spend 0.004 sec
  175. INFO 10:51:32.339 1 aiservice.py 53727f9f9683 (#2) Start processing batch #7, camera laptop, spend 5.700 sec
  176. INFO 10:51:32.359 1 command.py 53727f9f9683 core.video_process_worker finished. Spend 0.019 sec. FPS 1254.793
  177. WARNING 10:51:32.360 1 foreman.py 53727f9f9683 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  178. CRITICAL 10:51:33.691 1 aiservice.py 53727f9f9683 Exception in one of the workers
  179. INFO 10:51:37.843 84 aiservice.py ee37425030b8 Start collecting batch for camera laptop, spend 5.512 sec
  180. INFO 10:51:37.844 1 aiservice.py 0258e8427db0 (#2) Start processing batch #8, camera laptop, spend 5.604 sec
  181. INFO 10:51:37.865 1 command.py 0258e8427db0 core.video_process_worker finished. Spend 0.020 sec. FPS 1180.413
  182. WARNING 10:51:37.867 1 foreman.py 0258e8427db0 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  183. CRITICAL 10:51:39.202 1 aiservice.py 0258e8427db0 Exception in one of the workers
  184. INFO 10:51:39.205 1 aiservice.py 1196af844b74 Put batch for camera laptop request to queue, spend 0.001 sec
  185. INFO 10:51:43.474 84 aiservice.py 1196af844b74 Start collecting batch for camera laptop, spend 4.271 sec
  186. INFO 10:51:43.556 1 aiservice.py ee37425030b8 (#2) Start processing batch #9, camera laptop, spend 5.713 sec
  187. INFO 10:51:43.566 1 command.py ee37425030b8 core.video_process_worker finished. Spend 0.009 sec. FPS 2697.157
  188. WARNING 10:51:43.567 1 foreman.py ee37425030b8 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  189. CRITICAL 10:51:44.610 1 aiservice.py ee37425030b8 Exception in one of the workers
  190. INFO 10:51:44.613 1 aiservice.py 6553184e8068 Put batch for camera laptop request to queue, spend 0.002 sec
  191. WARNING 10:51:47.633 1 conclusion.py ------------ HACK!!! Call anomaly retrain from main loop in conclusion!
  192. INFO 10:51:47.645 176 AnomalyService.py ------------ Start for retrain
  193. INFO 10:51:48.342 176 MLAnomalityRecognizer.py ------------ ML anomaly detector weights update: APPROVED
  194. INFO 10:51:48.775 176 BaseAnomalyTrainer.py ------------ MLAnomalyTrainer train with 1.0
  195. INFO 10:51:48.783 176 BaseAnomalyTrainer.py ------------ StatisticAnomalyTrainer train with 0.22727272727272724
  196. INFO 10:51:48.783 176 AnomalyService.py ------------ Retrain finished 1.1366(1.1366) sec for 1/0 c/f; 0.88/0.00 fps c/f
  197. INFO 10:51:49.077 84 aiservice.py 6553184e8068 Start collecting batch for camera laptop, spend 4.466 sec
  198. INFO 10:51:49.169 1 aiservice.py 1196af844b74 (#2) Start processing batch #10, camera laptop, spend 5.695 sec
  199. INFO 10:51:49.189 1 command.py 1196af844b74 core.video_process_worker finished. Spend 0.018 sec. FPS 1349.320
  200. WARNING 10:51:49.190 1 foreman.py 1196af844b74 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  201. CRITICAL 10:51:50.102 1 aiservice.py 1196af844b74 Exception in one of the workers
  202. INFO 10:51:50.105 1 aiservice.py 90f343ab6cc2 Put batch for camera laptop request to queue, spend 0.002 sec
  203. WARNING 10:51:50.106 1 command.py ------------ File modified! Restart core.anomality.AnomalyWorker
  204. INFO 10:51:50.107 139 command.py ------------ Stop core.anomality.AnomalyWorker thread
  205. INFO 10:51:50.141 214 command.py ------------ Loading module core.anomality.AnomalyWorker ...
  206. INFO 10:51:50.445 214 gpu.py ------------ Set gpu memory to 768
  207. INFO 10:51:50.448 214 command.py ------------ Loading module core.anomality.AnomalyWorker 0.307 sec ...OK
  208. INFO 10:51:54.677 84 aiservice.py 90f343ab6cc2 Start collecting batch for camera laptop, spend 4.574 sec
  209. INFO 10:51:54.760 1 aiservice.py 108bdd673493 Put batch for camera laptop request to queue, spend 0.005 sec
  210. INFO 10:51:54.763 1 aiservice.py 6553184e8068 (#2) Start processing batch #11, camera laptop, spend 5.686 sec
  211. INFO 10:51:54.778 1 command.py 6553184e8068 core.video_process_worker finished. Spend 0.014 sec. FPS 1698.672
  212. WARNING 10:51:54.780 1 foreman.py 6553184e8068 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  213. CRITICAL 10:51:55.731 1 aiservice.py 6553184e8068 Exception in one of the workers
  214. INFO 10:52:00.278 84 aiservice.py 108bdd673493 Start collecting batch for camera laptop, spend 5.522 sec
  215. INFO 10:52:00.295 1 aiservice.py 90f343ab6cc2 (#2) Start processing batch #12, camera laptop, spend 5.617 sec
  216. INFO 10:52:00.305 1 command.py 90f343ab6cc2 core.video_process_worker finished. Spend 0.010 sec. FPS 2478.842
  217. WARNING 10:52:00.306 1 foreman.py 90f343ab6cc2 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  218. CRITICAL 10:52:01.152 1 aiservice.py 90f343ab6cc2 Exception in one of the workers
  219. INFO 10:52:01.155 1 aiservice.py 5be92e2f3a93 Put batch for camera laptop request to queue, spend 0.001 sec
  220. INFO 10:52:05.870 84 aiservice.py 5be92e2f3a93 Start collecting batch for camera laptop, spend 4.716 sec
  221. INFO 10:52:05.905 1 aiservice.py 108bdd673493 (#2) Start processing batch #13, camera laptop, spend 5.627 sec
  222. INFO 10:52:05.911 1 command.py 108bdd673493 core.video_process_worker finished. Spend 0.005 sec. FPS 4402.698
  223. WARNING 10:52:05.912 1 foreman.py 108bdd673493 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  224. CRITICAL 10:52:06.948 1 aiservice.py 108bdd673493 Exception in one of the workers
  225. INFO 10:52:06.951 1 aiservice.py 33fb3677f6b6 Put batch for camera laptop request to queue, spend 0.001 sec
  226. INFO 10:52:11.482 84 aiservice.py 33fb3677f6b6 Start collecting batch for camera laptop, spend 4.532 sec
  227. INFO 10:52:11.501 1 aiservice.py 5be92e2f3a93 (#2) Start processing batch #14, camera laptop, spend 5.631 sec
  228. INFO 10:52:11.513 1 command.py 5be92e2f3a93 core.video_process_worker finished. Spend 0.011 sec. FPS 2138.451
  229. WARNING 10:52:11.514 1 foreman.py 5be92e2f3a93 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  230. CRITICAL 10:52:14.374 1 aiservice.py 5be92e2f3a93 Exception in one of the workers
  231. INFO 10:52:14.376 1 aiservice.py b2fd7adabeb9 Put batch for camera laptop request to queue, spend 0.001 sec
  232. INFO 10:52:17.081 84 aiservice.py b2fd7adabeb9 Start collecting batch for camera laptop, spend 2.706 sec
  233. INFO 10:52:17.105 1 aiservice.py 33fb3677f6b6 (#2) Start processing batch #15, camera laptop, spend 5.623 sec
  234. INFO 10:52:17.118 1 command.py 33fb3677f6b6 core.video_process_worker finished. Spend 0.012 sec. FPS 1931.005
  235. WARNING 10:52:17.119 1 foreman.py 33fb3677f6b6 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  236. CRITICAL 10:52:18.769 1 aiservice.py 33fb3677f6b6 Exception in one of the workers
  237. INFO 10:52:18.772 1 aiservice.py 08e7fdc79a06 Put batch for camera laptop request to queue, spend 0.001 sec
  238. INFO 10:52:22.670 84 aiservice.py 08e7fdc79a06 Start collecting batch for camera laptop, spend 3.899 sec
  239. INFO 10:52:22.711 1 aiservice.py b2fd7adabeb9 (#2) Start processing batch #16, camera laptop, spend 5.630 sec
  240. INFO 10:52:22.732 1 command.py b2fd7adabeb9 core.video_process_worker finished. Spend 0.020 sec. FPS 1215.315
  241. WARNING 10:52:22.734 1 foreman.py b2fd7adabeb9 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  242. CRITICAL 10:52:23.977 1 aiservice.py b2fd7adabeb9 Exception in one of the workers
  243. INFO 10:52:23.981 1 aiservice.py 0e940e1b1b4f Put batch for camera laptop request to queue, spend 0.001 sec
  244. INFO 10:52:28.280 84 aiservice.py 0e940e1b1b4f Start collecting batch for camera laptop, spend 4.300 sec
  245. INFO 10:52:28.324 1 aiservice.py 08e7fdc79a06 (#2) Start processing batch #17, camera laptop, spend 5.654 sec
  246. INFO 10:52:28.348 1 command.py 08e7fdc79a06 core.video_process_worker finished. Spend 0.024 sec. FPS 1019.489
  247. WARNING 10:52:28.351 1 foreman.py 08e7fdc79a06 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  248. CRITICAL 10:52:29.169 1 aiservice.py 08e7fdc79a06 Exception in one of the workers
  249. INFO 10:52:29.172 1 aiservice.py 1b507be7f5b9 Put batch for camera laptop request to queue, spend 0.002 sec
  250. INFO 10:52:33.879 84 aiservice.py 1b507be7f5b9 Start collecting batch for camera laptop, spend 4.709 sec
  251. INFO 10:52:33.923 1 aiservice.py 0e940e1b1b4f (#2) Start processing batch #18, camera laptop, spend 5.643 sec
  252. INFO 10:52:33.948 1 command.py 0e940e1b1b4f core.video_process_worker finished. Spend 0.024 sec. FPS 1008.216
  253. WARNING 10:52:33.949 1 foreman.py 0e940e1b1b4f Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  254. CRITICAL 10:52:34.832 1 aiservice.py 0e940e1b1b4f Exception in one of the workers
  255. INFO 10:52:34.834 1 aiservice.py 65c2bfe54399 Put batch for camera laptop request to queue, spend 0.001 sec
  256. INFO 10:52:39.478 84 aiservice.py 65c2bfe54399 Start collecting batch for camera laptop, spend 4.645 sec
  257. INFO 10:52:39.494 1 aiservice.py 434fe6cee677 Put batch for camera laptop request to queue, spend 0.004 sec
  258. INFO 10:52:39.499 1 aiservice.py 1b507be7f5b9 (#2) Start processing batch #19, camera laptop, spend 5.620 sec
  259. INFO 10:52:39.516 1 command.py 1b507be7f5b9 core.video_process_worker finished. Spend 0.016 sec. FPS 1484.337
  260. WARNING 10:52:39.517 1 foreman.py 1b507be7f5b9 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  261. CRITICAL 10:52:40.473 1 aiservice.py 1b507be7f5b9 Exception in one of the workers
  262. INFO 10:52:45.070 84 aiservice.py 434fe6cee677 Start collecting batch for camera laptop, spend 5.581 sec
  263. INFO 10:52:45.125 1 aiservice.py a5650f4be029 Put batch for camera laptop request to queue, spend 0.001 sec
  264. INFO 10:52:45.130 1 aiservice.py 65c2bfe54399 (#2) Start processing batch #20, camera laptop, spend 5.652 sec
  265. INFO 10:52:45.139 1 command.py 65c2bfe54399 core.video_process_worker finished. Spend 0.008 sec. FPS 2851.328
  266. WARNING 10:52:45.139 1 foreman.py 65c2bfe54399 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  267. CRITICAL 10:52:46.675 1 aiservice.py 65c2bfe54399 Exception in one of the workers
  268. WARNING 10:52:47.634 1 conclusion.py ------------ HACK!!! Call anomaly retrain from main loop in conclusion!
  269. INFO 10:52:47.642 251 AnomalyService.py ------------ Start for retrain
  270. INFO 10:52:48.360 251 MLAnomalityRecognizer.py ------------ ML anomaly detector weights update: APPROVED
  271. INFO 10:52:48.795 251 BaseAnomalyTrainer.py ------------ MLAnomalyTrainer train with 1.0
  272. INFO 10:52:48.806 251 BaseAnomalyTrainer.py ------------ StatisticAnomalyTrainer train with 0.22727272727272724
  273. INFO 10:52:48.806 251 AnomalyService.py ------------ Retrain finished 1.1637(1.1637) sec for 1/0 c/f; 0.86/0.00 fps c/f
  274. WARNING 10:52:50.142 1 command.py ------------ File modified! Restart core.anomality.AnomalyWorker
  275. INFO 10:52:50.144 214 command.py ------------ Stop core.anomality.AnomalyWorker thread
  276. INFO 10:52:50.192 287 command.py ------------ Loading module core.anomality.AnomalyWorker ...
  277. INFO 10:52:50.495 287 gpu.py ------------ Set gpu memory to 768
  278. INFO 10:52:50.497 287 command.py ------------ Loading module core.anomality.AnomalyWorker 0.305 sec ...OK
  279. INFO 10:52:50.680 84 aiservice.py a5650f4be029 Start collecting batch for camera laptop, spend 5.556 sec
  280. INFO 10:52:50.726 1 aiservice.py 1de02dc4d8f9 Put batch for camera laptop request to queue, spend 0.006 sec
  281. INFO 10:52:50.731 1 aiservice.py 434fe6cee677 (#2) Start processing batch #21, camera laptop, spend 5.660 sec
  282. INFO 10:52:50.749 1 command.py 434fe6cee677 core.video_process_worker finished. Spend 0.017 sec. FPS 1404.088
  283. WARNING 10:52:50.750 1 foreman.py 434fe6cee677 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  284. CRITICAL 10:52:52.879 1 aiservice.py 434fe6cee677 Exception in one of the workers
  285. INFO 10:52:56.282 84 aiservice.py 1de02dc4d8f9 Start collecting batch for camera laptop, spend 5.562 sec
  286. INFO 10:52:56.325 1 aiservice.py aac03ecc9ca4 Put batch for camera laptop request to queue, spend 0.005 sec
  287. INFO 10:52:56.329 1 aiservice.py a5650f4be029 (#2) Start processing batch #22, camera laptop, spend 5.649 sec
  288. INFO 10:52:56.347 1 command.py a5650f4be029 core.video_process_worker finished. Spend 0.017 sec. FPS 1397.383
  289. WARNING 10:52:56.349 1 foreman.py a5650f4be029 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  290. CRITICAL 10:52:57.245 1 aiservice.py a5650f4be029 Exception in one of the workers
  291. INFO 10:53:01.878 84 aiservice.py aac03ecc9ca4 Start collecting batch for camera laptop, spend 5.557 sec
  292. INFO 10:53:01.903 1 aiservice.py 77896fbeb9bf Put batch for camera laptop request to queue, spend 0.004 sec
  293. INFO 10:53:01.909 1 aiservice.py 1de02dc4d8f9 (#2) Start processing batch #23, camera laptop, spend 5.627 sec
  294. INFO 10:53:01.925 1 command.py 1de02dc4d8f9 core.video_process_worker finished. Spend 0.015 sec. FPS 1622.215
  295. WARNING 10:53:01.926 1 foreman.py 1de02dc4d8f9 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  296. CRITICAL 10:53:03.818 1 aiservice.py 1de02dc4d8f9 Exception in one of the workers
  297. INFO 10:53:07.481 84 aiservice.py 77896fbeb9bf Start collecting batch for camera laptop, spend 5.582 sec
  298. INFO 10:53:07.562 1 aiservice.py aac03ecc9ca4 (#2) Start processing batch #24, camera laptop, spend 5.683 sec
  299. INFO 10:53:07.586 1 command.py aac03ecc9ca4 core.video_process_worker finished. Spend 0.023 sec. FPS 1054.154
  300. WARNING 10:53:07.587 1 foreman.py aac03ecc9ca4 Pipe has unfinished command core.anomality.AnomalyWorker(SeparateProcessCommand) that can not be done. Required {'treaded_video', 'track_frames'}, Have dict_keys(['debug_info', 'images_time', 'treaded_video', 'image_idx'])
  301. CRITICAL 10:53:12.220 1 aiservice.py aac03ecc9ca4 Exception in one of the workers
  302. INFO 10:53:12.223 1 aiservice.py e25040724574 Put batch for camera laptop request to queue, spend 0.001 sec
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!