API tools faq
paste
mr_radioactive

Untitled

mr_radioactive
Dec 17th, 2022
184
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 76.11 KB | None | 0 0
raw download clone embed print report
  1. PS C:\Users\varun> WARNING: sun.reflect.Reflection.getCallerClass is not supported. This will impact performance.
  2. 2022-12-17T12:06:10,522 [INFO ] main org.pytorch.serve.servingsdk.impl.PluginsManager - Loading snapshot serializer plugin...
  3. 2022-12-17T12:06:10,549 [INFO ] main org.pytorch.serve.servingsdk.impl.PluginsManager - Initializing plugins manager...
  4. 2022-12-17T12:06:10,778 [INFO ] main org.pytorch.serve.ModelServer -
  5. Torchserve version: 0.7.0
  6. TS Home: C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages
  7. Current directory: C:\Users\varun
  8. Temp directory: C:\Users\varun\AppData\Local\Temp
  9. Metrics config path: C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml
  10. Number of GPUs: 0
  11. Number of CPUs: 12
  12. Max heap size: 4018 M
  13. Python executable: C:\Users\varun\AppData\Local\Programs\Python\Python310\python.exe
  14. Config file: logs\config\20221217115823053-startup.cfg
  15. Inference address: http://127.0.0.1:8080
  16. Management address: http://127.0.0.1:8081
  17. Metrics address: http://127.0.0.1:8082
  18. Model Store: C:\Users\varun\model_store
  19. Initial Models: bert=bert.mar
  20. Log dir: C:\Users\varun\logs
  21. Metrics dir: C:\Users\varun\logs
  22. Netty threads: 0
  23. Netty client threads: 0
  24. Default workers per model: 12
  25. Blacklist Regex: N/A
  26. Maximum Response Size: 6553500
  27. Maximum Request Size: 6553500
  28. Limit Maximum Image Pixels: true
  29. Prefer direct buffer: false
  30. Allowed Urls: [file://.*|http(s)?://.*]
  31. Custom python dependency for model allowed: false
  32. Metrics report format: prometheus
  33. Enable metrics API: true
  34. Workflow Store: C:\Users\varun\model_store
  35. Model config: N/A
  36. 2022-12-17T12:06:10,783 [INFO ] main org.pytorch.serve.snapshot.SnapshotManager - Started restoring models from snapshot {
  37. "name": "20221217115823053-startup.cfg",
  38. "modelCount": 1,
  39. "created": 1671258503053,
  40. "models": {
  41. "bert": {
  42. "1.0": {
  43. "defaultVersion": true,
  44. "marName": "bert.mar",
  45. "minWorkers": 12,
  46. "maxWorkers": 12,
  47. "batchSize": 1,
  48. "maxBatchDelay": 100,
  49. "responseTimeout": 120
  50. }
  51. }
  52. }
  53. }
  54. 2022-12-17T12:06:10,790 [INFO ] main org.pytorch.serve.snapshot.SnapshotManager - Validating snapshot 20221217115823053-startup.cfg
  55. 2022-12-17T12:06:10,791 [INFO ] main org.pytorch.serve.snapshot.SnapshotManager - Snapshot 20221217115823053-startup.cfg validated successfully
  56. 2022-12-17T12:06:15,993 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Adding new version 1.0 for model bert
  57. 2022-12-17T12:06:15,993 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Setting default version to 1.0 for model bert
  58. 2022-12-17T12:06:15,993 [DEBUG] main org.pytorch.serve.wlm.ModelVersionedRefs - Setting default version to 1.0 for model bert
  59. 2022-12-17T12:06:15,994 [INFO ] main org.pytorch.serve.wlm.ModelManager - Model bert loaded.
  60. 2022-12-17T12:06:15,994 [DEBUG] main org.pytorch.serve.wlm.ModelManager - updateModel: bert, count: 12
  61. 2022-12-17T12:06:16,004 [INFO ] main org.pytorch.serve.ModelServer - Initialize Inference server with: NioServerSocketChannel.
  62. 2022-12-17T12:06:16,008 [DEBUG] W-9008-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [C:\Users\varun\AppData\Local\Programs\Python\Python310\python.exe, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py, --sock-type, tcp, --port, 9008, --metrics-config, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml]
  63. 2022-12-17T12:06:16,008 [DEBUG] W-9010-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [C:\Users\varun\AppData\Local\Programs\Python\Python310\python.exe, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py, --sock-type, tcp, --port, 9010, --metrics-config, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml]
  64. 2022-12-17T12:06:16,008 [DEBUG] W-9001-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [C:\Users\varun\AppData\Local\Programs\Python\Python310\python.exe, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py, --sock-type, tcp, --port, 9001, --metrics-config, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml]
  65. 2022-12-17T12:06:16,009 [DEBUG] W-9006-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [C:\Users\varun\AppData\Local\Programs\Python\Python310\python.exe, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py, --sock-type, tcp, --port, 9006, --metrics-config, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml]
  66. 2022-12-17T12:06:16,008 [DEBUG] W-9000-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [C:\Users\varun\AppData\Local\Programs\Python\Python310\python.exe, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py, --sock-type, tcp, --port, 9000, --metrics-config, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml]
  67. 2022-12-17T12:06:16,008 [DEBUG] W-9004-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [C:\Users\varun\AppData\Local\Programs\Python\Python310\python.exe, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py, --sock-type, tcp, --port, 9004, --metrics-config, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml]
  68. 2022-12-17T12:06:16,008 [DEBUG] W-9003-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [C:\Users\varun\AppData\Local\Programs\Python\Python310\python.exe, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py, --sock-type, tcp, --port, 9003, --metrics-config, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml]
  69. 2022-12-17T12:06:16,008 [DEBUG] W-9009-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [C:\Users\varun\AppData\Local\Programs\Python\Python310\python.exe, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py, --sock-type, tcp, --port, 9009, --metrics-config, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml]
  70. 2022-12-17T12:06:16,008 [DEBUG] W-9005-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [C:\Users\varun\AppData\Local\Programs\Python\Python310\python.exe, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py, --sock-type, tcp, --port, 9005, --metrics-config, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml]
  71. 2022-12-17T12:06:16,008 [DEBUG] W-9007-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [C:\Users\varun\AppData\Local\Programs\Python\Python310\python.exe, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py, --sock-type, tcp, --port, 9007, --metrics-config, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml]
  72. 2022-12-17T12:06:16,008 [DEBUG] W-9011-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [C:\Users\varun\AppData\Local\Programs\Python\Python310\python.exe, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py, --sock-type, tcp, --port, 9011, --metrics-config, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml]
  73. 2022-12-17T12:06:16,008 [DEBUG] W-9002-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - Worker cmdline: [C:\Users\varun\AppData\Local\Programs\Python\Python310\python.exe, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py, --sock-type, tcp, --port, 9002, --metrics-config, C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml]
  74. 2022-12-17T12:06:16,298 [INFO ] W-9008-bert_1.0-stdout MODEL_LOG - Listening on port: None
  75. 2022-12-17T12:06:16,303 [INFO ] W-9008-bert_1.0-stdout MODEL_LOG - Successfully loaded C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml.
  76. 2022-12-17T12:06:16,304 [INFO ] W-9008-bert_1.0-stdout MODEL_LOG - [PID]17944
  77. 2022-12-17T12:06:16,305 [INFO ] W-9008-bert_1.0-stdout MODEL_LOG - Torch worker started.
  78. 2022-12-17T12:06:16,305 [DEBUG] W-9008-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9008-bert_1.0 State change null -> WORKER_STARTED
  79. 2022-12-17T12:06:16,306 [INFO ] W-9008-bert_1.0-stdout MODEL_LOG - Python runtime: 3.10.8
  80. 2022-12-17T12:06:16,313 [INFO ] W-9008-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Connecting to: /127.0.0.1:9008
  81. 2022-12-17T12:06:16,318 [INFO ] W-9002-bert_1.0-stdout MODEL_LOG - Listening on port: None
  82. 2022-12-17T12:06:16,320 [INFO ] W-9011-bert_1.0-stdout MODEL_LOG - Listening on port: None
  83. 2022-12-17T12:06:16,324 [INFO ] W-9002-bert_1.0-stdout MODEL_LOG - Successfully loaded C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml.
  84. 2022-12-17T12:06:16,324 [INFO ] W-9002-bert_1.0-stdout MODEL_LOG - [PID]18564
  85. 2022-12-17T12:06:16,324 [INFO ] W-9011-bert_1.0-stdout MODEL_LOG - Successfully loaded C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml.
  86. 2022-12-17T12:06:16,326 [DEBUG] W-9002-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9002-bert_1.0 State change null -> WORKER_STARTED
  87. 2022-12-17T12:06:16,326 [INFO ] W-9002-bert_1.0-stdout MODEL_LOG - Torch worker started.
  88. 2022-12-17T12:06:16,327 [INFO ] W-9011-bert_1.0-stdout MODEL_LOG - [PID]9012
  89. 2022-12-17T12:06:16,327 [INFO ] W-9002-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Connecting to: /127.0.0.1:9002
  90. 2022-12-17T12:06:16,326 [INFO ] W-9002-bert_1.0-stdout MODEL_LOG - Python runtime: 3.10.8
  91. 2022-12-17T12:06:16,329 [DEBUG] W-9011-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9011-bert_1.0 State change null -> WORKER_STARTED
  92. 2022-12-17T12:06:16,330 [INFO ] W-9011-bert_1.0-stdout MODEL_LOG - Torch worker started.
  93. 2022-12-17T12:06:16,330 [INFO ] W-9011-bert_1.0-stdout MODEL_LOG - Python runtime: 3.10.8
  94. 2022-12-17T12:06:16,330 [INFO ] W-9011-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Connecting to: /127.0.0.1:9011
  95. 2022-12-17T12:06:16,332 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - Listening on port: None
  96. 2022-12-17T12:06:16,338 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - Successfully loaded C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml.
  97. 2022-12-17T12:06:16,339 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - [PID]19204
  98. 2022-12-17T12:06:16,340 [INFO ] W-9007-bert_1.0-stdout MODEL_LOG - Listening on port: None
  99. 2022-12-17T12:06:16,339 [INFO ] W-9003-bert_1.0-stdout MODEL_LOG - Listening on port: None
  100. 2022-12-17T12:06:16,340 [DEBUG] W-9009-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9009-bert_1.0 State change null -> WORKER_STARTED
  101. 2022-12-17T12:06:16,340 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - Torch worker started.
  102. 2022-12-17T12:06:16,341 [INFO ] W-9009-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Connecting to: /127.0.0.1:9009
  103. 2022-12-17T12:06:16,341 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - Python runtime: 3.10.8
  104. 2022-12-17T12:06:16,345 [INFO ] W-9007-bert_1.0-stdout MODEL_LOG - Successfully loaded C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml.
  105. 2022-12-17T12:06:16,345 [INFO ] W-9003-bert_1.0-stdout MODEL_LOG - Successfully loaded C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml.
  106. 2022-12-17T12:06:16,347 [INFO ] W-9007-bert_1.0-stdout MODEL_LOG - [PID]13056
  107. 2022-12-17T12:06:16,347 [INFO ] W-9003-bert_1.0-stdout MODEL_LOG - [PID]18316
  108. 2022-12-17T12:06:16,348 [DEBUG] W-9007-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9007-bert_1.0 State change null -> WORKER_STARTED
  109. 2022-12-17T12:06:16,348 [INFO ] W-9007-bert_1.0-stdout MODEL_LOG - Torch worker started.
  110. 2022-12-17T12:06:16,348 [DEBUG] W-9003-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9003-bert_1.0 State change null -> WORKER_STARTED
  111. 2022-12-17T12:06:16,348 [INFO ] W-9003-bert_1.0-stdout MODEL_LOG - Torch worker started.
  112. 2022-12-17T12:06:16,348 [INFO ] W-9007-bert_1.0-stdout MODEL_LOG - Python runtime: 3.10.8
  113. 2022-12-17T12:06:16,348 [INFO ] W-9007-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Connecting to: /127.0.0.1:9007
  114. 2022-12-17T12:06:16,348 [INFO ] W-9003-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Connecting to: /127.0.0.1:9003
  115. 2022-12-17T12:06:16,349 [INFO ] W-9003-bert_1.0-stdout MODEL_LOG - Python runtime: 3.10.8
  116. 2022-12-17T12:06:16,351 [INFO ] W-9006-bert_1.0-stdout MODEL_LOG - Listening on port: None
  117. 2022-12-17T12:06:16,352 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - Listening on port: None
  118. 2022-12-17T12:06:16,356 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - Successfully loaded C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml.
  119. 2022-12-17T12:06:16,356 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - [PID]19908
  120. 2022-12-17T12:06:16,356 [INFO ] W-9006-bert_1.0-stdout MODEL_LOG - Successfully loaded C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml.
  121. 2022-12-17T12:06:16,357 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - Torch worker started.
  122. 2022-12-17T12:06:16,357 [DEBUG] W-9005-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9005-bert_1.0 State change null -> WORKER_STARTED
  123. 2022-12-17T12:06:16,357 [INFO ] W-9006-bert_1.0-stdout MODEL_LOG - [PID]20220
  124. 2022-12-17T12:06:16,357 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - Python runtime: 3.10.8
  125. 2022-12-17T12:06:16,357 [INFO ] W-9005-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Connecting to: /127.0.0.1:9005
  126. 2022-12-17T12:06:16,357 [INFO ] W-9006-bert_1.0-stdout MODEL_LOG - Torch worker started.
  127. 2022-12-17T12:06:16,357 [DEBUG] W-9006-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9006-bert_1.0 State change null -> WORKER_STARTED
  128. 2022-12-17T12:06:16,358 [INFO ] W-9006-bert_1.0-stdout MODEL_LOG - Python runtime: 3.10.8
  129. 2022-12-17T12:06:16,358 [INFO ] W-9006-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Connecting to: /127.0.0.1:9006
  130. 2022-12-17T12:06:16,358 [INFO ] W-9010-bert_1.0-stdout MODEL_LOG - Listening on port: None
  131. 2022-12-17T12:06:16,358 [INFO ] W-9001-bert_1.0-stdout MODEL_LOG - Listening on port: None
  132. 2022-12-17T12:06:16,363 [INFO ] W-9001-bert_1.0-stdout MODEL_LOG - Successfully loaded C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml.
  133. 2022-12-17T12:06:16,364 [INFO ] W-9010-bert_1.0-stdout MODEL_LOG - Successfully loaded C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml.
  134. 2022-12-17T12:06:16,364 [INFO ] W-9001-bert_1.0-stdout MODEL_LOG - [PID]5712
  135. 2022-12-17T12:06:16,365 [INFO ] W-9001-bert_1.0-stdout MODEL_LOG - Torch worker started.
  136. 2022-12-17T12:06:16,365 [DEBUG] W-9001-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9001-bert_1.0 State change null -> WORKER_STARTED
  137. 2022-12-17T12:06:16,365 [INFO ] W-9010-bert_1.0-stdout MODEL_LOG - [PID]14684
  138. 2022-12-17T12:06:16,365 [INFO ] W-9001-bert_1.0-stdout MODEL_LOG - Python runtime: 3.10.8
  139. 2022-12-17T12:06:16,365 [INFO ] W-9001-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Connecting to: /127.0.0.1:9001
  140. 2022-12-17T12:06:16,365 [INFO ] W-9010-bert_1.0-stdout MODEL_LOG - Torch worker started.
  141. 2022-12-17T12:06:16,365 [DEBUG] W-9010-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9010-bert_1.0 State change null -> WORKER_STARTED
  142. 2022-12-17T12:06:16,365 [INFO ] W-9010-bert_1.0-stdout MODEL_LOG - Python runtime: 3.10.8
  143. 2022-12-17T12:06:16,365 [INFO ] W-9010-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Connecting to: /127.0.0.1:9010
  144. 2022-12-17T12:06:16,371 [INFO ] W-9000-bert_1.0-stdout MODEL_LOG - Listening on port: None
  145. 2022-12-17T12:06:16,375 [INFO ] W-9000-bert_1.0-stdout MODEL_LOG - Successfully loaded C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml.
  146. 2022-12-17T12:06:16,375 [INFO ] W-9000-bert_1.0-stdout MODEL_LOG - [PID]924
  147. 2022-12-17T12:06:16,375 [INFO ] W-9000-bert_1.0-stdout MODEL_LOG - Torch worker started.
  148. 2022-12-17T12:06:16,375 [DEBUG] W-9000-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9000-bert_1.0 State change null -> WORKER_STARTED
  149. 2022-12-17T12:06:16,376 [INFO ] W-9000-bert_1.0-stdout MODEL_LOG - Python runtime: 3.10.8
  150. 2022-12-17T12:06:16,376 [INFO ] W-9000-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Connecting to: /127.0.0.1:9000
  151. 2022-12-17T12:06:16,376 [INFO ] W-9004-bert_1.0-stdout MODEL_LOG - Listening on port: None
  152. 2022-12-17T12:06:16,379 [INFO ] W-9004-bert_1.0-stdout MODEL_LOG - Successfully loaded C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages/ts/configs/metrics.yaml.
  153. 2022-12-17T12:06:16,379 [INFO ] W-9004-bert_1.0-stdout MODEL_LOG - [PID]8360
  154. 2022-12-17T12:06:16,379 [INFO ] W-9004-bert_1.0-stdout MODEL_LOG - Torch worker started.
  155. 2022-12-17T12:06:16,379 [DEBUG] W-9004-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9004-bert_1.0 State change null -> WORKER_STARTED
  156. 2022-12-17T12:06:16,381 [INFO ] W-9004-bert_1.0-stdout MODEL_LOG - Python runtime: 3.10.8
  157. 2022-12-17T12:06:16,381 [INFO ] W-9004-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Connecting to: /127.0.0.1:9004
  158. 2022-12-17T12:06:16,593 [INFO ] main org.pytorch.serve.ModelServer - Inference API bind to: http://127.0.0.1:8080
  159. 2022-12-17T12:06:16,593 [INFO ] main org.pytorch.serve.ModelServer - Initialize Management server with: NioServerSocketChannel.
  160. 2022-12-17T12:06:16,596 [INFO ] W-9004-bert_1.0-stdout MODEL_LOG - Connection accepted: ('127.0.0.1', 9004).
  161. 2022-12-17T12:06:16,596 [INFO ] W-9011-bert_1.0-stdout MODEL_LOG - Connection accepted: ('127.0.0.1', 9011).
  162. 2022-12-17T12:06:16,596 [INFO ] main org.pytorch.serve.ModelServer - Management API bind to: http://127.0.0.1:8081
  163. 2022-12-17T12:06:16,596 [INFO ] W-9006-bert_1.0-stdout MODEL_LOG - Connection accepted: ('127.0.0.1', 9006).
  164. 2022-12-17T12:06:16,596 [INFO ] W-9000-bert_1.0-stdout MODEL_LOG - Connection accepted: ('127.0.0.1', 9000).
  165. 2022-12-17T12:06:16,596 [INFO ] W-9007-bert_1.0-stdout MODEL_LOG - Connection accepted: ('127.0.0.1', 9007).
  166. 2022-12-17T12:06:16,596 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - Connection accepted: ('127.0.0.1', 9005).
  167. 2022-12-17T12:06:16,598 [INFO ] W-9010-bert_1.0-stdout MODEL_LOG - Connection accepted: ('127.0.0.1', 9010).
  168. 2022-12-17T12:06:16,596 [INFO ] W-9002-bert_1.0-stdout MODEL_LOG - Connection accepted: ('127.0.0.1', 9002).
  169. 2022-12-17T12:06:16,596 [INFO ] W-9001-bert_1.0-stdout MODEL_LOG - Connection accepted: ('127.0.0.1', 9001).
  170. 2022-12-17T12:06:16,598 [INFO ] main org.pytorch.serve.ModelServer - Initialize Metrics server with: NioServerSocketChannel.
  171. 2022-12-17T12:06:16,596 [INFO ] W-9008-bert_1.0-stdout MODEL_LOG - Connection accepted: ('127.0.0.1', 9008).
  172. 2022-12-17T12:06:16,596 [INFO ] W-9003-bert_1.0-stdout MODEL_LOG - Connection accepted: ('127.0.0.1', 9003).
  173. 2022-12-17T12:06:16,596 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - Connection accepted: ('127.0.0.1', 9009).
  174. 2022-12-17T12:06:16,600 [INFO ] main org.pytorch.serve.ModelServer - Metrics API bind to: http://127.0.0.1:8082
  175. 2022-12-17T12:06:16,602 [INFO ] W-9006-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Flushing req. to backend at: 1671258976602
  176. 2022-12-17T12:06:16,603 [INFO ] W-9001-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Flushing req. to backend at: 1671258976603
  177. 2022-12-17T12:06:16,602 [INFO ] W-9000-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Flushing req. to backend at: 1671258976602
  178. 2022-12-17T12:06:16,603 [INFO ] W-9003-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Flushing req. to backend at: 1671258976603
  179. 2022-12-17T12:06:16,603 [INFO ] W-9008-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Flushing req. to backend at: 1671258976603
  180. 2022-12-17T12:06:16,603 [INFO ] W-9009-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Flushing req. to backend at: 1671258976603
  181. 2022-12-17T12:06:16,603 [INFO ] W-9004-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Flushing req. to backend at: 1671258976603
  182. 2022-12-17T12:06:16,602 [INFO ] W-9010-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Flushing req. to backend at: 1671258976602
  183. 2022-12-17T12:06:16,603 [INFO ] W-9002-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Flushing req. to backend at: 1671258976603
  184. 2022-12-17T12:06:16,602 [INFO ] W-9011-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Flushing req. to backend at: 1671258976602
  185. 2022-12-17T12:06:16,603 [INFO ] W-9005-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Flushing req. to backend at: 1671258976603
  186. 2022-12-17T12:06:16,603 [INFO ] W-9007-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Flushing req. to backend at: 1671258976603
  187. 2022-12-17T12:06:16,684 [INFO ] W-9003-bert_1.0-stdout MODEL_LOG - model_name: bert, batchSize: 1
  188. 2022-12-17T12:06:16,687 [INFO ] W-9010-bert_1.0-stdout MODEL_LOG - model_name: bert, batchSize: 1
  189. 2022-12-17T12:06:16,686 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - model_name: bert, batchSize: 1
  190. 2022-12-17T12:06:16,688 [INFO ] W-9002-bert_1.0-stdout MODEL_LOG - model_name: bert, batchSize: 1
  191. 2022-12-17T12:06:16,686 [INFO ] W-9008-bert_1.0-stdout MODEL_LOG - model_name: bert, batchSize: 1
  192. 2022-12-17T12:06:16,684 [INFO ] W-9011-bert_1.0-stdout MODEL_LOG - model_name: bert, batchSize: 1
  193. 2022-12-17T12:06:16,684 [INFO ] W-9004-bert_1.0-stdout MODEL_LOG - model_name: bert, batchSize: 1
  194. 2022-12-17T12:06:16,684 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - model_name: bert, batchSize: 1
  195. 2022-12-17T12:06:16,688 [INFO ] W-9006-bert_1.0-stdout MODEL_LOG - model_name: bert, batchSize: 1
  196. 2022-12-17T12:06:16,690 [INFO ] W-9000-bert_1.0-stdout MODEL_LOG - model_name: bert, batchSize: 1
  197. 2022-12-17T12:06:16,694 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - Backend worker process died.
  198. 2022-12-17T12:06:16,694 [INFO ] W-9010-bert_1.0-stdout MODEL_LOG - Backend worker process died.
  199. 2022-12-17T12:06:16,695 [INFO ] W-9000-bert_1.0-stdout MODEL_LOG - Backend worker process died.
  200. 2022-12-17T12:06:16,695 [INFO ] W-9001-bert_1.0-stdout MODEL_LOG - model_name: bert, batchSize: 1
  201. 2022-12-17T12:06:16,695 [INFO ] W-9000-bert_1.0-stdout MODEL_LOG - Traceback (most recent call last):
  202. 2022-12-17T12:06:16,694 [INFO ] W-9003-bert_1.0-stdout MODEL_LOG - Backend worker process died.
  203. 2022-12-17T12:06:16,701 [INFO ] W-9002-bert_1.0-stdout MODEL_LOG - Backend worker process died.
  204. 2022-12-17T12:06:16,728 [INFO ] W-9002-bert_1.0-stdout MODEL_LOG - Traceback (most recent call last):
  205. 2022-12-17T12:06:16,695 [INFO ] W-9004-bert_1.0-stdout MODEL_LOG - Backend worker process died.
  206. 2022-12-17T12:06:16,695 [INFO ] W-9010-bert_1.0-stdout MODEL_LOG - Traceback (most recent call last):
  207. 2022-12-17T12:06:16,695 [INFO ] W-9006-bert_1.0-stdout MODEL_LOG - Backend worker process died.
  208. 2022-12-17T12:06:16,695 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - Backend worker process died.
  209. 2022-12-17T12:06:16,694 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - Traceback (most recent call last):
  210. 2022-12-17T12:06:16,730 [INFO ] W-9004-bert_1.0-stdout MODEL_LOG - Traceback (most recent call last):
  211. 2022-12-17T12:06:16,731 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - Traceback (most recent call last):
  212. 2022-12-17T12:06:16,729 [INFO ] W-9002-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 221, in <module>
  213. 2022-12-17T12:06:16,725 [INFO ] nioEventLoopGroup-5-2 org.pytorch.serve.wlm.WorkerThread - 9001 Worker disconnected. WORKER_STARTED
  214. 2022-12-17T12:06:16,726 [INFO ] nioEventLoopGroup-5-8 org.pytorch.serve.wlm.WorkerThread - 9007 Worker disconnected. WORKER_STARTED
  215. 2022-12-17T12:06:16,725 [INFO ] nioEventLoopGroup-5-6 org.pytorch.serve.wlm.WorkerThread - 9000 Worker disconnected. WORKER_STARTED
  216. 2022-12-17T12:06:16,725 [INFO ] nioEventLoopGroup-5-11 org.pytorch.serve.wlm.WorkerThread - 9011 Worker disconnected. WORKER_STARTED
  217. 2022-12-17T12:06:16,725 [INFO ] nioEventLoopGroup-5-7 org.pytorch.serve.wlm.WorkerThread - 9009 Worker disconnected. WORKER_STARTED
  218. 2022-12-17T12:06:16,725 [INFO ] nioEventLoopGroup-5-4 org.pytorch.serve.wlm.WorkerThread - 9003 Worker disconnected. WORKER_STARTED
  219. 2022-12-17T12:06:16,725 [INFO ] nioEventLoopGroup-5-5 org.pytorch.serve.wlm.WorkerThread - 9010 Worker disconnected. WORKER_STARTED
  220. 2022-12-17T12:06:16,725 [INFO ] nioEventLoopGroup-5-9 org.pytorch.serve.wlm.WorkerThread - 9006 Worker disconnected. WORKER_STARTED
  221. 2022-12-17T12:06:16,725 [INFO ] nioEventLoopGroup-5-10 org.pytorch.serve.wlm.WorkerThread - 9002 Worker disconnected. WORKER_STARTED
  222. 2022-12-17T12:06:16,726 [INFO ] W-9003-bert_1.0-stdout MODEL_LOG - Traceback (most recent call last):
  223. 2022-12-17T12:06:16,725 [INFO ] nioEventLoopGroup-5-1 org.pytorch.serve.wlm.WorkerThread - 9005 Worker disconnected. WORKER_STARTED
  224. 2022-12-17T12:06:16,725 [INFO ] nioEventLoopGroup-5-3 org.pytorch.serve.wlm.WorkerThread - 9004 Worker disconnected. WORKER_STARTED
  225. 2022-12-17T12:06:16,725 [INFO ] W-9011-bert_1.0-stdout MODEL_LOG - Backend worker process died.
  226. 2022-12-17T12:06:16,725 [INFO ] nioEventLoopGroup-5-12 org.pytorch.serve.wlm.WorkerThread - 9008 Worker disconnected. WORKER_STARTED
  227. 2022-12-17T12:06:16,702 [INFO ] W-9007-bert_1.0-stdout MODEL_LOG - model_name: bert, batchSize: 1
  228. 2022-12-17T12:06:16,701 [INFO ] W-9001-bert_1.0-stdout MODEL_LOG - Backend worker process died.
  229. 2022-12-17T12:06:16,701 [INFO ] W-9008-bert_1.0-stdout MODEL_LOG - Backend worker process died.
  230. 2022-12-17T12:06:16,696 [INFO ] W-9000-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 221, in <module>
  231. 2022-12-17T12:06:16,740 [INFO ] W-9007-bert_1.0-stdout MODEL_LOG - Backend worker process died.
  232. 2022-12-17T12:06:16,739 [INFO ] W-9011-bert_1.0-stdout MODEL_LOG - Traceback (most recent call last):
  233. 2022-12-17T12:06:16,739 [DEBUG] W-9008-bert_1.0 org.pytorch.serve.wlm.WorkerThread - System state is : WORKER_STARTED
  234. 2022-12-17T12:06:16,738 [DEBUG] W-9004-bert_1.0 org.pytorch.serve.wlm.WorkerThread - System state is : WORKER_STARTED
  235. 2022-12-17T12:06:16,738 [DEBUG] W-9005-bert_1.0 org.pytorch.serve.wlm.WorkerThread - System state is : WORKER_STARTED
  236. 2022-12-17T12:06:16,738 [DEBUG] W-9002-bert_1.0 org.pytorch.serve.wlm.WorkerThread - System state is : WORKER_STARTED
  237. 2022-12-17T12:06:16,737 [DEBUG] W-9006-bert_1.0 org.pytorch.serve.wlm.WorkerThread - System state is : WORKER_STARTED
  238. 2022-12-17T12:06:16,736 [INFO ] W-9010-bert_1.0-stderr org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9010-bert_1.0-stderr
  239. 2022-12-17T12:06:16,746 [INFO ] W-9009-bert_1.0-stderr org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9009-bert_1.0-stderr
  240. 2022-12-17T12:06:16,736 [INFO ] W-9006-bert_1.0-stderr org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9006-bert_1.0-stderr
  241. 2022-12-17T12:06:16,734 [INFO ] W-9005-bert_1.0-stderr org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9005-bert_1.0-stderr
  242. 2022-12-17T12:06:16,734 [DEBUG] W-9003-bert_1.0 org.pytorch.serve.wlm.WorkerThread - System state is : WORKER_STARTED
  243. 2022-12-17T12:06:16,733 [DEBUG] W-9011-bert_1.0 org.pytorch.serve.wlm.WorkerThread - System state is : WORKER_STARTED
  244. 2022-12-17T12:06:16,733 [DEBUG] W-9000-bert_1.0 org.pytorch.serve.wlm.WorkerThread - System state is : WORKER_STARTED
  245. 2022-12-17T12:06:16,732 [DEBUG] W-9001-bert_1.0 org.pytorch.serve.wlm.WorkerThread - System state is : WORKER_STARTED
  246. 2022-12-17T12:06:16,731 [INFO ] W-9010-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 221, in <module>
  247. 2022-12-17T12:06:16,731 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 221, in <module>
  248. 2022-12-17T12:06:16,731 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 221, in <module>
  249. 2022-12-17T12:06:16,730 [INFO ] W-9006-bert_1.0-stdout MODEL_LOG - Traceback (most recent call last):
  250. 2022-12-17T12:06:16,751 [INFO ] W-9010-bert_1.0-stdout MODEL_LOG - worker.run_server()
  251. 2022-12-17T12:06:16,751 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - worker.run_server()
  252. 2022-12-17T12:06:16,751 [DEBUG] W-9007-bert_1.0 org.pytorch.serve.wlm.WorkerThread - System state is : WORKER_STARTED
  253. 2022-12-17T12:06:16,751 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 189, in run_server
  254. 2022-12-17T12:06:16,750 [DEBUG] W-9009-bert_1.0 org.pytorch.serve.wlm.WorkerThread - System state is : WORKER_STARTED
  255. 2022-12-17T12:06:16,750 [DEBUG] W-9010-bert_1.0 org.pytorch.serve.wlm.WorkerThread - System state is : WORKER_STARTED
  256. 2022-12-17T12:06:16,747 [INFO ] W-9003-bert_1.0-stderr org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9003-bert_1.0-stderr
  257. 2022-12-17T12:06:16,746 [INFO ] W-9003-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 221, in <module>
  258. 2022-12-17T12:06:16,745 [INFO ] W-9000-bert_1.0-stderr org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9000-bert_1.0-stderr
  259. 2022-12-17T12:06:16,745 [INFO ] W-9011-bert_1.0-stderr org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9011-bert_1.0-stderr
  260. 2022-12-17T12:06:16,742 [INFO ] W-9011-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 221, in <module>
  261. 2022-12-17T12:06:16,742 [INFO ] W-9008-bert_1.0-stdout MODEL_LOG - Traceback (most recent call last):
  262. 2022-12-17T12:06:16,742 [INFO ] W-9007-bert_1.0-stdout MODEL_LOG - Traceback (most recent call last):
  263. 2022-12-17T12:06:16,741 [INFO ] W-9001-bert_1.0-stderr org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9001-bert_1.0-stderr
  264. 2022-12-17T12:06:16,741 [INFO ] W-9004-bert_1.0-stderr org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9004-bert_1.0-stderr
  265. 2022-12-17T12:06:16,741 [INFO ] W-9001-bert_1.0-stdout MODEL_LOG - Traceback (most recent call last):
  266. 2022-12-17T12:06:16,755 [INFO ] W-9007-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 221, in <module>
  267. 2022-12-17T12:06:16,755 [INFO ] W-9008-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 221, in <module>
  268. 2022-12-17T12:06:16,755 [INFO ] W-9011-bert_1.0-stdout MODEL_LOG - worker.run_server()
  269. 2022-12-17T12:06:16,754 [INFO ] W-9002-bert_1.0-stderr org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9002-bert_1.0-stderr
  270. 2022-12-17T12:06:16,754 [INFO ] W-9008-bert_1.0-stderr org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9008-bert_1.0-stderr
  271. 2022-12-17T12:06:16,753 [INFO ] W-9007-bert_1.0-stderr org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9007-bert_1.0-stderr
  272. 2022-12-17T12:06:16,752 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - self.handle_connection(cl_socket)
  273. 2022-12-17T12:06:16,757 [INFO ] W-9003-bert_1.0-stdout MODEL_LOG - worker.run_server()
  274. 2022-12-17T12:06:16,752 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - worker.run_server()
  275. 2022-12-17T12:06:16,751 [INFO ] W-9006-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 221, in <module>
  276. 2022-12-17T12:06:16,751 [INFO ] W-9002-bert_1.0-stdout MODEL_LOG - worker.run_server()
  277. 2022-12-17T12:06:16,751 [INFO ] W-9004-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 221, in <module>
  278. 2022-12-17T12:06:16,758 [INFO ] W-9002-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 189, in run_server
  279. 2022-12-17T12:06:16,758 [INFO ] W-9004-bert_1.0-stdout MODEL_LOG - worker.run_server()
  280. 2022-12-17T12:06:16,757 [INFO ] W-9006-bert_1.0-stdout MODEL_LOG - worker.run_server()
  281. 2022-12-17T12:06:16,757 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 189, in run_server
  282. 2022-12-17T12:06:16,758 [INFO ] W-9006-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 189, in run_server
  283. 2022-12-17T12:06:16,757 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 154, in handle_connection
  284. 2022-12-17T12:06:16,758 [INFO ] W-9006-bert_1.0-stdout MODEL_LOG - self.handle_connection(cl_socket)
  285. 2022-12-17T12:06:16,756 [INFO ] W-9011-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 189, in run_server
  286. 2022-12-17T12:06:16,756 [INFO ] W-9007-bert_1.0-stdout MODEL_LOG - worker.run_server()
  287. 2022-12-17T12:06:16,756 [INFO ] W-9001-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 221, in <module>
  288. 2022-12-17T12:06:16,756 [INFO ] W-9000-bert_1.0-stdout MODEL_LOG - worker.run_server()
  289. 2022-12-17T12:06:16,760 [INFO ] W-9001-bert_1.0-stdout MODEL_LOG - worker.run_server()
  290. 2022-12-17T12:06:16,758 [INFO ] W-9007-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 189, in run_server
  291. 2022-12-17T12:06:16,758 [INFO ] W-9011-bert_1.0-stdout MODEL_LOG - self.handle_connection(cl_socket)
  292. 2022-12-17T12:06:16,758 [INFO ] W-9006-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 154, in handle_connection
  293. 2022-12-17T12:06:16,758 [INFO ] W-9003-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 189, in run_server
  294. 2022-12-17T12:06:16,758 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - service, result, code = self.load_model(msg)
  295. 2022-12-17T12:06:16,758 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - self.handle_connection(cl_socket)
  296. 2022-12-17T12:06:16,758 [INFO ] W-9004-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 189, in run_server
  297. 2022-12-17T12:06:16,762 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 118, in load_model
  298. 2022-12-17T12:06:16,758 [INFO ] W-9010-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 189, in run_server
  299. 2022-12-17T12:06:16,753 [DEBUG] W-9009-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Backend worker monitoring thread interrupted or backend worker process died.
  300. java.lang.InterruptedException: null
  301. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056) ~[?:?]
  302. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133) ~[?:?]
  303. at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:432) ~[?:?]
  304. at org.pytorch.serve.wlm.WorkerThread.run(WorkerThread.java:191) [model-server.jar:?]
  305. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  306. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  307. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  308. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  309. at java.lang.Thread.run(Thread.java:834) [?:?]
  310. 2022-12-17T12:06:16,743 [DEBUG] W-9004-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Backend worker monitoring thread interrupted or backend worker process died.
  311. java.lang.InterruptedException: null
  312. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056) ~[?:?]
  313. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133) ~[?:?]
  314. at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:432) ~[?:?]
  315. at org.pytorch.serve.wlm.WorkerThread.run(WorkerThread.java:191) [model-server.jar:?]
  316. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  317. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  318. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  319. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  320. at java.lang.Thread.run(Thread.java:834) [?:?]
  321. 2022-12-17T12:06:16,758 [INFO ] W-9002-bert_1.0-stdout MODEL_LOG - self.handle_connection(cl_socket)
  322. 2022-12-17T12:06:16,742 [DEBUG] W-9008-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Backend worker monitoring thread interrupted or backend worker process died.
  323. java.lang.InterruptedException: null
  324. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056) ~[?:?]
  325. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133) ~[?:?]
  326. at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:432) ~[?:?]
  327. at org.pytorch.serve.wlm.WorkerThread.run(WorkerThread.java:191) [model-server.jar:?]
  328. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  329. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  330. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  331. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  332. at java.lang.Thread.run(Thread.java:834) [?:?]
  333. 2022-12-17T12:06:16,763 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - service = model_loader.load(
  334. 2022-12-17T12:06:16,764 [INFO ] W-9002-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 154, in handle_connection
  335. 2022-12-17T12:06:16,752 [DEBUG] W-9007-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Backend worker monitoring thread interrupted or backend worker process died.
  336. java.lang.InterruptedException: null
  337. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056) ~[?:?]
  338. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133) ~[?:?]
  339. at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:432) ~[?:?]
  340. at org.pytorch.serve.wlm.WorkerThread.run(WorkerThread.java:191) [model-server.jar:?]
  341. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  342. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  343. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  344. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  345. at java.lang.Thread.run(Thread.java:834) [?:?]
  346. 2022-12-17T12:06:16,746 [DEBUG] W-9002-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Backend worker monitoring thread interrupted or backend worker process died.
  347. java.lang.InterruptedException: null
  348. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056) ~[?:?]
  349. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133) ~[?:?]
  350. at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:432) ~[?:?]
  351. at org.pytorch.serve.wlm.WorkerThread.run(WorkerThread.java:191) [model-server.jar:?]
  352. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  353. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  354. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  355. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  356. at java.lang.Thread.run(Thread.java:834) [?:?]
  357. 2022-12-17T12:06:16,750 [DEBUG] W-9000-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Backend worker monitoring thread interrupted or backend worker process died.
  358. java.lang.InterruptedException: null
  359. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056) ~[?:?]
  360. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133) ~[?:?]
  361. at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:432) ~[?:?]
  362. at org.pytorch.serve.wlm.WorkerThread.run(WorkerThread.java:191) [model-server.jar:?]
  363. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  364. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  365. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  366. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  367. at java.lang.Thread.run(Thread.java:834) [?:?]
  368. 2022-12-17T12:06:16,753 [DEBUG] W-9010-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Backend worker monitoring thread interrupted or backend worker process died.
  369. java.lang.InterruptedException: null
  370. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056) ~[?:?]
  371. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133) ~[?:?]
  372. at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:432) ~[?:?]
  373. at org.pytorch.serve.wlm.WorkerThread.run(WorkerThread.java:191) [model-server.jar:?]
  374. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  375. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  376. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  377. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  378. at java.lang.Thread.run(Thread.java:834) [?:?]
  379. 2022-12-17T12:06:16,765 [WARN ] W-9000-bert_1.0 org.pytorch.serve.wlm.BatchAggregator - Load model failed: bert, error: Worker died.
  380. 2022-12-17T12:06:16,750 [DEBUG] W-9011-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Backend worker monitoring thread interrupted or backend worker process died.
  381. java.lang.InterruptedException: null
  382. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056) ~[?:?]
  383. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133) ~[?:?]
  384. at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:432) ~[?:?]
  385. at org.pytorch.serve.wlm.WorkerThread.run(WorkerThread.java:191) [model-server.jar:?]
  386. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  387. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  388. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  389. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  390. at java.lang.Thread.run(Thread.java:834) [?:?]
  391. 2022-12-17T12:06:16,751 [DEBUG] W-9001-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Backend worker monitoring thread interrupted or backend worker process died.
  392. java.lang.InterruptedException: null
  393. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056) ~[?:?]
  394. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133) ~[?:?]
  395. at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:432) ~[?:?]
  396. at org.pytorch.serve.wlm.WorkerThread.run(WorkerThread.java:191) [model-server.jar:?]
  397. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  398. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  399. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  400. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  401. at java.lang.Thread.run(Thread.java:834) [?:?]
  402. 2022-12-17T12:06:16,745 [DEBUG] W-9005-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Backend worker monitoring thread interrupted or backend worker process died.
  403. java.lang.InterruptedException: null
  404. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056) ~[?:?]
  405. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133) ~[?:?]
  406. at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:432) ~[?:?]
  407. at org.pytorch.serve.wlm.WorkerThread.run(WorkerThread.java:191) [model-server.jar:?]
  408. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  409. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  410. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  411. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  412. at java.lang.Thread.run(Thread.java:834) [?:?]
  413. 2022-12-17T12:06:16,765 [WARN ] W-9011-bert_1.0 org.pytorch.serve.wlm.BatchAggregator - Load model failed: bert, error: Worker died.
  414. 2022-12-17T12:06:16,747 [DEBUG] W-9006-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Backend worker monitoring thread interrupted or backend worker process died.
  415. java.lang.InterruptedException: null
  416. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056) ~[?:?]
  417. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133) ~[?:?]
  418. at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:432) ~[?:?]
  419. at org.pytorch.serve.wlm.WorkerThread.run(WorkerThread.java:191) [model-server.jar:?]
  420. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  421. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  422. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  423. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  424. at java.lang.Thread.run(Thread.java:834) [?:?]
  425. 2022-12-17T12:06:16,750 [DEBUG] W-9003-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Backend worker monitoring thread interrupted or backend worker process died.
  426. java.lang.InterruptedException: null
  427. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2056) ~[?:?]
  428. at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2133) ~[?:?]
  429. at java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:432) ~[?:?]
  430. at org.pytorch.serve.wlm.WorkerThread.run(WorkerThread.java:191) [model-server.jar:?]
  431. at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
  432. at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
  433. at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
  434. at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
  435. at java.lang.Thread.run(Thread.java:834) [?:?]
  436. 2022-12-17T12:06:16,762 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 154, in handle_connection
  437. 2022-12-17T12:06:16,762 [INFO ] W-9004-bert_1.0-stdout MODEL_LOG - self.handle_connection(cl_socket)
  438. 2022-12-17T12:06:16,761 [INFO ] W-9003-bert_1.0-stdout MODEL_LOG - self.handle_connection(cl_socket)
  439. 2022-12-17T12:06:16,766 [WARN ] W-9003-bert_1.0 org.pytorch.serve.wlm.BatchAggregator - Load model failed: bert, error: Worker died.
  440. 2022-12-17T12:06:16,761 [INFO ] W-9006-bert_1.0-stdout MODEL_LOG - service, result, code = self.load_model(msg)
  441. 2022-12-17T12:06:16,761 [INFO ] W-9011-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 154, in handle_connection
  442. 2022-12-17T12:06:16,761 [INFO ] W-9007-bert_1.0-stdout MODEL_LOG - self.handle_connection(cl_socket)
  443. 2022-12-17T12:06:16,761 [INFO ] W-9001-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 189, in run_server
  444. 2022-12-17T12:06:16,767 [INFO ] W-9006-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 118, in load_model
  445. 2022-12-17T12:06:16,760 [INFO ] W-9008-bert_1.0-stdout MODEL_LOG - worker.run_server()
  446. 2022-12-17T12:06:16,767 [INFO ] W-9007-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 154, in handle_connection
  447. 2022-12-17T12:06:16,760 [INFO ] W-9000-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 189, in run_server
  448. 2022-12-17T12:06:16,767 [INFO ] W-9011-bert_1.0-stdout MODEL_LOG - service, result, code = self.load_model(msg)
  449. 2022-12-17T12:06:16,767 [INFO ] W-9000-bert_1.0-stdout MODEL_LOG - self.handle_connection(cl_socket)
  450. 2022-12-17T12:06:16,767 [DEBUG] W-9003-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9003-bert_1.0 State change WORKER_STARTED -> WORKER_STOPPED
  451. 2022-12-17T12:06:16,766 [INFO ] W-9003-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 154, in handle_connection
  452. 2022-12-17T12:06:16,766 [INFO ] W-9004-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 154, in handle_connection
  453. 2022-12-17T12:06:16,766 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - service, result, code = self.load_model(msg)
  454. 2022-12-17T12:06:16,766 [WARN ] W-9006-bert_1.0 org.pytorch.serve.wlm.BatchAggregator - Load model failed: bert, error: Worker died.
  455. 2022-12-17T12:06:16,766 [WARN ] W-9005-bert_1.0 org.pytorch.serve.wlm.BatchAggregator - Load model failed: bert, error: Worker died.
  456. 2022-12-17T12:06:16,768 [INFO ] W-9004-bert_1.0-stdout MODEL_LOG - service, result, code = self.load_model(msg)
  457. 2022-12-17T12:06:16,766 [WARN ] W-9001-bert_1.0 org.pytorch.serve.wlm.BatchAggregator - Load model failed: bert, error: Worker died.
  458. 2022-12-17T12:06:16,765 [DEBUG] W-9000-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9000-bert_1.0 State change WORKER_STARTED -> WORKER_STOPPED
  459. 2022-12-17T12:06:16,765 [WARN ] W-9010-bert_1.0 org.pytorch.serve.wlm.BatchAggregator - Load model failed: bert, error: Worker died.
  460. 2022-12-17T12:06:16,768 [DEBUG] W-9001-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9001-bert_1.0 State change WORKER_STARTED -> WORKER_STOPPED
  461. 2022-12-17T12:06:16,764 [WARN ] W-9002-bert_1.0 org.pytorch.serve.wlm.BatchAggregator - Load model failed: bert, error: Worker died.
  462. 2022-12-17T12:06:16,764 [INFO ] W-9010-bert_1.0-stdout MODEL_LOG - self.handle_connection(cl_socket)
  463. 2022-12-17T12:06:16,768 [DEBUG] W-9002-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9002-bert_1.0 State change WORKER_STARTED -> WORKER_STOPPED
  464. 2022-12-17T12:06:16,764 [WARN ] W-9007-bert_1.0 org.pytorch.serve.wlm.BatchAggregator - Load model failed: bert, error: Worker died.
  465. 2022-12-17T12:06:16,764 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\site-packages\ts\model_loader.py", line 100, in load
  466. 2022-12-17T12:06:16,764 [WARN ] W-9008-bert_1.0 org.pytorch.serve.wlm.BatchAggregator - Load model failed: bert, error: Worker died.
  467. 2022-12-17T12:06:16,764 [WARN ] W-9004-bert_1.0 org.pytorch.serve.wlm.BatchAggregator - Load model failed: bert, error: Worker died.
  468. 2022-12-17T12:06:16,764 [WARN ] W-9009-bert_1.0 org.pytorch.serve.wlm.BatchAggregator - Load model failed: bert, error: Worker died.
  469. 2022-12-17T12:06:16,768 [DEBUG] W-9004-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9004-bert_1.0 State change WORKER_STARTED -> WORKER_STOPPED
  470. 2022-12-17T12:06:16,768 [DEBUG] W-9008-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9008-bert_1.0 State change WORKER_STARTED -> WORKER_STOPPED
  471. 2022-12-17T12:06:16,768 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - module, function_name = self._load_handler_file(handler)
  472. 2022-12-17T12:06:16,768 [DEBUG] W-9007-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9007-bert_1.0 State change WORKER_STARTED -> WORKER_STOPPED
  473. 2022-12-17T12:06:16,768 [WARN ] W-9002-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9002-bert_1.0-stderr
  474. 2022-12-17T12:06:16,768 [INFO ] W-9010-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 154, in handle_connection
  475. 2022-12-17T12:06:16,768 [WARN ] W-9001-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9001-bert_1.0-stderr
  476. 2022-12-17T12:06:16,768 [WARN ] W-9000-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9000-bert_1.0-stderr
  477. 2022-12-17T12:06:16,769 [WARN ] W-9002-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9002-bert_1.0-stdout
  478. 2022-12-17T12:06:16,768 [DEBUG] W-9011-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9011-bert_1.0 State change WORKER_STARTED -> WORKER_STOPPED
  479. 2022-12-17T12:06:16,768 [DEBUG] W-9005-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9005-bert_1.0 State change WORKER_STARTED -> WORKER_STOPPED
  480. 2022-12-17T12:06:16,768 [DEBUG] W-9006-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9006-bert_1.0 State change WORKER_STARTED -> WORKER_STOPPED
  481. 2022-12-17T12:06:16,770 [WARN ] W-9005-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9005-bert_1.0-stderr
  482. 2022-12-17T12:06:16,768 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 118, in load_model
  483. 2022-12-17T12:06:16,770 [WARN ] W-9005-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9005-bert_1.0-stdout
  484. 2022-12-17T12:06:16,767 [INFO ] W-9003-bert_1.0-stdout MODEL_LOG - service, result, code = self.load_model(msg)
  485. 2022-12-17T12:06:16,770 [INFO ] W-9004-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 118, in load_model
  486. 2022-12-17T12:06:16,767 [WARN ] W-9003-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9003-bert_1.0-stderr
  487. 2022-12-17T12:06:16,770 [INFO ] W-9005-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Retry worker: 9005 in 1 seconds.
  488. 2022-12-17T12:06:16,767 [INFO ] W-9000-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 154, in handle_connection
  489. 2022-12-17T12:06:16,767 [INFO ] W-9001-bert_1.0-stdout MODEL_LOG - self.handle_connection(cl_socket)
  490. 2022-12-17T12:06:16,767 [INFO ] W-9011-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 118, in load_model
  491. 2022-12-17T12:06:16,767 [INFO ] W-9008-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 189, in run_server
  492. 2022-12-17T12:06:16,770 [INFO ] W-9001-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 154, in handle_connection
  493. 2022-12-17T12:06:16,767 [INFO ] W-9007-bert_1.0-stdout MODEL_LOG - service, result, code = self.load_model(msg)
  494. 2022-12-17T12:06:16,767 [INFO ] W-9006-bert_1.0-stdout MODEL_LOG - service = model_loader.load(
  495. 2022-12-17T12:06:16,771 [INFO ] W-9001-bert_1.0-stdout MODEL_LOG - service, result, code = self.load_model(msg)
  496. 2022-12-17T12:06:16,771 [INFO ] W-9011-bert_1.0-stdout MODEL_LOG - service = model_loader.load(
  497. 2022-12-17T12:06:16,770 [INFO ] W-9000-bert_1.0-stdout MODEL_LOG - service, result, code = self.load_model(msg)
  498. 2022-12-17T12:06:16,770 [INFO ] W-9002-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Retry worker: 9002 in 1 seconds.
  499. 2022-12-17T12:06:16,770 [INFO ] W-9004-bert_1.0-stdout MODEL_LOG - service = model_loader.load(
  500. 2022-12-17T12:06:16,770 [WARN ] W-9003-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9003-bert_1.0-stdout
  501. 2022-12-17T12:06:16,770 [INFO ] W-9003-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 118, in load_model
  502. 2022-12-17T12:06:16,770 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - service = model_loader.load(
  503. 2022-12-17T12:06:16,770 [WARN ] W-9006-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9006-bert_1.0-stderr
  504. 2022-12-17T12:06:16,772 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\site-packages\ts\model_loader.py", line 100, in load
  505. 2022-12-17T12:06:16,769 [DEBUG] W-9010-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9010-bert_1.0 State change WORKER_STARTED -> WORKER_STOPPED
  506. 2022-12-17T12:06:16,769 [WARN ] W-9011-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9011-bert_1.0-stderr
  507. 2022-12-17T12:06:16,772 [WARN ] W-9010-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9010-bert_1.0-stderr
  508. 2022-12-17T12:06:16,769 [WARN ] W-9001-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9001-bert_1.0-stdout
  509. 2022-12-17T12:06:16,769 [WARN ] W-9007-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9007-bert_1.0-stderr
  510. 2022-12-17T12:06:16,769 [INFO ] W-9010-bert_1.0-stdout MODEL_LOG - service, result, code = self.load_model(msg)
  511. 2022-12-17T12:06:16,772 [WARN ] W-9007-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9007-bert_1.0-stdout
  512. 2022-12-17T12:06:16,769 [INFO ] W-9005-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\site-packages\ts\model_loader.py", line 145, in _load_handler_file
  513. 2022-12-17T12:06:16,769 [WARN ] W-9008-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9008-bert_1.0-stderr
  514. 2022-12-17T12:06:16,769 [WARN ] W-9004-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9004-bert_1.0-stderr
  515. 2022-12-17T12:06:16,768 [INFO ] W-9002-bert_1.0-stdout MODEL_LOG - service, result, code = self.load_model(msg)
  516. 2022-12-17T12:06:16,773 [WARN ] W-9004-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9004-bert_1.0-stdout
  517. 2022-12-17T12:06:16,768 [DEBUG] W-9009-bert_1.0 org.pytorch.serve.wlm.WorkerThread - W-9009-bert_1.0 State change WORKER_STARTED -> WORKER_STOPPED
  518. 2022-12-17T12:06:16,773 [INFO ] W-9005-bert_1.0-stdout org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9005-bert_1.0-stdout
  519. 2022-12-17T12:06:16,773 [WARN ] W-9009-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9009-bert_1.0-stderr
  520. 2022-12-17T12:06:16,773 [WARN ] W-9008-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9008-bert_1.0-stdout
  521. 2022-12-17T12:06:16,772 [INFO ] W-9007-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Retry worker: 9007 in 1 seconds.
  522. 2022-12-17T12:06:16,774 [INFO ] W-9008-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Retry worker: 9008 in 1 seconds.
  523. 2022-12-17T12:06:16,772 [INFO ] W-9010-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 118, in load_model
  524. 2022-12-17T12:06:16,772 [WARN ] W-9000-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9000-bert_1.0-stdout
  525. 2022-12-17T12:06:16,772 [INFO ] W-9001-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Retry worker: 9001 in 1 seconds.
  526. 2022-12-17T12:06:16,774 [INFO ] W-9000-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Retry worker: 9000 in 1 seconds.
  527. 2022-12-17T12:06:16,772 [WARN ] W-9010-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9010-bert_1.0-stdout
  528. 2022-12-17T12:06:16,772 [WARN ] W-9011-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9011-bert_1.0-stdout
  529. 2022-12-17T12:06:16,774 [INFO ] W-9010-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Retry worker: 9010 in 1 seconds.
  530. 2022-12-17T12:06:16,772 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - module, function_name = self._load_handler_file(handler)
  531. 2022-12-17T12:06:16,774 [INFO ] W-9011-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Retry worker: 9011 in 1 seconds.
  532. 2022-12-17T12:06:16,772 [WARN ] W-9006-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9006-bert_1.0-stdout
  533. 2022-12-17T12:06:16,772 [INFO ] W-9003-bert_1.0-stdout org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9003-bert_1.0-stdout
  534. 2022-12-17T12:06:16,771 [INFO ] W-9003-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Retry worker: 9003 in 1 seconds.
  535. 2022-12-17T12:06:16,771 [INFO ] W-9004-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\site-packages\ts\model_loader.py", line 100, in load
  536. 2022-12-17T12:06:16,771 [INFO ] W-9000-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 118, in load_model
  537. 2022-12-17T12:06:16,771 [INFO ] W-9008-bert_1.0-stdout MODEL_LOG - self.handle_connection(cl_socket)
  538. 2022-12-17T12:06:16,771 [INFO ] W-9011-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\site-packages\ts\model_loader.py", line 100, in load
  539. 2022-12-17T12:06:16,771 [INFO ] W-9001-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 118, in load_model
  540. 2022-12-17T12:06:16,771 [INFO ] W-9006-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\site-packages\ts\model_loader.py", line 100, in load
  541. 2022-12-17T12:06:16,771 [INFO ] W-9007-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\model_service_worker.py", line 118, in load_model
  542. 2022-12-17T12:06:16,776 [INFO ] W-9011-bert_1.0-stdout org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9011-bert_1.0-stdout
  543. 2022-12-17T12:06:16,775 [INFO ] W-9008-bert_1.0-stdout org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9008-bert_1.0-stdout
  544. 2022-12-17T12:06:16,775 [INFO ] W-9000-bert_1.0-stdout org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9000-bert_1.0-stdout
  545. 2022-12-17T12:06:16,775 [INFO ] W-9004-bert_1.0-stdout org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9004-bert_1.0-stdout
  546. 2022-12-17T12:06:16,774 [INFO ] W-9006-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Retry worker: 9006 in 1 seconds.
  547. 2022-12-17T12:06:16,774 [INFO ] W-9010-bert_1.0-stdout MODEL_LOG - service = model_loader.load(
  548. 2022-12-17T12:06:16,774 [WARN ] W-9009-bert_1.0 org.pytorch.serve.wlm.WorkerLifeCycle - terminateIOStreams() threadName=W-9009-bert_1.0-stdout
  549. 2022-12-17T12:06:16,777 [INFO ] W-9007-bert_1.0-stdout org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9007-bert_1.0-stdout
  550. 2022-12-17T12:06:16,773 [INFO ] W-9002-bert_1.0-stdout org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9002-bert_1.0-stdout
  551. 2022-12-17T12:06:16,773 [INFO ] W-9004-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Retry worker: 9004 in 1 seconds.
  552. 2022-12-17T12:06:16,778 [INFO ] W-9010-bert_1.0-stdout org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9010-bert_1.0-stdout
  553. 2022-12-17T12:06:16,777 [INFO ] W-9006-bert_1.0-stdout org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9006-bert_1.0-stdout
  554. 2022-12-17T12:06:16,777 [INFO ] W-9009-bert_1.0-stdout MODEL_LOG - File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\site-packages\ts\model_loader.py", line 145, in _load_handler_file
  555. 2022-12-17T12:06:16,777 [INFO ] W-9001-bert_1.0-stdout org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9001-bert_1.0-stdout
  556. 2022-12-17T12:06:16,778 [INFO ] W-9009-bert_1.0 org.pytorch.serve.wlm.WorkerThread - Retry worker: 9009 in 1 seconds.
  557. 2022-12-17T12:06:16,779 [INFO ] W-9009-bert_1.0-stdout org.pytorch.serve.wlm.WorkerLifeCycle - Stopped Scanner - W-9009-bert_1.0-stdout
  558. Model server started.
  559. 2022-12-17T12:06:17,308 [INFO ] pool-3-thread-1 TS_METRICS - CPUUtilization.Percent:0.0|#Level:Host|#hostname:JadeGnome,timestamp:1671258977
  560. 2022-12-17T12:06:17,309 [INFO ] pool-3-thread-1 TS_METRICS - DiskAvailable.Gigabytes:104.52069854736328|#Level:Host|#hostname:JadeGnome,timestamp:1671258977
  561. 2022-12-17T12:06:17,310 [INFO ] pool-3-thread-1 TS_METRICS - DiskUsage.Gigabytes:305.57988357543945|#Level:Host|#hostname:JadeGnome,timestamp:1671258977
  562. 2022-12-17T12:06:17,310 [INFO ] pool-3-thread-1 TS_METRICS - DiskUtilization.Percent:74.5|#Level:Host|#hostname:JadeGnome,timestamp:1671258977
  563. 2022-12-17T12:06:17,310 [INFO ] pool-3-thread-1 TS_METRICS - MemoryAvailable.Megabytes:7060.0078125|#Level:Host|#hostname:JadeGnome,timestamp:1671258977
  564. 2022-12-17T12:06:17,310 [INFO ] pool-3-thread-1 TS_METRICS - MemoryUsed.Megabytes:9008.73046875|#Level:Host|#hostname:JadeGnome,timestamp:1671258977
  565. 2022-12-17T12:06:17,311 [INFO ] pool-3-thread-1 TS_METRICS - MemoryUtilization.Percent:56.1|#Level:Host|#hostname:JadeGnome,timestamp:1671258977
  566. 2022-12-17T12:06:17,370 [ERROR] Thread-1 org.pytorch.serve.metrics.MetricCollector - --- Logging error ---
  567. Traceback (most recent call last):
  568. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\_pswindows.py", line 688, in wrapper
  569. return fun(self, *args, **kwargs)
  570. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\_pswindows.py", line 942, in create_time
  571. user, system, created = cext.proc_times(self.pid)
  572. ProcessLookupError: [Errno 3] assume no such process (originated from GetExitCodeProcess != STILL_ACTIVE)
  573.  
  574. During handling of the above exception, another exception occurred:
  575.  
  576. Traceback (most recent call last):
  577. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\__init__.py", line 361, in _init
  578. self.create_time()
  579. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\__init__.py", line 714, in create_time
  580. self._create_time = self._proc.create_time()
  581. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\_pswindows.py", line 690, in wrapper
  582. raise convert_oserror(err, pid=self.pid, name=self._name)
  583. psutil.NoSuchProcess: process no longer exists (pid=13056)
  584.  
  585. During handling of the above exception, another exception occurred:
  586.  
  587. Traceback (most recent call last):
  588. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\site-packages\ts\metrics\process_memory_metric.py", line 20, in get_cpu_usage
  589. process = psutil.Process(int(pid))
  590. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\__init__.py", line 332, in __init__
  591. self._init(pid)
  592. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\__init__.py", line 373, in _init
  593. raise NoSuchProcess(pid, msg='process PID not found')
  594. psutil.NoSuchProcess: process PID not found (pid=13056)
  595.  
  596. During handling of the above exception, another exception occurred:
  597.  
  598. Traceback (most recent call last):
  599. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\logging\__init__.py", line 1104, in emit
  600. self.flush()
  601. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\logging\__init__.py", line 1084, in flush
  602. self.stream.flush()
  603. OSError: [Errno 22] Invalid argument
  604. Call stack:
  605. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\metrics\metric_collector.py", line 29, in <module>
  606. check_process_mem_usage(sys.stdin)
  607. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\site-packages\ts\metrics\process_memory_metric.py", line 40, in check_process_mem_usage
  608. logging.info("%s:%d", process, get_cpu_usage(process))
  609. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\site-packages\ts\metrics\process_memory_metric.py", line 22, in get_cpu_usage
  610. logging.error("Failed get process for pid: %s", pid, exc_info=True)
  611. Message: 'Failed get process for pid: %s'
  612. Arguments: ('13056',)
  613. --- Logging error ---
  614. Traceback (most recent call last):
  615. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\logging\__init__.py", line 1104, in emit
  616. self.flush()
  617. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\logging\__init__.py", line 1084, in flush
  618. self.stream.flush()
  619. OSError: [Errno 22] Invalid argument
  620. Call stack:
  621. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\metrics\metric_collector.py", line 29, in <module>
  622. check_process_mem_usage(sys.stdin)
  623. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\site-packages\ts\metrics\process_memory_metric.py", line 40, in check_process_mem_usage
  624. logging.info("%s:%d", process, get_cpu_usage(process))
  625. Message: '%s:%d'
  626. Arguments: ('13056', 0)
  627. --- Logging error ---
  628. Traceback (most recent call last):
  629. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\_pswindows.py", line 688, in wrapper
  630. return fun(self, *args, **kwargs)
  631. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\_pswindows.py", line 942, in create_time
  632. user, system, created = cext.proc_times(self.pid)
  633. ProcessLookupError: [Errno 3] assume no such process (originated from GetExitCodeProcess != STILL_ACTIVE)
  634.  
  635. During handling of the above exception, another exception occurred:
  636.  
  637. Traceback (most recent call last):
  638. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\__init__.py", line 361, in _init
  639. self.create_time()
  640. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\__init__.py", line 714, in create_time
  641. self._create_time = self._proc.create_time()
  642. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\_pswindows.py", line 690, in wrapper
  643. raise convert_oserror(err, pid=self.pid, name=self._name)
  644. psutil.NoSuchProcess: process no longer exists (pid=18564)
  645.  
  646. During handling of the above exception, another exception occurred:
  647.  
  648. Traceback (most recent call last):
  649. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\site-packages\ts\metrics\process_memory_metric.py", line 20, in get_cpu_usage
  650. process = psutil.Process(int(pid))
  651. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\__init__.py", line 332, in __init__
  652. self._init(pid)
  653. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\__init__.py", line 373, in _init
  654. raise NoSuchProcess(pid, msg='process PID not found')
  655. psutil.NoSuchProcess: process PID not found (pid=18564)
  656.  
  657. During handling of the above exception, another exception occurred:
  658.  
  659. Traceback (most recent call last):
  660. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\logging\__init__.py", line 1104, in emit
  661. self.flush()
  662. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\logging\__init__.py", line 1084, in flush
  663. self.stream.flush()
  664. OSError: [Errno 22] Invalid argument
  665. Call stack:
  666. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\metrics\metric_collector.py", line 29, in <module>
  667. check_process_mem_usage(sys.stdin)
  668. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\site-packages\ts\metrics\process_memory_metric.py", line 40, in check_process_mem_usage
  669. logging.info("%s:%d", process, get_cpu_usage(process))
  670. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\site-packages\ts\metrics\process_memory_metric.py", line 22, in get_cpu_usage
  671. logging.error("Failed get process for pid: %s", pid, exc_info=True)
  672. Message: 'Failed get process for pid: %s'
  673. Arguments: ('18564',)
  674. --- Logging error ---
  675. Traceback (most recent call last):
  676. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\logging\__init__.py", line 1104, in emit
  677. self.flush()
  678. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\logging\__init__.py", line 1084, in flush
  679. self.stream.flush()
  680. OSError: [Errno 22] Invalid argument
  681. Call stack:
  682. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\Lib\site-packages\ts\metrics\metric_collector.py", line 29, in <module>
  683. check_process_mem_usage(sys.stdin)
  684. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\site-packages\ts\metrics\process_memory_metric.py", line 40, in check_process_mem_usage
  685. logging.info("%s:%d", process, get_cpu_usage(process))
  686. Message: '%s:%d'
  687. Arguments: ('18564', 0)
  688. --- Logging error ---
  689. Traceback (most recent call last):
  690. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\_pswindows.py", line 688, in wrapper
  691. return fun(self, *args, **kwargs)
  692. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\_pswindows.py", line 942, in create_time
  693. user, system, created = cext.proc_times(self.pid)
  694. ProcessLookupError: [Errno 3] assume no such process (originated from GetExitCodeProcess != STILL_ACTIVE)
  695.  
  696. During handling of the above exception, another exception occurred:
  697.  
  698. Traceback (most recent call last):
  699. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\__init__.py", line 361, in _init
  700. self.create_time()
  701. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\__init__.py", line 714, in create_time
  702. self._create_time = self._proc.create_time()
  703. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\_pswindows.py", line 690, in wrapper
  704. raise convert_oserror(err, pid=self.pid, name=self._name)
  705. psutil.NoSuchProcess: process no longer exists (pid=19908)
  706.  
  707. During handling of the above exception, another exception occurred:
  708.  
  709. Traceback (most recent call last):
  710. File "C:\Users\varun\AppData\Local\Programs\Python\Python310\lib\site-packages\ts\metrics\process_memory_metric.py", line 20, in get_cpu_usage
  711. process = psutil.Process(int(pid))
  712. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\__init__.py", line 332, in __init__
  713. self._init(pid)
  714. File "C:\Users\varun\AppData\Roaming\Python\Python310\site-packages\psutil\__init__.py", line 373, in _init
  715. raise NoSuchProcess(pid, msg='process PID not found')
  716. psutil.NoSuchProcess: process PID not found (pid=19908)
  717.  
  718. During handling of the above exception, another exception occurred:
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!