API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Jul 12th, 2018
197
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 28.30 KB | None | 0 0
raw download clone embed print report
  1. 2018-07-12 15:01:19,786 - Thread-43 - storperf.db.job_db - DEBUG - Connecting to StorPerfJob.db
  2. 2018-07-12 15:01:19,787 - Thread-43 - storperf.db.job_db - DEBUG - Job table exists
  3. 2018-07-12 15:01:19,788 - Thread-43 - storperf.db.job_db - DEBUG - Job params table exists
  4. 2018-07-12 15:01:19,789 - Thread-43 - storperf.db.job_db - DEBUG - Job summary table exists
  5. 2018-07-12 15:01:19,789 - Thread-43 - storperf.test_executor - ERROR - Cannot determine installer
  6. 2018-07-12 15:01:19,791 - Thread-43 - storperf.test_executor - DEBUG - Found: <module 'ws' from '/storperf/storperf/workloads/ws.py'>
  7. 2018-07-12 15:01:19,792 - Thread-43 - storperf.test_executor - DEBUG - Found: <module 'rs' from '/storperf/storperf/workloads/rs.py'>
  8. 2018-07-12 15:01:19,793 - Thread-43 - storperf.test_executor - DEBUG - Found: <module 'wr' from '/storperf/storperf/workloads/wr.py'>
  9. 2018-07-12 15:01:19,793 - Thread-43 - storperf.test_executor - DEBUG - Found: <module 'rr' from '/storperf/storperf/workloads/rr.py'>
  10. 2018-07-12 15:01:19,794 - Thread-43 - storperf.test_executor - DEBUG - Found: <module 'rw' from '/storperf/storperf/workloads/rw.py'>
  11. 2018-07-12 15:01:19,794 - Thread-43 - storperf.storperf_master - INFO - Custom workloads = None
  12. 2018-07-12 15:01:19,795 - Thread-43 - storperf.storperf_master - INFO - Custom workloads = {u'rs': {u'rw': u'read'}}
  13. 2018-07-12 15:01:19,795 - Thread-43 - storperf.db.job_db - DEBUG - Connecting to StorPerfJob.db
  14. 2018-07-12 15:01:19,796 - Thread-43 - storperf.db.job_db - DEBUG - Job table exists
  15. 2018-07-12 15:01:19,796 - Thread-43 - storperf.db.job_db - DEBUG - Job params table exists
  16. 2018-07-12 15:01:19,797 - Thread-43 - storperf.db.job_db - DEBUG - Job summary table exists
  17. 2018-07-12 15:01:19,797 - Thread-43 - storperf.test_executor - ERROR - Cannot determine installer
  18. 2018-07-12 15:01:19,798 - Thread-43 - storperf.test_executor - DEBUG - Found: <module 'rs' from '/storperf/storperf/workloads/rs.pyc'>
  19. 2018-07-12 15:01:19,799 - Thread-43 - storperf.test_executor - DEBUG - Found: <module 'ws' from '/storperf/storperf/workloads/ws.pyc'>
  20. 2018-07-12 15:01:19,799 - Thread-43 - storperf.test_executor - DEBUG - Found: <module 'rw' from '/storperf/storperf/workloads/rw.pyc'>
  21. 2018-07-12 15:01:19,799 - Thread-43 - storperf.test_executor - DEBUG - Found: <module 'wr' from '/storperf/storperf/workloads/wr.pyc'>
  22. 2018-07-12 15:01:19,800 - Thread-43 - storperf.test_executor - DEBUG - Found: <module 'rr' from '/storperf/storperf/workloads/rr.pyc'>
  23. 2018-07-12 15:01:19,800 - Thread-43 - storperf.test_executor - DEBUG - Found: <module 'ws' from '/storperf/storperf/workloads/ws.pyc'>
  24. 2018-07-12 15:01:19,801 - Thread-43 - storperf.test_executor - DEBUG - Found: <module 'rs' from '/storperf/storperf/workloads/rs.pyc'>
  25. 2018-07-12 15:01:19,801 - Thread-43 - storperf.test_executor - DEBUG - Found: <module 'wr' from '/storperf/storperf/workloads/wr.pyc'>
  26. 2018-07-12 15:01:19,802 - Thread-43 - storperf.test_executor - DEBUG - Found: <module 'rr' from '/storperf/storperf/workloads/rr.pyc'>
  27. 2018-07-12 15:01:19,802 - Thread-43 - storperf.test_executor - DEBUG - Found: <module 'rw' from '/storperf/storperf/workloads/rw.pyc'>
  28. 2018-07-12 15:01:19,802 - Thread-43 - storperf.test_executor - DEBUG - Set custom workloads to: {u'rs': {u'rw': u'read'}}
  29. 2018-07-12 15:01:19,803 - Thread-43 - storperf.test_executor - DEBUG - Set block_sizes to: 4096k
  30. 2018-07-12 15:01:19,803 - Thread-43 - storperf.test_executor - DEBUG - Set queue_depths to: 4
  31. 2018-07-12 15:01:19,804 - Thread-44 - storperf.storperf_master:10.5.149.152 - INFO - Initializing slave at 10.5.149.152
  32. 2018-07-12 15:01:19,804 - Thread-44 - storperf.storperf_master:10.5.149.152 - DEBUG - Checking if slave 10.5.149.152 is alive
  33. 2018-07-12 15:01:19,807 - Thread-44 - storperf.storperf_master:10.5.149.152 - DEBUG - Slave 10.5.149.152 is alive and ready
  34. 2018-07-12 15:01:19,822 - Thread-45 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_7.2p2)
  35. 2018-07-12 15:01:19,964 - Thread-45 - paramiko.transport - INFO - Authentication (publickey) successful!
  36. 2018-07-12 15:01:20,258 - Thread-44 - storperf.storperf_master:10.5.149.152 - DEBUG - Available space on / is 2778944
  37. 2018-07-12 15:01:20,259 - Thread-44 - storperf.storperf_master:10.5.149.152 - DEBUG - Transferring fio to 10.5.149.152
  38. 2018-07-12 15:01:20,460 - Thread-43 - storperf.test_executor - DEBUG - Set slaves to: [u'10.5.149.152']
  39. 2018-07-12 15:01:20,461 - Thread-43 - storperf.test_executor - DEBUG - Set volume count to: 1
  40. 2018-07-12 15:01:20,463 - Thread-43 - storperf.db.job_db - DEBUG - Reserved job id 3e5e9af0-a6d3-4802-9ab1-ed85dd2034bf
  41. 2018-07-12 15:01:20,556 - Thread-43 - storperf.test_executor - INFO - Workload 3e5e9af0-a6d3-4802-9ab1-ed85dd2034bf.rs.queue-depth.4.block-size.4096k={'rw': u'read', 'name': u'rs', 'output-format': 'json', 'numjobs': '1', 'direct': '1', 'bs': u'4096k', 'loops': '200', 'ioengine': 'libaio', 'iodepth': u'4', 'status-interval': '60'}
  42. 2018-07-12 15:01:20,557 - Thread-43 - storperf.test_executor - INFO - Testing FIO parameters for {'status': 'Pending', 'workload': <storperf.workloads._custom_workload._custom_workload object at 0x7f63e57cd310>, 'name': u'3e5e9af0-a6d3-4802-9ab1-ed85dd2034bf.rs.queue-depth.4.block-size.4096k', 'workload_name': u'rs', 'blocksize': u'4096k', 'queue-depth': u'4'}
  43. 2018-07-12 15:01:20,560 - Thread-43 - storperf.test_executor - DEBUG - Device to profile on 10.5.149.152: /dev/vdb
  44. 2018-07-12 15:01:20,561 - Thread-43 - storperf.test_executor - DEBUG - Waiting on <multiprocessing.pool.ApplyResult object at 0x7f63e9953550>
  45. 2018-07-12 15:01:20,561 - Thread-47 - storperf.test_executor - INFO - Starting 3e5e9af0-a6d3-4802-9ab1-ed85dd2034bf.rs.queue-depth.4.block-size.4096k.10-5-149-152--dev-vdb
  46. 2018-07-12 15:01:20,564 - Thread-51 - paramiko.transport - DEBUG - starting thread (client mode): 0xe5c88410L
  47. 2018-07-12 15:01:20,565 - Thread-51 - paramiko.transport - DEBUG - Local version/idstring: SSH-2.0-paramiko_2.0.2
  48. 2018-07-12 15:01:20,571 - Thread-51 - paramiko.transport - DEBUG - Remote version/idstring: SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.4
  49. 2018-07-12 15:01:20,571 - Thread-51 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_7.2p2)
  50. 2018-07-12 15:01:20,572 - Thread-51 - paramiko.transport - DEBUG - kex algos:[u'curve25519-sha256@libssh.org', u'ecdh-sha2-nistp256', u'ecdh-sha2-nistp384', u'ecdh-sha2-nistp521', u'diffie-hellman-group-exchange-sha256', u'diffie-hellman-group14-sha1'] server key:[u'ssh-rsa', u'rsa-sha2-512', u'rsa-sha2-256', u'ecdsa-sha2-nistp256', u'ssh-ed25519'] client encrypt:[u'chacha20-poly1305@openssh.com', u'aes128-ctr', u'aes192-ctr', u'aes256-ctr', u'aes128-gcm@openssh.com', u'aes256-gcm@openssh.com'] server encrypt:[u'chacha20-poly1305@openssh.com', u'aes128-ctr', u'aes192-ctr', u'aes256-ctr', u'aes128-gcm@openssh.com', u'aes256-gcm@openssh.com'] client mac:[u'umac-64-etm@openssh.com', u'umac-128-etm@openssh.com', u'hmac-sha2-256-etm@openssh.com', u'hmac-sha2-512-etm@openssh.com', u'hmac-sha1-etm@openssh.com', u'umac-64@openssh.com', u'umac-128@openssh.com', u'hmac-sha2-256', u'hmac-sha2-512', u'hmac-sha1'] server mac:[u'umac-64-etm@openssh.com', u'umac-128-etm@openssh.com', u'hmac-sha2-256-etm@openssh.com', u'hmac-sha2-512-etm@openssh.com', u'hmac-sha1-etm@openssh.com', u'umac-64@openssh.com', u'umac-128@openssh.com', u'hmac-sha2-256', u'hmac-sha2-512', u'hmac-sha1'] client compress:[u'none', u'zlib@openssh.com'] server compress:[u'none', u'zlib@openssh.com'] client lang:[u''] server lang:[u''] kex follows?False
  51. 2018-07-12 15:01:20,573 - Thread-51 - paramiko.transport - DEBUG - Kex agreed: diffie-hellman-group14-sha1
  52. 2018-07-12 15:01:20,573 - Thread-51 - paramiko.transport - DEBUG - Cipher agreed: aes128-ctr
  53. 2018-07-12 15:01:20,573 - Thread-51 - paramiko.transport - DEBUG - MAC agreed: hmac-sha2-256
  54. 2018-07-12 15:01:20,574 - Thread-51 - paramiko.transport - DEBUG - Compression agreed: none
  55. 2018-07-12 15:01:20,638 - Thread-51 - paramiko.transport - DEBUG - kex engine KexGroup14 specified hash_algo <built-in function openssl_sha1>
  56. 2018-07-12 15:01:20,639 - Thread-51 - paramiko.transport - DEBUG - Switch to new keys ...
  57. 2018-07-12 15:01:20,665 - Thread-47 - paramiko.transport - DEBUG - Adding ssh-rsa host key for 10.5.149.152: 971d3fdab5c16e044f9bd2c715d43843
  58. 2018-07-12 15:01:20,667 - Thread-47 - paramiko.transport - DEBUG - Trying key b9927bb6d18101c38ffdbcd779fabff8 from storperf/resources/ssh/storperf_rsa
  59. 2018-07-12 15:01:20,677 - Thread-51 - paramiko.transport - DEBUG - userauth is OK
  60. 2018-07-12 15:01:20,685 - Thread-51 - paramiko.transport - INFO - Authentication (publickey) successful!
  61. 2018-07-12 15:01:20,699 - Thread-47 - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Remote command: sudo ./fio --rw=read --name=rs --output-format=json --numjobs=1 --direct=1 --filename=/dev/vdb --bs=4096k --loops=200 --ioengine=libaio --size=100% --iodepth=4 --status-interval=60 --parse-only
  62. 2018-07-12 15:01:20,700 - Thread-47 - paramiko.transport - DEBUG - [chan 0] Max packet in: 32768 bytes
  63. 2018-07-12 15:01:20,790 - Thread-51 - paramiko.transport - DEBUG - Received global request "hostkeys-00@openssh.com"
  64. 2018-07-12 15:01:20,790 - Thread-51 - paramiko.transport - DEBUG - Rejecting "hostkeys-00@openssh.com" global request from server.
  65. 2018-07-12 15:01:20,829 - Thread-51 - paramiko.transport - DEBUG - [chan 0] Max packet out: 32768 bytes
  66. 2018-07-12 15:01:20,829 - Thread-51 - paramiko.transport - DEBUG - Secsh channel 0 opened.
  67. 2018-07-12 15:01:20,835 - Thread-51 - paramiko.transport - DEBUG - [chan 0] Sesch channel 0 request ok
  68. 2018-07-12 15:01:20,835 - 10.5.149.152 stdout - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Started
  69. 2018-07-12 15:01:20,836 - 10.5.149.152 stderr - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Started
  70. 2018-07-12 15:01:20,836 - Thread-47 - storperf.fio.fio_invoker:10.5.149.152 - INFO - Started fio on 10.5.149.152
  71. 2018-07-12 15:01:21,201 - 10.5.149.152 stderr - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Finished
  72. 2018-07-12 15:01:21,201 - Thread-51 - paramiko.transport - DEBUG - [chan 0] EOF received (0)
  73. 2018-07-12 15:01:21,202 - 10.5.149.152 stdout - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Finished
  74. 2018-07-12 15:01:21,203 - Thread-51 - paramiko.transport - DEBUG - [chan 0] Unhandled channel request "exit-signal"
  75. 2018-07-12 15:01:21,204 - Thread-51 - paramiko.transport - DEBUG - [chan 0] EOF sent (0)
  76. 2018-07-12 15:01:21,204 - Thread-47 - storperf.fio.fio_invoker:10.5.149.152 - INFO - Finished fio on 10.5.149.152 with exit code -1
  77. 2018-07-12 15:01:21,205 - Thread-47 - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Joining stderr handler
  78. 2018-07-12 15:01:21,205 - Thread-47 - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Joining stdout handler
  79. 2018-07-12 15:01:21,206 - Thread-47 - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Ended
  80. 2018-07-12 15:01:21,305 - Thread-51 - paramiko.transport - DEBUG - EOF in transport thread
  81. 2018-07-12 15:01:21,320 - Thread-47 - storperf.test_executor - INFO - Ended 3e5e9af0-a6d3-4802-9ab1-ed85dd2034bf.rs.queue-depth.4.block-size.4096k.10-5-149-152--dev-vdb
  82. 2018-07-12 15:01:21,321 - Thread-43 - storperf.test_executor - DEBUG - Done waiting for <multiprocessing.pool.ApplyResult object at 0x7f63e9953550>, exit status []
  83. 2018-07-12 15:01:21,571 - Thread-43 - storperf.test_executor - ERROR - Cannot determine installer
  84. 2018-07-12 15:01:21,572 - Workload thread - storperf.test_executor - INFO - Starting job 3e5e9af0-a6d3-4802-9ab1-ed85dd2034bf
  85. 2018-07-12 15:01:21,574 - Thread-43 - werkzeug - INFO - 172.18.0.6 - - [12/Jul/2018 15:01:21] "POST /api/v2.0/jobs HTTP/1.0" 200 -
  86. 2018-07-12 15:01:21,575 - Workload thread - storperf.db.job_db - DEBUG - Connecting to StorPerfJob.db
  87. 2018-07-12 15:01:21,576 - Workload thread - storperf.db.job_db - DEBUG - Job table exists
  88. 2018-07-12 15:01:21,577 - Workload thread - storperf.db.job_db - DEBUG - Job params table exists
  89. 2018-07-12 15:01:21,577 - Workload thread - storperf.db.job_db - DEBUG - Job summary table exists
  90. 2018-07-12 15:01:21,578 - Workload thread - storperf.test_executor - INFO - Workload 3e5e9af0-a6d3-4802-9ab1-ed85dd2034bf.rs.queue-depth.4.block-size.4096k={'rw': u'read', 'name': u'rs', 'output-format': 'json', 'numjobs': '1', 'direct': '1', 'bs': u'4096k', 'loops': '200', 'ioengine': 'libaio', 'iodepth': u'4', 'status-interval': '60'}
  91. 2018-07-12 15:01:21,579 - Workload thread - storperf.test_executor - INFO - Starting run 3e5e9af0-a6d3-4802-9ab1-ed85dd2034bf.rs.queue-depth.4.block-size.4096k
  92. 2018-07-12 15:01:21,584 - Thread-55 - werkzeug - INFO - 172.18.0.6 - - [12/Jul/2018 15:01:21] "GET /api/v2.0/jobs?type=status&id=3e5e9af0-a6d3-4802-9ab1-ed85dd2034bf HTTP/1.0" 404 -
  93. 2018-07-12 15:01:21,585 - Workload thread - storperf.test_executor - DEBUG - Device to profile on 10.5.149.152: /dev/vdb
  94. 2018-07-12 15:01:21,586 - Workload thread - storperf.test_executor - DEBUG - Waiting on <multiprocessing.pool.ApplyResult object at 0x7f63e5927510>
  95. 2018-07-12 15:01:21,586 - Thread-53 - storperf.test_executor - INFO - Starting 3e5e9af0-a6d3-4802-9ab1-ed85dd2034bf.rs.queue-depth.4.block-size.4096k.10-5-149-152--dev-vdb
  96. 2018-07-12 15:01:21,733 - Thread-58 - paramiko.transport - DEBUG - starting thread (client mode): 0xe58a8410L
  97. 2018-07-12 15:01:21,733 - Thread-58 - paramiko.transport - DEBUG - Local version/idstring: SSH-2.0-paramiko_2.0.2
  98. 2018-07-12 15:01:21,740 - Thread-58 - paramiko.transport - DEBUG - Remote version/idstring: SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.4
  99. 2018-07-12 15:01:21,741 - Thread-58 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_7.2p2)
  100. 2018-07-12 15:01:21,742 - Thread-58 - paramiko.transport - DEBUG - kex algos:[u'curve25519-sha256@libssh.org', u'ecdh-sha2-nistp256', u'ecdh-sha2-nistp384', u'ecdh-sha2-nistp521', u'diffie-hellman-group-exchange-sha256', u'diffie-hellman-group14-sha1'] server key:[u'ssh-rsa', u'rsa-sha2-512', u'rsa-sha2-256', u'ecdsa-sha2-nistp256', u'ssh-ed25519'] client encrypt:[u'chacha20-poly1305@openssh.com', u'aes128-ctr', u'aes192-ctr', u'aes256-ctr', u'aes128-gcm@openssh.com', u'aes256-gcm@openssh.com'] server encrypt:[u'chacha20-poly1305@openssh.com', u'aes128-ctr', u'aes192-ctr', u'aes256-ctr', u'aes128-gcm@openssh.com', u'aes256-gcm@openssh.com'] client mac:[u'umac-64-etm@openssh.com', u'umac-128-etm@openssh.com', u'hmac-sha2-256-etm@openssh.com', u'hmac-sha2-512-etm@openssh.com', u'hmac-sha1-etm@openssh.com', u'umac-64@openssh.com', u'umac-128@openssh.com', u'hmac-sha2-256', u'hmac-sha2-512', u'hmac-sha1'] server mac:[u'umac-64-etm@openssh.com', u'umac-128-etm@openssh.com', u'hmac-sha2-256-etm@openssh.com', u'hmac-sha2-512-etm@openssh.com', u'hmac-sha1-etm@openssh.com', u'umac-64@openssh.com', u'umac-128@openssh.com', u'hmac-sha2-256', u'hmac-sha2-512', u'hmac-sha1'] client compress:[u'none', u'zlib@openssh.com'] server compress:[u'none', u'zlib@openssh.com'] client lang:[u''] server lang:[u''] kex follows?False
  101. 2018-07-12 15:01:21,742 - Thread-58 - paramiko.transport - DEBUG - Kex agreed: diffie-hellman-group14-sha1
  102. 2018-07-12 15:01:21,743 - Thread-58 - paramiko.transport - DEBUG - Cipher agreed: aes128-ctr
  103. 2018-07-12 15:01:21,743 - Thread-58 - paramiko.transport - DEBUG - MAC agreed: hmac-sha2-256
  104. 2018-07-12 15:01:21,744 - Thread-58 - paramiko.transport - DEBUG - Compression agreed: none
  105. 2018-07-12 15:01:21,807 - Thread-58 - paramiko.transport - DEBUG - kex engine KexGroup14 specified hash_algo <built-in function openssl_sha1>
  106. 2018-07-12 15:01:21,807 - Thread-58 - paramiko.transport - DEBUG - Switch to new keys ...
  107. 2018-07-12 15:01:21,834 - Thread-53 - paramiko.transport - DEBUG - Adding ssh-rsa host key for 10.5.149.152: 971d3fdab5c16e044f9bd2c715d43843
  108. 2018-07-12 15:01:21,835 - Thread-53 - paramiko.transport - DEBUG - Trying key b9927bb6d18101c38ffdbcd779fabff8 from storperf/resources/ssh/storperf_rsa
  109. 2018-07-12 15:01:21,845 - Thread-58 - paramiko.transport - DEBUG - userauth is OK
  110. 2018-07-12 15:01:21,853 - Thread-58 - paramiko.transport - INFO - Authentication (publickey) successful!
  111. 2018-07-12 15:01:21,867 - Thread-53 - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Remote command: sudo ./fio --rw=read --name=rs --output-format=json --numjobs=1 --direct=1 --filename=/dev/vdb --bs=4096k --loops=200 --ioengine=libaio --size=100% --iodepth=4 --status-interval=60
  112. 2018-07-12 15:01:21,868 - Thread-53 - paramiko.transport - DEBUG - [chan 0] Max packet in: 32768 bytes
  113. 2018-07-12 15:01:21,970 - Thread-58 - paramiko.transport - DEBUG - Received global request "hostkeys-00@openssh.com"
  114. 2018-07-12 15:01:21,971 - Thread-58 - paramiko.transport - DEBUG - Rejecting "hostkeys-00@openssh.com" global request from server.
  115. 2018-07-12 15:01:22,009 - Thread-58 - paramiko.transport - DEBUG - [chan 0] Max packet out: 32768 bytes
  116. 2018-07-12 15:01:22,009 - Thread-58 - paramiko.transport - DEBUG - Secsh channel 0 opened.
  117. 2018-07-12 15:01:22,035 - Thread-58 - paramiko.transport - DEBUG - [chan 0] Sesch channel 0 request ok
  118. 2018-07-12 15:01:22,036 - 10.5.149.152 stdout - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Started
  119. 2018-07-12 15:01:22,036 - Thread-53 - storperf.fio.fio_invoker:10.5.149.152 - INFO - Started fio on 10.5.149.152
  120. 2018-07-12 15:01:22,037 - 10.5.149.152 stderr - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Started
  121. 2018-07-12 15:01:22,343 - Thread-58 - paramiko.transport - DEBUG - [chan 0] Unhandled channel request "exit-signal"
  122. 2018-07-12 15:01:22,344 - 10.5.149.152 stdout - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Finished
  123. 2018-07-12 15:01:22,344 - Thread-58 - paramiko.transport - DEBUG - [chan 0] EOF received (0)
  124. 2018-07-12 15:01:22,345 - 10.5.149.152 stderr - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Finished
  125. 2018-07-12 15:01:22,349 - Thread-58 - paramiko.transport - DEBUG - [chan 0] EOF sent (0)
  126. 2018-07-12 15:01:22,350 - Thread-53 - storperf.fio.fio_invoker:10.5.149.152 - INFO - Finished fio on 10.5.149.152 with exit code -1
  127. 2018-07-12 15:01:22,351 - Thread-53 - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Joining stderr handler
  128. 2018-07-12 15:01:22,352 - Thread-53 - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Joining stdout handler
  129. 2018-07-12 15:01:22,352 - Thread-53 - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Ended
  130. 2018-07-12 15:01:22,451 - Thread-58 - paramiko.transport - DEBUG - EOF in transport thread
  131. 2018-07-12 15:01:22,604 - Thread-60 - storperf.test_executor - INFO - Terminating current run
  132. 2018-07-12 15:01:22,605 - Thread-60 - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Terminating fio on 10.5.149.152
  133. 2018-07-12 15:01:22,607 - Thread-61 - paramiko.transport - DEBUG - starting thread (client mode): 0xe58a8bd0L
  134. 2018-07-12 15:01:22,607 - Thread-61 - paramiko.transport - DEBUG - Local version/idstring: SSH-2.0-paramiko_2.0.2
  135. 2018-07-12 15:01:22,613 - Thread-61 - paramiko.transport - DEBUG - Remote version/idstring: SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.4
  136. 2018-07-12 15:01:22,613 - Thread-61 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_7.2p2)
  137. 2018-07-12 15:01:22,614 - Thread-61 - paramiko.transport - DEBUG - kex algos:[u'curve25519-sha256@libssh.org', u'ecdh-sha2-nistp256', u'ecdh-sha2-nistp384', u'ecdh-sha2-nistp521', u'diffie-hellman-group-exchange-sha256', u'diffie-hellman-group14-sha1'] server key:[u'ssh-rsa', u'rsa-sha2-512', u'rsa-sha2-256', u'ecdsa-sha2-nistp256', u'ssh-ed25519'] client encrypt:[u'chacha20-poly1305@openssh.com', u'aes128-ctr', u'aes192-ctr', u'aes256-ctr', u'aes128-gcm@openssh.com', u'aes256-gcm@openssh.com'] server encrypt:[u'chacha20-poly1305@openssh.com', u'aes128-ctr', u'aes192-ctr', u'aes256-ctr', u'aes128-gcm@openssh.com', u'aes256-gcm@openssh.com'] client mac:[u'umac-64-etm@openssh.com', u'umac-128-etm@openssh.com', u'hmac-sha2-256-etm@openssh.com', u'hmac-sha2-512-etm@openssh.com', u'hmac-sha1-etm@openssh.com', u'umac-64@openssh.com', u'umac-128@openssh.com', u'hmac-sha2-256', u'hmac-sha2-512', u'hmac-sha1'] server mac:[u'umac-64-etm@openssh.com', u'umac-128-etm@openssh.com', u'hmac-sha2-256-etm@openssh.com', u'hmac-sha2-512-etm@openssh.com', u'hmac-sha1-etm@openssh.com', u'umac-64@openssh.com', u'umac-128@openssh.com', u'hmac-sha2-256', u'hmac-sha2-512', u'hmac-sha1'] client compress:[u'none', u'zlib@openssh.com'] server compress:[u'none', u'zlib@openssh.com'] client lang:[u''] server lang:[u''] kex follows?False
  138. 2018-07-12 15:01:22,615 - Thread-61 - paramiko.transport - DEBUG - Kex agreed: diffie-hellman-group14-sha1
  139. 2018-07-12 15:01:22,615 - Thread-61 - paramiko.transport - DEBUG - Cipher agreed: aes128-ctr
  140. 2018-07-12 15:01:22,616 - Thread-61 - paramiko.transport - DEBUG - MAC agreed: hmac-sha2-256
  141. 2018-07-12 15:01:22,616 - Thread-61 - paramiko.transport - DEBUG - Compression agreed: none
  142. 2018-07-12 15:01:22,678 - Thread-61 - paramiko.transport - DEBUG - kex engine KexGroup14 specified hash_algo <built-in function openssl_sha1>
  143. 2018-07-12 15:01:22,679 - Thread-61 - paramiko.transport - DEBUG - Switch to new keys ...
  144. 2018-07-12 15:01:22,681 - Thread-60 - paramiko.transport - DEBUG - Adding ssh-rsa host key for 10.5.149.152: 971d3fdab5c16e044f9bd2c715d43843
  145. 2018-07-12 15:01:22,683 - Thread-60 - paramiko.transport - DEBUG - Trying key b9927bb6d18101c38ffdbcd779fabff8 from storperf/resources/ssh/storperf_rsa
  146. 2018-07-12 15:01:22,689 - Thread-53 - storperf.test_executor - INFO - Ended 3e5e9af0-a6d3-4802-9ab1-ed85dd2034bf.rs.queue-depth.4.block-size.4096k.10-5-149-152--dev-vdb
  147. 2018-07-12 15:01:22,690 - Workload thread - storperf.test_executor - DEBUG - Done waiting for <multiprocessing.pool.ApplyResult object at 0x7f63e5927510>, exit status []
  148. 2018-07-12 15:01:22,690 - Workload thread - storperf.test_executor - INFO - Completed run 3e5e9af0-a6d3-4802-9ab1-ed85dd2034bf.rs.queue-depth.4.block-size.4096k
  149. 2018-07-12 15:01:22,691 - Workload thread - storperf.test_executor - INFO - Completed job 3e5e9af0-a6d3-4802-9ab1-ed85dd2034bf
  150. 2018-07-12 15:01:22,691 - Workload thread - storperf.test_executor - DEBUG - Notifying event listener <bound method StorPerfMaster.executor_event of <storperf.storperf_master.StorPerfMaster object at 0x7f63e670e790>>
  151. 2018-07-12 15:01:22,692 - Workload thread - storperf.test_executor - DEBUG - Notifying event listener <bound method DataHandler.data_event of <storperf.utilities.data_handler.DataHandler object at 0x7f63e57b1d90>>
  152. 2018-07-12 15:01:22,692 - Workload thread - storperf.utilities.data_handler - DEBUG - Event received
  153. 2018-07-12 15:01:22,692 - Workload thread - storperf.test_executor - ERROR - While notifying listener 'steady_state'
  154. Traceback (most recent call last):
  155. File "/storperf/storperf/test_executor.py", line 170, in broadcast_event
  156. event_listener(self)
  157. File "/storperf/storperf/utilities/data_handler.py", line 35, in data_event
  158. self._push_to_db(executor)
  159. File "/storperf/storperf/utilities/data_handler.py", line 140, in _push_to_db
  160. criteria = self._determine_criteria(executor.metadata)
  161. File "/storperf/storperf/utilities/data_handler.py", line 163, in _determine_criteria
  162. for workload, value in metadata['details']['steady_state'].items():
  163. KeyError: 'steady_state'
  164. 2018-07-12 15:01:22,717 - Thread-61 - paramiko.transport - DEBUG - userauth is OK
  165. 2018-07-12 15:01:22,726 - Thread-61 - paramiko.transport - INFO - Authentication (publickey) successful!
  166. 2018-07-12 15:01:22,748 - Thread-60 - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Executing on 10.5.149.152: sudo killall fio
  167. 2018-07-12 15:01:22,765 - Thread-60 - paramiko.transport - DEBUG - [chan 0] Max packet in: 32768 bytes
  168. 2018-07-12 15:01:22,826 - Thread-61 - paramiko.transport - DEBUG - Received global request "hostkeys-00@openssh.com"
  169. 2018-07-12 15:01:22,827 - Thread-61 - paramiko.transport - DEBUG - Rejecting "hostkeys-00@openssh.com" global request from server.
  170. 2018-07-12 15:01:22,827 - Thread-61 - paramiko.transport - DEBUG - [chan 0] Max packet out: 32768 bytes
  171. 2018-07-12 15:01:22,828 - Thread-61 - paramiko.transport - DEBUG - Secsh channel 0 opened.
  172. 2018-07-12 15:01:22,831 - Thread-61 - paramiko.transport - DEBUG - [chan 0] Sesch channel 0 request ok
  173. 2018-07-12 15:01:22,916 - Thread-61 - paramiko.transport - DEBUG - [chan 0] EOF received (0)
  174. 2018-07-12 15:01:22,916 - Thread-60 - storperf.fio.fio_invoker:10.5.149.152 - ERROR - fio: no process found
  175. 2018-07-12 15:01:22,918 - Thread-61 - paramiko.transport - DEBUG - [chan 0] EOF sent (0)
  176. 2018-07-12 15:01:22,918 - Thread-61 - paramiko.transport - DEBUG - Dropping user packet because connection is dead.
  177. 2018-07-12 15:01:22,919 - Thread-61 - paramiko.transport - DEBUG - Dropping user packet because connection is dead.
  178. 2018-07-12 15:01:22,921 - Thread-60 - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Terminating fio on 10.5.149.152
  179. 2018-07-12 15:01:22,923 - Thread-63 - paramiko.transport - DEBUG - starting thread (client mode): 0xe57323d0L
  180. 2018-07-12 15:01:22,923 - Thread-63 - paramiko.transport - DEBUG - Local version/idstring: SSH-2.0-paramiko_2.0.2
  181. 2018-07-12 15:01:22,929 - Thread-63 - paramiko.transport - DEBUG - Remote version/idstring: SSH-2.0-OpenSSH_7.2p2 Ubuntu-4ubuntu2.4
  182. 2018-07-12 15:01:22,929 - Thread-63 - paramiko.transport - INFO - Connected (version 2.0, client OpenSSH_7.2p2)
  183. 2018-07-12 15:01:22,930 - Thread-63 - paramiko.transport - DEBUG - kex algos:[u'curve25519-sha256@libssh.org', u'ecdh-sha2-nistp256', u'ecdh-sha2-nistp384', u'ecdh-sha2-nistp521', u'diffie-hellman-group-exchange-sha256', u'diffie-hellman-group14-sha1'] server key:[u'ssh-rsa', u'rsa-sha2-512', u'rsa-sha2-256', u'ecdsa-sha2-nistp256', u'ssh-ed25519'] client encrypt:[u'chacha20-poly1305@openssh.com', u'aes128-ctr', u'aes192-ctr', u'aes256-ctr', u'aes128-gcm@openssh.com', u'aes256-gcm@openssh.com'] server encrypt:[u'chacha20-poly1305@openssh.com', u'aes128-ctr', u'aes192-ctr', u'aes256-ctr', u'aes128-gcm@openssh.com', u'aes256-gcm@openssh.com'] client mac:[u'umac-64-etm@openssh.com', u'umac-128-etm@openssh.com', u'hmac-sha2-256-etm@openssh.com', u'hmac-sha2-512-etm@openssh.com', u'hmac-sha1-etm@openssh.com', u'umac-64@openssh.com', u'umac-128@openssh.com', u'hmac-sha2-256', u'hmac-sha2-512', u'hmac-sha1'] server mac:[u'umac-64-etm@openssh.com', u'umac-128-etm@openssh.com', u'hmac-sha2-256-etm@openssh.com', u'hmac-sha2-512-etm@openssh.com', u'hmac-sha1-etm@openssh.com', u'umac-64@openssh.com', u'umac-128@openssh.com', u'hmac-sha2-256', u'hmac-sha2-512', u'hmac-sha1'] client compress:[u'none', u'zlib@openssh.com'] server compress:[u'none', u'zlib@openssh.com'] client lang:[u''] server lang:[u''] kex follows?False
  184. 2018-07-12 15:01:22,931 - Thread-63 - paramiko.transport - DEBUG - Kex agreed: diffie-hellman-group14-sha1
  185. 2018-07-12 15:01:22,931 - Thread-63 - paramiko.transport - DEBUG - Cipher agreed: aes128-ctr
  186. 2018-07-12 15:01:22,931 - Thread-63 - paramiko.transport - DEBUG - MAC agreed: hmac-sha2-256
  187. 2018-07-12 15:01:22,932 - Thread-63 - paramiko.transport - DEBUG - Compression agreed: none
  188. 2018-07-12 15:01:22,995 - Thread-63 - paramiko.transport - DEBUG - kex engine KexGroup14 specified hash_algo <built-in function openssl_sha1>
  189. 2018-07-12 15:01:22,995 - Thread-63 - paramiko.transport - DEBUG - Switch to new keys ...
  190. 2018-07-12 15:01:22,997 - Thread-60 - paramiko.transport - DEBUG - Adding ssh-rsa host key for 10.5.149.152: 971d3fdab5c16e044f9bd2c715d43843
  191. 2018-07-12 15:01:22,998 - Thread-60 - paramiko.transport - DEBUG - Trying key b9927bb6d18101c38ffdbcd779fabff8 from storperf/resources/ssh/storperf_rsa
  192. 2018-07-12 15:01:23,033 - Thread-63 - paramiko.transport - DEBUG - userauth is OK
  193. 2018-07-12 15:01:23,041 - Thread-63 - paramiko.transport - INFO - Authentication (publickey) successful!
  194. 2018-07-12 15:01:23,063 - Thread-60 - storperf.fio.fio_invoker:10.5.149.152 - DEBUG - Executing on 10.5.149.152: sudo killall fio
  195. 2018-07-12 15:01:23,063 - Thread-60 - paramiko.transport - DEBUG - [chan 0] Max packet in: 32768 bytes
  196. 2018-07-12 15:01:23,133 - Thread-63 - paramiko.transport - DEBUG - Received global request "hostkeys-00@openssh.com"
  197. 2018-07-12 15:01:23,133 - Thread-63 - paramiko.transport - DEBUG - Rejecting "hostkeys-00@openssh.com" global request from server.
  198. 2018-07-12 15:01:23,172 - Thread-63 - paramiko.transport - DEBUG - [chan 0] Max packet out: 32768 bytes
  199. 2018-07-12 15:01:23,173 - Thread-63 - paramiko.transport - DEBUG - Secsh channel 0 opened.
  200. 2018-07-12 15:01:23,181 - Thread-63 - paramiko.transport - DEBUG - [chan 0] Sesch channel 0 request ok
  201. 2018-07-12 15:01:23,191 - Thread-60 - storperf.fio.fio_invoker:10.5.149.152 - ERROR - fio: no process found
  202. 2018-07-12 15:01:23,192 - Thread-63 - paramiko.transport - DEBUG - [chan 0] EOF received (0)
  203. 2018-07-12 15:01:23,193 - Thread-60 - create_stack - INFO - Deleting stack - StorPerfAgentGroup
  204. 2018-07-12 15:01:45,467 - Thread-60 - create_stack - INFO - Attempting to delete again stack - StorPerfAgentGroup
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!