lava-failure_retry_debug_log

Validating that https://artifactory.softwaretool.com/artifactory/gop-generic-stable-local/build-artifacts/grip-hybrid/01.2447.0/uuu-grip-hybrid-01.2447.0.zip exists
WARNING: Using boot commands supplied in the job definition, NOT the LAVA device configuration
case: validate
case_id: 228798
definition: lava
result: pass
Calling: 'nice' 'relay' 'imx8-hybrid-unit1' 'on'
>> ds378.com [] 17123 (?) open
>> *** RELAY 7 on!**** 
Returned 0 in 1 seconds
start: 2.1 deploy-flasher (timeout 00:20:00) [common]
start: 2.1.1 download-retry (timeout 00:15:00) [common]
start: 2.1.1.1 http-download (timeout 00:15:00) [common]
saving as /var/lib/lava/dispatcher/tmp/4346/deploy-flasher-gayl1hgj/package/uuu-grip-hybrid-01.2447.0.zip
total size: 450767351 (429MB)
No compression specified
progress   0% (0MB)
http-download timed out after 900 seconds
end: 2.1.1.1 http-download (duration 00:15:00) [common]
case: http-download
case_id: 228883
definition: lava
duration: 900.00
extra: ...
level: 2.1.1.1
namespace: common
result: fail
Cleaning up download directory: /var/lib/lava/dispatcher/tmp/4346/deploy-flasher-gayl1hgj/package
Retrying: 2.1.1 download-retry (timeout 00:15:00)
start: 2.1.1.1 http-download (timeout 00:15:00) [common]
saving as /var/lib/lava/dispatcher/tmp/4346/deploy-flasher-gayl1hgj/package/uuu-grip-hybrid-01.2447.0.zip
total size: 450767351 (429MB)
No compression specified
progress   0% (0MB)
progress   5% (21MB)
progress  10% (43MB)
progress  15% (64MB)
progress  20% (86MB)
progress  25% (107MB)
progress  30% (128MB)
progress  35% (150MB)
progress  40% (171MB)
progress  45% (193MB)
progress  50% (214MB)
progress  55% (236MB)
progress  60% (257MB)
progress  65% (279MB)
progress  70% (300MB)
progress  75% (322MB)
progress  80% (343MB)
progress  85% (365MB)
progress  90% (386MB)
progress  95% (408MB)
progress 100% (429MB)
end: 2.1.1.1 http-download (duration 00:04:42) [common]
case: http-download
case_id: 228883
definition: lava
duration: 281.75
extra: ...
level: 2.1.1.1
namespace: common
result: pass
end: 2.1.1 download-retry (duration 00:04:42) [common]
start: 2.1.2 deploy-device-env (timeout 00:00:17) [common]
end: 2.1.2 deploy-device-env (duration 00:00:00) [common]
start: 2.1.3 lava-overlay (timeout 00:00:17) [common]
[common] Preparing overlay tarball in /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc
makedir: /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin
makedir: /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/tests
makedir: /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/results
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-add-keys
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-add-sources
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-background-process-start
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-background-process-stop
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-common-functions
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-echo-ipv4
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-install-packages
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-installed-packages
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-os-build
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-probe-channel
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-probe-ip
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-target-ip
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-target-mac
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-target-storage
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-test-case
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-test-event
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-test-feedback
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-test-raise
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-test-reference
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-test-runner
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-test-set
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/bin/lava-test-shell
Creating /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/environment
device_info:
- LAVA_DEVICE_INFO_0_board_id=Undefined
LAVA metadata
- LAVA_JOB_ID=4346
- LAVA_DISPATCHER_IP
start: 2.1.3.1 ssh-authorize (timeout 00:00:17) [common]
end: 2.1.3.1 ssh-authorize (duration 00:00:00) [common]
start: 2.1.3.2 lava-vland-overlay (timeout 00:00:17) [common]
skipped lava-vland-overlay
end: 2.1.3.2 lava-vland-overlay (duration 00:00:00) [common]
start: 2.1.3.3 lava-multinode-overlay (timeout 00:00:17) [common]
skipped lava-multinode-overlay
end: 2.1.3.3 lava-multinode-overlay (duration 00:00:00) [common]
start: 2.1.3.4 test-definition (timeout 00:00:17) [common]
start: 2.1.3.4.1 git-repo-action (timeout 00:00:17) [common]
Using /lava-4346 at stage 0
Running '/usr/bin/git clone --depth=1 ssh://[email protected]/gop/lava-tests.git /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/0/tests/0_fct-test'
Tests stored (tmp) in /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/0/tests/0_fct-test/lava-test-shell/hybrid-fct-test.yaml
uuid=4346_2.1.3.4.1 testdef=None
end: 2.1.3.4.1 git-repo-action (duration 00:00:03) [common]
case: git-repo-action
case_id: 228885
definition: lava
duration: 3.19
extra: ...
level: 2.1.3.4.1
namespace: common
result: pass
start: 2.1.3.4.2 test-overlay (timeout 00:00:14) [common]
end: 2.1.3.4.2 test-overlay (duration 00:00:00) [common]
case: test-overlay
case_id: 228886
definition: lava
duration: 0.00
extra: ...
level: 2.1.3.4.2
namespace: common
result: pass
start: 2.1.3.4.3 test-install-overlay (timeout 00:00:14) [common]
end: 2.1.3.4.3 test-install-overlay (duration 00:00:00) [common]
case: test-install-overlay
case_id: 228887
definition: lava
duration: 0.00
extra: ...
level: 2.1.3.4.3
namespace: common
result: pass
start: 2.1.3.4.4 test-runscript-overlay (timeout 00:00:14) [common]
runner path: /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/0/tests/0_fct-test test_uuid 4346_2.1.3.4.1
end: 2.1.3.4.4 test-runscript-overlay (duration 00:00:00) [common]
case: test-runscript-overlay
case_id: 228888
definition: lava
duration: 0.00
extra: ...
level: 2.1.3.4.4
namespace: common
result: pass
Using lava-test-runner path: /var/lib/lava/dispatcher/tmp/4346/lava-overlay-bqtdhkfc/lava-4346/0 for stage 0
- 0_fct-test
end: 2.1.3.4 test-definition (duration 00:00:03) [common]
start: 2.1.3.5 compress-overlay (timeout 00:00:14) [common]
end: 2.1.3.5 compress-overlay (duration 00:00:00) [common]
start: 2.1.3.6 persistent-nfs-overlay (timeout 00:00:14) [common]
end: 2.1.3.6 persistent-nfs-overlay (duration 00:00:00) [common]
end: 2.1.3 lava-overlay (duration 00:00:03) [common]
Calling: 'nice' 'flash' 'imx8-hybrid-unit1' 'package/uuu-grip-hybrid-01.2447.0.zip'
>> /var/lib/lava/dispatcher/tmp/4346/deploy-flasher-gayl1hgj/package /var/lib/lava/dispatcher/tmp/4346/deploy-flasher-gayl1hgj
>> *** RELAY 7 off!**** 
>> ds378..com [] 17123 (?) open
>> *** RELAY 8 off!**** 
>> ds378.com [] 17123 (?) open
>> ds378.com [] 17123 (?) open
>> *** RELAY 8 on!**** 
>> ds378.com [] 17123 (?) open
>> *** RELAY 7 on!**** 
>> uuu (Universal Update Utility) for nxp imx chips -- libuuu_1.4.243-0-ged48c51
>>
>> Wait for Known USB Device Appear...
[?25l
Success 0    Failure 0    Wait for Known USB Device Appear...
>>
>> Prep     1/ 0 [                                      ] Http Download\Uncompress
>> 
Success 0    Failure 0    Wait for Known USB Device Appear...
>>
>> Prep     1/ 0 [=================100%=================] Http Download\Uncompress
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  1/ 0 [                                      ]
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  1/ 1 [                                      ] SDP: boot -f imx-boot-64.
>> 
Success 0    Failure 0
>>
>> Prep     1/ 0 [=================100%=================] Http Download\Uncompress
>> 1:41344  1/ 1 [                                      ] SDP: boot -f imx-boot-64.
>> 
Success 0    Failure 0
>>
>> Prep     1/ 0 [=================100%=================] Http Download\Uncompress
>> 1:41344  1/ 1 [                                      ] SDP: boot -f imx-boot-64.
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  1/ 1 [=====>           17%                  ] SDP: boot -f imx-boot-64.
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  1/ 1 [============>    35%                  ] SDP: boot -f imx-boot-64.
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  1/ 1 [=================52%                  ] SDP: boot -f imx-boot-64.
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  1/ 1 [=================70%=====>            ] SDP: boot -f imx-boot-64.
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  1/ 1 [=================87%============>     ] SDP: boot -f imx-boot-64.
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  1/ 1 [=================100%=================] SDP: boot -f imx-boot-64.
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  1/ 1 [                  0%                  ] SDP: boot -f imx-boot-64.
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  1/ 1 [=================100%=================] SDP: boot -f imx-boot-64.
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  1/ 1 [                  0%                  ] SDP: boot -f imx-boot-64.
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  1/ 1 [=================100%=================] SDP: boot -f imx-boot-64.
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  1/ 1 [=================100%=================] SDP: boot -f imx-boot-64.
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  1/ 1 [=================100%=================] SDP: boot -f imx-boot-64.
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  1/ 0 [                                      ]
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  1/ 3 [                                      ] SDPV: delay 1000
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  1/ 3 [                                      ] SDPV: delay 1000
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [                                      ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [                  3%                  ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [=>                6%                  ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [==>              10%                  ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [====>            13%                  ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [=====>           16%                  ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [======>          20%                  ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [========>        23%                  ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [=========>       27%                  ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [==========>      30%                  ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [===========>     33%                  ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [=============>   37%                  ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [==============>  40%                  ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [===============> 44%                  ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [=================47%                  ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [=================50%                  ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [=================54%                  ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [=================57%>                 ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [=================60%==>               ] SDPV: write -f imx-boot-6
>> 
Success 0    Failure 0
>>
>>
>> 1:41344  2/ 3 [=================64%===>              ] SDPV: write -f imx-boot-6
deploy-flasher timed out after 1199 seconds
end: 2.1 deploy-flasher (duration 00:20:00) [common]
case: deploy-flasher
case_id: 228889
definition: lava
duration: 1199.98
extra: ...
level: 2.1
namespace: common
result: fail
Cleaning up download directory: /var/lib/lava/dispatcher/tmp/4346/deploy-flasher-gayl1hgj/package
Retrying: 2 deploy-flasher-retry (timeout 00:20:00)
start: 2.1 deploy-flasher (timeout 00:20:00) [common]
start: 2.1.1 download-retry (timeout 00:15:00) [common]
start: 2.1.1.1 http-download (timeout 00:15:00) [common]
saving as /var/lib/lava/dispatcher/tmp/4346/deploy-flasher-gayl1hgj/package/uuu-grip-hybrid-01.2447.0.zip
total size: 450767351 (429MB)
No compression specified
progress   0% (0MB)
progress   5% (21MB)
progress  10% (43MB)
progress  15% (64MB)
progress  20% (86MB)
progress  25% (107MB)
progress  30% (128MB)
progress  35% (150MB)
progress  40% (171MB)
progress  45% (193MB)
progress  50% (214MB)
progress  55% (236MB)
progress  60% (257MB)
progress  65% (279MB)
progress  70% (300MB)
progress  75% (322MB)
progress  80% (343MB)
progress  85% (365MB)
progress  90% (386MB)
progress  95% (408MB)
progress 100% (429MB)
end: 2.1.1.1 http-download (duration 00:01:52) [common]
case: http-download
case_id: 228883
definition: lava
duration: 112.21
extra: ...
level: 2.1.1.1
namespace: common
result: pass