test-runner for manual tests

naresh@linaro:~/git-local/2016/manual-test-milosz/test-definitions$ test-runner  -d manual/generic/linux/usb-ethernet.yaml -o ~/output-dir -k manual
2016-11-16 15:21:24,754 - RUNNER: INFO: Tests to run:
{'path': 'manual/generic/linux/usb-ethernet.yaml', 'uuid': '61df2ee4-d3ab-400e-978a-6fc090332987', 'timeout': None, 'skip_install': False}
2016-11-16 15:21:24,796 - RUNNER.TestSetup: INFO: Output directory created: /home/naresh/output-dir
2016-11-16 15:21:25,361 - RUNNER.TestSetup: INFO: Test repo copied to: /home/naresh/output-dir/usb-ethernet_61df2ee4-d3ab-400e-978a-6fc090332987
usb-ethernet
Welcome to manual test executor. Type 'help' for available commands
usb-ethernet > help

Documented commands (type help <topic>):
========================================
EOF      description  fail  next  quit  start
current  expected     help  pass  skip  steps

usb-ethernet > ifconfig eth0
*** Unknown syntax: ifconfig eth0
usb-ethernet > description
Test if USB Ethernet works on Linux
usb-ethernet > start
0. Login as root and plug in your USB Ethernet gadget.
usb-ethernet >
0. Login as root and plug in your USB Ethernet gadget.
usb-ethernet > next
1. Run "dmesg" to find the device ID. Take "eth0" for example.
usb-ethernet > current dmesg
1. Run "dmesg" to find the device ID. Take "eth0" for example.
usb-ethernet > dmesg
*** Unknown syntax: dmesg
usb-ethernet > steps dmesg
0. Login as root and plug in your USB Ethernet gadget.
1. Run "dmesg" to find the device ID. Take "eth0" for example.
2. Run "ifconfig eth0" to check if IP address assigned by DHCP server. If not, run "dhclient eth0" to get an IP address.
3. ping www.google.com
4. wget http://testdata.validation.linaro.org/media_codec/vpx_streams/vp90-2-tos_1280x534_tile_1x4_1306kbps.webm
usb-ethernet > current
1. Run "dmesg" to find the device ID. Take "eth0" for example.
usb-ethernet > dmesg
*** Unknown syntax: dmesg
usb-ethernet > run dmesg
*** Unknown syntax: run dmesg
usb-ethernet > pass dmesg
Recording pass in /home/naresh/output-dir/usb-ethernet_61df2ee4-d3ab-400e-978a-6fc090332987/stdout.log
2016-11-16 15:26:33,600 - RUNNER.ResultParser: INFO: Result files saved to: /home/naresh/output-dir/usb-ethernet_61df2ee4-d3ab-400e-978a-6fc090332987
--- Printing result.csv ---
test,test_case_id,result,measurement,units,test_params
usb-ethernet,usb-ethernet,pass,,,

naresh@linaro:~/git-local/2016/manual-test-milosz/test-definitions$