test/py: Implement pytest infrastructure
authorStephen Warren <swarren@wwwdotorg.org>
Fri, 15 Jan 2016 18:15:24 +0000 (11:15 -0700)
committerSimon Glass <sjg@chromium.org>
Thu, 21 Jan 2016 02:06:23 +0000 (19:06 -0700)
commitd201506cca782c54309b488170623094f252aab5
treec70a6ecd955073d269ed9dea69f26ad62a7fe248
parent27067a46c56cdaa0f8a2ef433f0aed4376834c44
test/py: Implement pytest infrastructure

This tool aims to test U-Boot by executing U-Boot shell commands using the
console interface. A single top-level script exists to execute or attach
to the U-Boot console, run the entire script of tests against it, and
summarize the results. Advantages of this approach are:

- Testing is performed in the same way a user or script would interact
  with U-Boot; there can be no disconnect.
- There is no need to write or embed test-related code into U-Boot itself.
  It is asserted that writing test-related code in Python is simpler and
  more flexible that writing it all in C.
- It is reasonably simple to interact with U-Boot in this way.

A few simple tests are provided as examples. Soon, we should convert as
many as possible of the other tests in test/* and test/cmd_ut.c too.

The hook scripts, relay control utilities, and udev rules I use for my
own HW setup are published at https://github.com/swarren/uboot-test-hooks.

See README.md for more details!

Signed-off-by: Stephen Warren <swarren@wwwdotorg.org>
Signed-off-by: Stephen Warren <swarren@nvidia.com>
Tested-by: Michal Simek <michal.simek@xilinx.com>
Tested-by: Simon Glass <sjg@chromium.org>
Acked-by: Simon Glass <sjg@chromium.org> #v3
14 files changed:
test/py/.gitignore [new file with mode: 0644]
test/py/README.md [new file with mode: 0644]
test/py/conftest.py [new file with mode: 0644]
test/py/multiplexed_log.css [new file with mode: 0644]
test/py/multiplexed_log.py [new file with mode: 0644]
test/py/pytest.ini [new file with mode: 0644]
test/py/test.py [new file with mode: 0755]
test/py/tests/test_000_version.py [new file with mode: 0644]
test/py/tests/test_help.py [new file with mode: 0644]
test/py/tests/test_unknown_cmd.py [new file with mode: 0644]
test/py/u_boot_console_base.py [new file with mode: 0644]
test/py/u_boot_console_exec_attach.py [new file with mode: 0644]
test/py/u_boot_console_sandbox.py [new file with mode: 0644]
test/py/u_boot_spawn.py [new file with mode: 0644]