#4 Clarification of the test runner
Merged by psss. Opened by psss.
runner  into  master

Download 4.patch

Changes proposed by @astepano on the original wiki page in order to clarify what the test runner is.

Testing-system delegates test-running to test-runner. test-runner system can
be different from test environment. E.g. Ansible is run on the test-runner
and tests are executed on the managed host test . Usually for _test-runner is
used a stable version of OS.

The testing system SHOULD stage a clean test-runner for each set of tests it runs.

I would keep only standard-test-roles

. The testing system MUST stage the following packages on the test runner:

rebased onto 549174e210390a1f4daf61fdca04dcd268586f40

Thanks for the feedback, @astepano. I've updated the pull request.

@psss, thank you. Looks good.

Metadata Update from @psss:
- Pull-request tagged with: Standard Test Interface

Some tests, like the Cockpit CI tests, need to setup their own VMs for running tests. They launch qemu to do this. Is that compatible with these changes?

Yes, it should be compatible. Basically this is only clarification of the difference between test runner which runs tests and needs standard-test-roles to be installed and test environment where tests are executed. For Cockpit case I guess the VMs are test environment.

LGTM also :clap:

Thanks for the feedback, merging.

Pull-Request has been merged by psss

Metadata