From 549174e210390a1f4daf61fdca04dcd268586f40 Mon Sep 17 00:00:00 2001 From: Petr Šplíchal Date: Feb 12 2019 11:08:53 +0000 Subject: Clarification of the test runner --- diff --git a/modules/ROOT/pages/standard-test-interface.adoc b/modules/ROOT/pages/standard-test-interface.adoc index 2267004..f9d3380 100644 --- a/modules/ROOT/pages/standard-test-interface.adoc +++ b/modules/ROOT/pages/standard-test-interface.adoc @@ -78,9 +78,9 @@ https://developers.openshift.com/managing-your-applications/continuous-integrati https://wiki.ubuntu.com/ProposedMigration/AutopkgtestInfrastructure[Ubuntu CI]... Test Runner:: -Testing system uses _test runner_ as a place for running tests. Testing -system delegates test-running to test runner. Test runner examples: -local machine, VM... +_Testing system_ delegates running of the test to _test runner_ which can be different from _test environment_. +For example ansible is run on the _test runner_ and tests are executed on the managed host. +Usually a stable version of OS is used for _test runner_. == Responsibilities == @@ -147,10 +147,10 @@ liberty of the packagers but there are one or more playbooks in the `tests/` folder that can be invoked to run the test suites. . The _testing system_ SHOULD stage the tests on target (eg: Fedora) operating system appropriate for the branch name of the dist-git repository containing the tests. -. The _testing system_ SHOULD stage a clean system for each set of tests it runs. -. The _testing system_ MUST stage the following packages: -.. `ansible python2-dnf libselinux-python standard-test-roles` -. The _testing system_ MUST clone the dist-git repository for the test, and checks out the appropriate branch. +. The _testing system_ SHOULD stage a clean _test runner_ for each set of tests it runs. +. The _testing system_ MUST stage the following package on the _test runner_: +.. `standard-test-roles` +. The _testing system_ MUST clone the dist-git repository for the test on the _test runner_, and checks out the appropriate branch. . The contents of `/etc/yum.repos.d` on the *staged system* SHOULD be replaced with repository information that reflects the known good Fedora packages corresponding to the branch of the dist-git repository. .. The _testing system_ MAY use multiple repositories, including _updates_ or _updates-testing_ to ensure this.