From b2d978e2cb25922eb3f03623e61aa6fe37ce745a Mon Sep 17 00:00:00 2001 From: Petr Šplíchal Date: Apr 11 2019 09:29:33 +0000 Subject: Clarify usage of multiple playbooks Standard Test Interface does not require `tests.yml` file as the main entry point. Tests and STR pages updated to make this clear. --- diff --git a/modules/ROOT/pages/standard-test-roles.adoc b/modules/ROOT/pages/standard-test-roles.adoc index 6032adb..a367819 100644 --- a/modules/ROOT/pages/standard-test-roles.adoc +++ b/modules/ROOT/pages/standard-test-roles.adoc @@ -51,7 +51,9 @@ Many tests modify or change the system they are run against, so take that into a The following examples invoke tests against the same system that the package git repository is checked out on. Below there are further options for invoking tests against another fully formed and integrated systems, such as an Atomic Host or container image _test subject_. -There may be more than one test present in a package git repository, but the file `tests.yml` is the main entry point. +There may be more than one test present in a package git repository. +Testing system will run each playbook matching the glob `tests/tests*.yml` separately in a clean environment. +Most often a single `tests.yml` file is used as the main entry point. To run it use the following command: ansible-playbook tests.yml diff --git a/modules/ROOT/pages/tests.adoc b/modules/ROOT/pages/tests.adoc index 80c5116..73d617e 100644 --- a/modules/ROOT/pages/tests.adoc +++ b/modules/ROOT/pages/tests.adoc @@ -63,8 +63,9 @@ tags:: all three test subjects (xref:standard-test-roles.adoc#_classic[classic] tests:: list of tests to be executed (here we have just a single smoke test) required_packages:: list of rpm packages required for test execution -There may by multiple files ending in `.yml` in the `tests/` subdirectory and each of them can represent a test or a part of a test. -All of them need to be included in the main `tests.yml` file. +It is possible to separate tests into multiple playbooks, each of them can represent a test or a part of a test. +Testing system will run each playbook matching the glob `tests/tests*.yml` separately in a clean environment. +Optionally you can have multiple playbooks without the `tests` prefix and link them from the `tests.yml` file. Let's have a look at the https://src.fedoraproject.org/rpms/gzip/blob/master/f/tests[gzip] example: > fedpkg clone -a gzip