mirror of
https://github.com/xcat2/xcat-core.git
synced 2026-10-21 23:28:19 +00:00
Daniel Hilst
c6fc094c93
The Perl tests of the OpenEmbedded Genesis image ran its shell scripts
and C programs through system(), qx, pipes and fork, wrote fake
commands through copied read_file and write_file helpers, and matched
regexes against shell and C source. Many rejections checked only a
non-zero exit, so an earlier, unrelated failure also passed. The
quality gate judged 91% of their 762 checks bad.
The shell and C checks move to bats in xCAT-test/bats. The C programs
are compiled there and run: the plain console, test drivers for the
shared status view and the shell launcher, and genesis-udp-send against
a loopback listener. Each rejection now matches the message of its own
guard. The .t files keep the artifact checks (kas, recipes, kernel
fragments, units, README), read with XCAT::Test::File. Test files left
with no checks are deleted.
Claim map (file -> where its claims went):
- go_xcat_uninstall_installed_only.t -> go_xcat_uninstall_installed_only.bats
- genesis_readme_paths.t, genesis_base_sources_staged.t -> kept in the
.t (README read by slurp_repo_file, tarball read by Archive::Tar)
- genesis_openembedded_{export,hardware,runtime}.t -> the bats file of
the same name
- genesis_openembedded_{bmcsetup,metrics,extensions,qeth,actions,
discovery}.t -> scripts to the bats file of the same name, recipes
and units kept in the .t
- genesis_openembedded_console.t -> built and run checks, state.c,
plain_ui.c and shell.c to genesis_openembedded_console.bats; Newt
source checks kept in the .t
- genesis_openembedded.t -> oe/build to genesis_openembedded_build.bats;
shell matches to the runtime, hardware and extensions bats; console
matches to the console bats or the console .t; artifacts kept
Red proof: every moved or new test was run against a mutated copy of
the code it covers and went red, for example: rpm -q not checked,
tar without --mtime, VEX report not exported, support dir after PATH,
digest check off, layer2 forced, wildcard device allowed, arguments
eval'd, tcp probe skipped, SOURCE_PORT 302, AF_INET only, stage timer
compared, launch error ignored, kas run twice, status written in place.
One mutation stayed green: tar without --owner=0 when the test runs as
root.
Signed-off-by: Daniel Hilst <392820+dhilst@users.noreply.github.com>
35 lines
1.4 KiB
Perl
35 lines
1.4 KiB
Perl
#!/usr/bin/env perl
|
|
use strict;
|
|
use warnings;
|
|
|
|
use FindBin;
|
|
use lib "$FindBin::Bin/../lib";
|
|
use Test::More;
|
|
|
|
use XCAT::Test::File qw(repo_path slurp_repo_file);
|
|
|
|
# The systemd unit and the recipes are the artifact. genesis-qeth is shell and is tested in
|
|
# xCAT-test/bats/genesis_openembedded_qeth.bats.
|
|
|
|
my $META = 'xCAT-genesis-base/oe/meta-xcat-genesis';
|
|
my $QETH = "$META/recipes-connectivity/xcat-genesis-qeth";
|
|
|
|
my $service_contents = slurp_repo_file("$QETH/files/xcat-genesis-qeth.service");
|
|
like( $service_contents, qr/^ConditionArchitecture=s390x$/m,
|
|
'the activation service is limited to s390x' );
|
|
like( $service_contents, qr/^ConditionKernelCommandLine=xcatd$/m,
|
|
'the activation service requires a Genesis boot' );
|
|
like( $service_contents, qr/^Before=.*\bNetworkManager\.service\b/m,
|
|
'qeth activation precedes NetworkManager' );
|
|
like( $service_contents, qr/^Before=.*\bxcat-genesis-network-state\.service\b/m,
|
|
'qeth activation precedes management network selection' );
|
|
like( $service_contents, qr/^TimeoutStartSec=120$/m,
|
|
'a stalled qeth command cannot block network startup indefinitely' );
|
|
|
|
ok( -f repo_path("$QETH/xcat-genesis-qeth_1.0.bb"),
|
|
'the qeth service has an OpenEmbedded recipe' );
|
|
ok( -f repo_path("$META/recipes-support/s390-tools/s390-tools-znetconf_2.41.0.bb"),
|
|
'the minimal znetconf package has an OpenEmbedded recipe' );
|
|
|
|
done_testing();
|