Running Test

usage: buildtest run [-h] [-s SOFTWARE-TEST-SUITE] [-p PACKAGE-TEST-SUITE] [-S {compilers,openmp}] [-j]

optional arguments:
  -h, --help            show this help message and exit
  -s SOFTWARE-TEST-SUITE, --software SOFTWARE-TEST-SUITE
                        Run test suite for application
  -p PACKAGE-TEST-SUITE, --package PACKAGE-TEST-SUITE
                        Run test suite for system package
  -S {compilers,openmp}, --suite {compilers,openmp}
                        Run the test suite
  -j, --job             Submit jobs to resource scheduler

Run an Application Test Suite (buildtest run --software)

buildtest can run test written in $BUILDTEST_TESTDIR for a particular application specified by option --software. The choice field for this option is populated based on directories found in $BUILDTEST_TESTDIR which were created by subsequent runs of buildtest build -s <application>.

(buildtest) [siddis14@adwnode11 buildtest-framework]$ buildtest run --software
GCC/6.4.0-2.28             GCCcore/6.4.0              Perl/5.26.0-GCCcore-6.4.0

Shown below is an output of buildtest run --software GCCcore/6.4.0 which attempts to run all tests for application GCCcore/6.4.0

---------------------------------------------------------
Executing Test: /tmp/buildtest-tests/ebapp/GCCcore/6.4.0/omp_orphan.f.csh >/dev/null 2>&1
---------------------------------------------------------
Test Successful
---------------------------------------------------------
Executing Test: /tmp/buildtest-tests/ebapp/GCCcore/6.4.0/omp_dotprod_serial.f.csh >/dev/null 2>&1
---------------------------------------------------------
Test Successful
---------------------------------------------------------
==============================================================
                         Test summary                         
Application:  GCCcore/6.4.0
Executed 126 tests
Passed Tests: 126    Percentage: 100.0%
Failed Tests: 0    Percentage: 0.0%

Run a System Package Test Suite (buildtest run --package)

Similarly, buildtest run --package is used to run test suite for system packages that were built by option buildtest build --package <package>

Shown below is an output of buildtest run --package gcc

Executing Test: /tmp/buildtest-tests/system/gcc/which__usr_bin_c89.sh >/dev/null 2>&1
---------------------------------------------------------
Test Successful
---------------------------------------------------------
Executing Test: /tmp/buildtest-tests/system/gcc/which__usr_bin_c99.sh >/dev/null 2>&1
---------------------------------------------------------
Test Successful
---------------------------------------------------------
Executing Test: /tmp/buildtest-tests/system/gcc/which__usr_bin_gcc.sh >/dev/null 2>&1
---------------------------------------------------------
Test Successful
---------------------------------------------------------
Executing Test: /tmp/buildtest-tests/system/gcc/which__usr_bin_gcc-ar.sh >/dev/null 2>&1
---------------------------------------------------------
Test Successful
---------------------------------------------------------
Executing Test: /tmp/buildtest-tests/system/gcc/which__usr_bin_gcc-nm.sh >/dev/null 2>&1
---------------------------------------------------------
Test Successful
---------------------------------------------------------
Executing Test: /tmp/buildtest-tests/system/gcc/which__usr_bin_gcc-ranlib.sh >/dev/null 2>&1
---------------------------------------------------------
Test Successful
---------------------------------------------------------
Executing Test: /tmp/buildtest-tests/system/gcc/which__usr_bin_gcov.sh >/dev/null 2>&1
---------------------------------------------------------
Test Successful
---------------------------------------------------------
==============================================================
                         Test summary                         
System Package:  gcc
Executed 7 tests
Passed Tests: 7    Percentage: 100.0%
Failed Tests: 0    Percentage: 0.0%