Writing Buildspecs

Buildspec Reference

• Global Schema
  • Schema Definition
  • Example Buildspec
  • Defining Maintainers
  • Test Names
  • Buildspec Structure
• Compilation Example
  • Hello World Example
  • STREAM Benchmark Example
• Defining Metrics
  • Metrics with Regex Type via ‘re’
  • Extract line numbers in Metrics
  • Invalid Metrics
• Test Dependency
  • Test Dependency by returncode
  • Test Dependency by state
• Running Test Across Multiple Executors
  • Multiple Executors
  • Scheduler Directives
  • Cray Burst Buffer and Data Warp
  • Custom Status by Executor
• Customize Shell
  • Shell Type
  • Customize Shebang
  • Python Shell
• Running Tests in Containers (Experimental)
  • Running a docker container
  • Running a Singularity container
  • Run Commands in Container
  • Running Scripts in Container
  • Specify Volume Mounts
  • Running Test in Container Executor
• Status Checks
  • returncode: Return Code Matching
  • regex: Regular Expression on stdout/stderr
  • file_regex: Regular Expression on files
  • runtime: Passing Test based on runtime
  • state: Explicitly Declare Status of Test
  • File Checks
  • file_count: File Count
  • linecount: Line Count on Stdout/Stderr
  • file_linecount: Line Count on File
  • re: Modify regular expression method
  • post_run: Specify Post Run Tests
• Comparison Operators
  • assert_ge: Greater Equal
  • assert_gt: Greater Than
  • assert_le: Less Than Equal
  • assert_lt: Less Than
  • assert_eq: Equal
  • assert_ne: Not Equal
  • assert_range: Upper and Lower Bound
  • contains, not_contains: Contains and Not Contains