This module implements the LSFExecutor class responsible for submitting jobs to LSF Scheduler. This class is called in class BuildExecutor when initializing the executors.
The LSFExecutor class is responsible for submitting jobs to LSF Scheduler.
- class buildtest.executors.lsf.LSFExecutor(name, settings, site_configs, account=None, maxpendtime=None, timeout=None)
The LSFExecutor class is responsible for submitting jobs to LSF Scheduler. The LSFExecutor performs the following steps
load: load lsf configuration from buildtest configuration file
dispatch: dispatch job to scheduler and acquire job ID
poll: wait for LSF jobs to finish
gather: Once job is complete, gather job data
Initiate a base executor, meaning we provide a name (also held by the BuildExecutor base that holds it) and the loaded dictionary of config opts to parse.
name (str) – name of executor
setting (dict) – setting for a given executor defined in configuration file
site_configs (buildtest.config.SiteConfiguration) – Instance of SiteConfiguration class
timeout (str, optional) – Test timeout in number of seconds
maxpendtime (int, optional) – Maximum Pending Time until job is cancelled. The default is 1 day (86400s)
account (str, optional) – Account to use for job submission
maxpendtime – Maximum Pending Time until job is cancelled. The default is 1 day (86400s)
- type = 'lsf'
- launcher_command(numprocs=None, numnodes=None)
This command returns the launcher command and any options specified in configuration file. This is useful when generating the build script in the BuilderBase class
This method is responsible for dispatching job to scheduler and extracting job ID by applying a
re.searchagainst output at onset of job submission. If job id is not retrieved due to job failure or unable to match regular expression we mark job incomplete by invoking
buildtest.buildsystem.base.BuilderBase.incomplete`()method and return from method.
If we have a valid job ID we invoke
buildtest.executors.lsf.LSFJobclass given the job id to poll job and store this into
builder (buildtest.buildsystem.base.BuilderBase) – An instance object of BuilderBase type