LSF

Note

This resource manager has limited support from the Open OnDemand developers. This is because it was either contributed by the community or the developers no longer have access to a live system to test against.

Due to this lack of access, the developers may not be able to fix bugs or issues.

However, community patches are always welcome.

A YAML cluster configuration file for an LSF resource manager on an HPC cluster looks like:

# /etc/ood/config/clusters.d/my_cluster.yml
---
v2:
  metadata:
    title: "My Cluster"
  login:
    host: "my_cluster.my_center.edu"
  job:
    adapter: "lsf"
    bindir: "/path/to/lsf/bin"
    libdir: "/path/to/lsf/lib"
    envdir: "/path/to/lsf/conf"
    serverdir: "/path/to/lsf/etc"
    cluster: "mycluster"
    # bin_overrides:
      # bsub: "/usr/local/bin/bsub"
      # bjobs: ""
      # bstop: ""
      # bresume: ""
      # bkill: ""

with the following configuration options:

adapter

This is set to lsf.

bindir

The path to the LSF client bin/ directory.

libdir

The path to the LSF client lib/ directory.

envdir

The path to the LSF client conf/ directory.

serverdir

The path to the LSF client etc/ directory.

bin_overrides

Replacements/wrappers for LSF's job submission and control clients. Optional

submit_host

A different, optional host to ssh to and then issue commands. Optional

cluster

The cluster to interact with when running LSF's multi-cluster mode. Required to enable multi-cluster mode

Supports the following clients:

bsub
bjobs
bstop
bresume
bkill

Advanced LSF settings

Performance Settings

Given these settings in lsf.conf:

LSB_QUERY_PORT=688X
LSB_QUERY_ENH=y

It's recommended that you set LSB_MBD_PORT to the same value as LSB_QUERY_PORT

It has also been observed that setting these values in lsb.params helps with the performance of the cluster and in turn Open OnDemand's usage.

JOB_INFO_MEMORY_CACHE_SIZE=2048
MBD_REFRESH_TIME=5
NEWJOB_REFRESH=Y