Introduction to HPC Module system

Introduction to HPC Module System

 

Most HPC clusters have many software packages available for various needs. Most installed packages are available as environment modules. You can find out about an installed software/module using the following command:-
 
module avail 
This command will list all the installed software and modules in your cluster.

Use:
module load <module/version>        to load a module
module unload <module/version>    when done.

Generally, use as few modules as possible at a time. Once you're done using a particular piece of software, unload it before you load another one to avoid incompatibilities.

If you cannot find a piece of software on the cluster, you can request an installation for cluster-wide use. Read through the Software Installation Policy page, and send your software request through the Software Installation Request form:

Contact hpc-help@ucdavis.edu with any other software issues.

Conda


Users can install their own Conda package by loading the system-installed Conda and then creating and activating their required environments:

module load conda
conda create -n [name of the environment] -c [name of the channels] [list of packages to install]
conda activate [name of environment]

Note that you can leave off the -c bioconda, because the system-wide conda configuration already has the bioconda channel configured as well as conda-forge

You can also replace conda with mamba in the create phase, it will solve the environment much more quickly. When the environment is active, you can run the following command to see that it lives in your home directory:

echo $CONDA_PREFIX


Python
 

Python is also installed and is available in the cluster Conda; you can load it using:

module load conda
conda activate
Python

R


R is a programming language and software environment for statistical computing and graphics. R offers a wide variety of statistics-related libraries and provides a favorable environment for statistical computing and design. In addition, the R programming language gets used by many quantitative analysts as a programming tool since it's useful for data importing and cleaning.

To see different versions of R installed on the cluster, run the command:

$ module avail -l R/

You can obtain R in your environment by loading the R module for the version you want, i.e.:

$ module load R/4.4.2

Once the module is loaded, you can run R like usual:

$ R

To check available libraries and packages within R, use the following command:

library(library-name) OR installed.packages()

You can install additional R packages with the normal method:

install.packages("package-name")


RStudio Server


Rstudio server enables you to provide a browser-based interface to a version of R running on a remote Linux server, bringing the power and productivity of the RStudio IDE to server-based deployments of R.

RStudio Server is available through Open OnDemand on select clusters. See https://docs.hpc.ucdavis.edu/software/ondemand/ for more information.
 

What is available software in Franklin cluster?

Franklin users can read about the available software in Franklin cluster on our documentation page:
https://docs.hpc.ucdavis.edu/franklin/software/modules/ 

How do I send Software Installation Request?

All users are encouraged to read through the Software Installation Policy document and then use the below link to send software request:
https://hpc.ucdavis.edu/form/software-installation-request