ansys¶

Summary

Source: http://www.ansys.com/products

License: commercial product for academic use only. Also check https://www.ansys.com/footer/terms-and-conditions for details. Path: /software/lumerical

Documentation: http://www.ansys.com/product

Downloads: see downloads page

License information¶

export ANSYSLI_SERVERS=2325@zitlic10.desy.de
export ANSYSLMD_LICENSE_FILE=1055@zitlic10.desy.de

The list of licensed modules (and your current license usage) can be found using the command

my-licenses -p ansys | egrep 'lum|Overview'

Using Lumerical on Maxwell¶

A couple of ansys versions are pre-installed on Maxwel under /software/ansys. To initialize the environment use

Basic lumerical installations are available on maxwell at /software/lumerical/. You can load a module - module load maxwell lumerical - or launch applications directly from /software/lumerical//bin/, e.g. /software/lumerical/2022/bin/mode-solutions.

module load maxwell lumerical # loads the newest version, e.g. module load maxwell lumerical/2021 to set a specific version
lumerical                     # starts the launcher

The lumerical module also creates a file ~/.config/Lumerical/License.ini if it doesn't exist. If lumerical nevertheless asks for a license server configuration, set "Ansys (Standard)" with zitlic10.desy.de as license server using the default port (or 1055) as shown in the screenshot:

Lumerical in batch ==¶

Running a lumerical batch-job on maxwell is basically very simple. A sample script could look like this:

#!/bin/bash                                                                                                                         
#SBATCH --partition=short                                                                                                           
#SBATCH --time=0-02:00                                                                                                              
#SBATCH --job-name=lumerical                                                                                                        
#SBATCH --nodes=1                                                                                                                   
unset LD_PRELOAD
source /etc/profile.d/modules.sh

# number of physical cores per node                                                                                                 
N=$(( $(nproc) / 2 ))

#
# this is just an example! 
# when use_mpich=0, lumerical will use the MPI implementation shipping with lumerical
# otherwise it's using an openmpi variant available on Maxwell. 
# the latter has better performance at least on EPYC nodes. 
#
use_mpich=0

if [[ $use_mpich -eq 0 ]]; then
    /software/lumerical/2021/mpich2/nemesis/bin/mpiexec -ppn $N /software/lumerical/2021/bin/fdtd-engine-mpich2nem -t 1 $PWD/fdtd_grating_trial.fsp
else
    module load maxwell gcc/9.3 openmpi/3.1.6
    mpirun -N $N --mca pml ucx --mca mpi_cuda_support 0  /software/lumerical/2021/bin/fdtd-engine-ompi-lcl -t 1 $PWD/fdtd_grating_trial.fsp
fi

submit the script from the folder containing the lumerical input-file (fdtd_grating_trial.fsp in the sample) with

sbatch lumerical.sh

(assuming that the script was named lumerical.sh).