Installation procedure to CentOS7.6(Makefile.conf)
Appendix : Example of installation procedure to CentOS7.6 (Makefile.conf)
We will explain how to install this software and how to build external libraries required this software on CentOS7.6.
More information for building each libraries, refer to their installation manuals.
Preparation
At first, install the basic build toolchains and libraries as follows.
$ su
# yum group mark install "Development Tools"
# yum update
# yum install openmpi-devel cmake
# exit
Configure the MPI environment settings as follows.
module purge
module local mpi/openmpi-x86_64
If you write the above two lines in $HOME/.bash_profile, the settings will be reflected even after the next login.
Please check compilers and compiler wrapper for MPI works propery as follow.
$ which gcc g++ gfortran mpicc mpic++ mpifort
/usr/bin/gcc
/usr/bin/g++
/usr/bin/gfortran
/usr/lib64/openmpi/bin/mpicc
/usr/lib64/openmpi/bin/mpic++
/usr/lib64/openmpi/bin/mpifort
Installing libraries
Compile and install required libraries this software. Working directory is $HOME/work, destination directory for install is $HOME/local.
And add $HOME/local/bin to PATH environment variable as follows.
cd $HOME
mkdir work
mkdir -p local/bin local/lib local/include
export PATH=$HOME/local/bin:$PATH
Downloads
Downloads the following software and save it to working directory $HOME/work.
| Software | Link |
|---|---|
| REVOCAP_Refiner-1.1.04.tar.gz | https://www.frontistr.com/download/ |
| FrontISTR_V50.tar.gz | https://www.frontistr.com/download/ |
| OpenBLAS-0.2.20.tar.gz | https://www.openblas.net/ |
| metis-5.1.0.tar.gz | https://gitlab.com/FrontISTR-Commons/METIS https://gitlab.com/FrontISTR-Commons/GKlib |
| scalapack-2.0.2.tgz | https://www.netlib.org/scalapack/ |
| MUMPS_5.1.2.tar.gz | https://mumps.enseeiht.fr/ |
| trilinos-12.14.1-Source.tar.bz2 | https://trilinos.org/download/ |
Compiling REVOCAP_Refiner
cd $HOME/work
tar xvf REVOCAP_Refiner-1.1.04.tar.gz
cd REVOCAP_Refiner-1.1.04
make
cp lib/x86_64-linux/libRcapRefiner.a $HOME/local/lib
cp Refiner/rcapRefiner.h $HOME/local/include
Compiling OpenBLAS
cd $HOME/work
tar xvf OpenBLAS-0.2.20.tar.gz
make BINARY=64 NO_SHARED=1 USE_OPENMP=1
make PREFIX=$HOME/local install
Compiling METIS
cd $HOME/work
tar xvf metis-5.1.0.tar.gz
cd metis-5.1.0
make config prefix=$HOME/local cc=gcc openmp=1
make
make install
Compiling ScaLAPACK
$ cd $HOME/work
$ tar xvf scalapack-2.0.2.tgz
$ cd scalapack-2.0.2
$ mkdir build
$ cmake -DCMAKE_INSTALL_PREFIX=$HOME/local \
-DCMAKE_EXE_LINKER_FLAGS="-fopenmp" \
-DBLAS_LIBRARIES=$HOME/local/lib/libopenblas.a \
-DLAPACK_LIBRARIES=$HOME/local/lib/libopenblas.a \
..
$ make
$ make install
Compiling MUMPS
cd $HOME/work
tar xvf MUMPS_5.1.2.tar.gz
cd MUMPS_5.1.2
cp Make.inc/Makefile.inc.generic Makefile.inc
Change the following parts of copied Makefile.inc
$ vi Makefile.inc
$ cp Make.inc/Makefile.inc.generic Makefile.inc
$ vi Makefile.inc
LMETISDIR = $(HOME)/local
IMETIS = -I$(LMETISDIR)/include
LMETIS = -L$(LMETISDIR)/lib -lmetis
ORDERINGSF = -Dmetis -Dpord
CC = mpicc -fopenmp
FC = mpifort -fopenmp
FL = mpifort -fopenmp
LAPACK = -L$(HOME)/local/lib -lopenblas
SCALAP = -L$(HOME)/local/lib -lscalapack
INCPAR = -I/usr/include/openmpi-x86_64
LIBPAR = $(SCALAP) -L/usr/lib64/openmpi/lib -lmpi
LIBBLAS = -L$(HOME)/local/lib -lopenblas
OPTF = -O -DBLR_MT -fopenmp
OPTC = -O -I. -fopenmp
OPTL = -O -fopenmp
Then execute make.
make
cp lib/*.a $HOME/local/lib
cp include/*.h $HOME/local/include
Compiling Trilinos ML
$ cd $HOME/work
$ tar xvf trilinos-12.14.1-Source.tar.gz
$ cd trilinos-12.14.1-Source
$ mkdir build
$ cmake -DCMAKE_INSTALL_PREFIX=$HOME/local \
-DCMAKE_C_COMPILER=mpicc \
-DCMAKE_CXX_COMPILER=mpic++ \
-DCMAKE_Fortran_COMPILER=mpifort \
-DTPL_ENABLE_MPI=ON \
-DTPL_ENABLE_LAPACK=ON \
-DTPL_ENABLE_SCALAPACK=ON \
-DTPL_ENABLE_METIS=ON \
-DTPL_ENABLE_MUMPS=ON \
-DTPL_MUMPS_INCLUDE_DIRS=$HOME/local/include \
-DTrilinos_ENABLE_ML=ON \
-DTrilinos_ENABLE_Zoltan=ON \
-DTrilinos_ENABLE_OpenMP=ON \
-DTrilinos_ENABLE_Amesos=ON \
-DTrilinos_ENABLE_ALL_OPTIONAL_PACKAGES=OFF \
-DBLAS_LIBRARY_DIRS=$HOME/local/lib \
-DLAPACK_LIBRARY_DIRS=$HOME/local/lib" \
-DSCALAPACK_LIBRARY_DIRS=$HOME/local/lib" \
-DBLAS_LIBRARY_NAMES="openblas" \
-DLAPACK_LIBRARY_NAMES="openblas" \
-DSCALAPACK_LIBRARY_NAMES="scalapack" \
..
$ make
$ make install
Compiling FrontISTR
Finishing compiling above libraries, compile FrontISTR.
cd $HOME/work
tar xvf FrontISTR_V50.tar.gz
cd FrontISTR
Editing Makefile.conf
Copy template as Makefile.conf.org to Makfile.conf. Then edit Makefile.conf as follows.
$ cp Makefile.conf.org Makefile.conf
$ vi Makefile.conf
##################################################
# #
# Setup Configulation File for FrontISTR #
# #
##################################################
# MPI
MPIDIR = /usr/lib64/openmpi
MPIBINDIR = $(MPIDIR)/bin
MPILIBDIR = $(MPIDIR)/lib
MPIINCDIR = /usr/include/openmpi-x86_64
MPILIBS = -lmpi -lmpi_cxx -lmpi_mpifh
# for install option only
PREFIX = $(HOME)/FrontISTR
BINDIR = $(PREFIX)/bin
LIBDIR = $(PREFIX)/lib
INCLUDEDIR = $(PREFIX)/include
# Metis
METISDIR = $(HOME)/local
METISLIBDIR = $(METISDIR)/lib
METISINCDIR = $(METISDIR)/include
HECMW_METIS_VER= 5
# Refiner
REFINERDIR = $(HOME)/local
REFINERINCDIR = $(REFINERDIR)/include
REFINERLIBDIR = $(REFINERDIR)/lib
# Coupler
REVOCAPDIR = $(HOME)/local
REVOCAPINCDIR = $(REVOCAPDIR)/include
REVOCAPLIBDIR = $(REVOCAPDIR)/lib
# MUMPS
MUMPSDIR = $(HOME)/local
MUMPSINCDIR = $(MUMPSDIR)/include
MUMPSLIBDIR = $(MUMPSDIR)/lib
MUMPSLIBS = -ldmumps -lmumps_common -lpord -L$HOME/local/lib -lscalapack
# MKL PARDISO
MKLDIR = $(HOME)/
MKLINCDIR = $(MKLDIR)/include
MKLLIBDIR = $(MKLDIR)/lib
# ML
MLDIR = $(HOME)/local
MLINCDIR = $(MLDIR)/include
MLLIBDIR = $(MLDIR)/lib
MLLIBS = -lml -lamesos -ltrilinosss -lzoltan -lepetra -lteuchosremainder -lteuchosnumerics -lteuchoscomm -lteuchosparameterlist -lteuchoscore -ldmumps -lmumps_common -lpord -lmetis
# C compiler settings
CC = mpicc -fopenmp
CFLAGS =
LDFLAGS = -lstdc++ -lm
OPTFLAGS = -O3
# C++ compiler settings
CPP = mpic++ -fopenmp
CPPFLAGS =
CPPLDFLAGS =
CPPOPTFLAGS = -O3
# Fortran compiler settings
F90 = mpif90 -fopenmp
F90FLAGS =
F90LDFLAGS = -lstdc++ -L$(HOME)/local/lib -lopenblas
F90OPTFLAGS = -O2
F90FPP = -cpp
F90LINKER = mpif90 -fopenmp
MAKE = make
AR = ar ruv
MV = mv -f
CP = cp -f
RM = rm -f
MKDIR = mkdir -p
Executing setup.sh
Finished to edit Makefile.conf, then execute setup.sh.
$ ./setup.sh -p --with-tools --with-refiner \
--with-metis --with-mumps --with-lapack --with-ml
Executing make
Execute make command.
make
Executing make install
make install
FrontISTR will be installed to $(HOME)/FrontISTR/bin.
Testing FrontISTR
Run sample case in the tutorial directory and check running of FrontISTR.
$ cd $HOME/work/FrontISTR/tutorial
$ cd 01_elastic_hinge
$ $HOME/FrontISTR/bin/fistr1
Step control not defined! Using default step=1
fstr_setup: OK
Start visualize PSF 1 at timestep 0
loading step= 1
sub_step= 1, current_time= 0.0000E+00, time_inc= 0.1000E+01
loading_factor= 0.0000000 1.0000000
### 3x3 BLOCK CG, SSOR, 1
1 1.903375E+00
2 1.974378E+00
3 2.534627E+00
4 3.004045E+00
5 3.202633E+00
6 3.203864E+00
...
...
When finished analysis, displayed message as follows.
...
...
2966 1.143085E-08
2967 1.078272E-08
2968 1.004759E-08
2969 9.372882E-09
### Relative residual = 9.39169E-09
### summary of linear solver
2969 iterations 9.391687E-09
set-up time : 4.108060E-01
solver time : 6.506822E+01
solver/comm time : 4.342469E-01
solver/matvec : 1.923199E+01
solver/precond : 2.688405E+01
solver/1 iter : 2.191587E-02
work ratio (%) : 9.933263E+01
Start visualize PSF 1 at timestep 1
### FSTR_SOLVE_NLGEOM FINISHED!
====================================
TOTAL TIME (sec) : 74.93
pre (sec) : 1.86
solve (sec) : 73.07
====================================
FrontISTR Completed !!