MPICH2 and SCALAPACK

[TronCarter]

Hi,

In my new job I inherited a user that has a RedHat 7.3 cluster that uses MPICH 1.1 and SCALAPACK. I am trying to figure out how to do a new installation of the above software on a SUSE 10.1 box because ultimately I would like to upgrade the cluster to SUSE and MPICH2.

Has anyone out there been able to successfully use MPICH2 and SCALAPACK?

This is my first real use of either software so I am not real familiar with the errors that one might see and I have been able to figure most of them out on my own, but have had trouble installing BLACS, before I can even attempt a SCALAPACK installation. I get the following error:

make[2]: *** No rule to make target `/export/mpich2/include/mpif.h', needed by `mpif.h'. Stop.
make[1]: *** [INTERN] Error 2
make[1]: Leaving directory `/export/BLACS/SRC/MPI'
make: *** [MPI] Error 2

A better question might be to ask if there is any performance difference between MPICH 1.2 (included with SUSE), or MPICH2. Maybe I am wasting my time with 2 if 1.2 will do what I need. Maybe that's a question for an MPICH forum.

Thank you for any help or advice you can offer.

[Julie]

Hi,

Just locate your mpif.h on your machine and add the -I"Path to mpif.f" on the compiling sequence.

Here, we are working mostly with OpenMpi, the new MPI library.
You can have a look at http://www.open-mpi.org.
Its performance are on the average better than MPICH or MPICH2

Julie

[TronCarter]

Hi Julie,

Thanks for the reply. I downloaded and am trying out openMPI. So far I have been able to get BLACS to install without error, but when I try to install the BLACS tester, I get this error:

make[1]: Entering directory `/export/BLACS/TESTING'
mpif77 -Nx400 -c blacstest.f
gfortran: unrecognized option '-Nx400'


Several times during the make tester process I get the unrecognized option 'Nx400'. In BMake.inc, there is:

F77NO_OPTFLAGS = Nx400

but I don't know what that should be set to, or on the other hand, if I should even bother/worry about the tester.

[Julie]

Hi,

I never tried to use gfortran with Open-Mpi/BLACS/ScaLAPACK, but I don't se any reason why it should not work.

I would set:

Code: Select all

F77NO_OPTFLAGS =

You have to verify that the BLACS testers go throught correctly, that will spare you many problems later on.
Usually, once you managed to installed the BLACS correctly, ScaLAPACK is fairly easy to install.

Julie

[TronCarter]

I tried it with the NO_OPTFLAGS blank as you had suggested, and come up with errors. I have also tried with g77 instead of gfortran (not sure of the exact differences) but come up with the same errors with both versions of the NO_OPTFLAGS.

With NO_OPTFLAGS =
I get many 'errors' like this:

Argument #13 (named `erribuf') of `zchkamn' is one type at (2) but is some other type at (1) [info -f g77 M GLOBALS]

followed at the end by this:

make[1]: *** [blacstest.o] Error 1
make[1]: Leaving directory `/export/BLACS/TESTING'
make: *** [tester] Error 2

What fortran compiler do you use?

[bruce]

Hi,

I installed MPICH2 and met error in testing BLACS. I have already done the flags modification in the toplevel Makefile on line 39.

here is the error message:

[root@athena TESTING]$ make
f77 -Nx400 -fno-globals -fno-f90 -fugly-complex -w -c blacstest.f
f77: unrecognized option `-Nx400'
make mpif.h
make[1]: Entering directory `/usr/local/computation/blacs/BLACS/TESTING'
rm -f mpif.h
ln -s /opt/MPICH2/include/mpif.h mpif.h
make[1]: Leaving directory `/usr/local/computation/blacs/BLACS/TESTING'
f77 -c -Nx400 -O btprim_MPI.f
f77: unrecognized option `-Nx400'
f77 -Nx400 -c tools.f
f77: unrecognized option `-Nx400'
f77 -o /usr/local/computation/blacs/BLACS/TESTING/EXE/xFbtest_MPI-LINUX-1 blacstest.o btprim_MPI.o tools.o /usr/local/computation/blacs/BLACS/LIB/blacsF77init_MPI-LINUX-1.a /usr/local/computation/blacs/BLACS/LIB/blacs_MPI-LINUX-1.a /usr/local/computation/blacs/BLACS/LIB/blacsF77init_MPI-LINUX-1.a /opt/MPICH2/lib/LINUX/ch_p4/libmpi.a
f77: /opt/MPICH2/lib/LINUX/ch_p4/libmpi.a: No such file or directory
make: *** [/usr/local/computation/blacs/BLACS/TESTING/EXE/xFbtest_MPI-LINUX-1] Error 1

===============

There are two things that confused me.

One is that unrecgonized Nx400.

The other thing is the following entry set in the Bmake.inc file.
MPILIB=$(MPILIBdir)/libmpi.a.
I met error when I typed make xtc_CsameF77; make xtc_UserMpich; make xcmpi_sane in the $home/BLACS/INSTALL directory. The problem is that there is no such directory or file under the folder where I install MPI.

I think these two things give me error when I tried to type 'make' to compile the testing suite.

Any help will be highly appreciate.

Xiaofeng