LAPACK/ScaLAPACK Development

by **sc0ttbeardsley** » Mon Jan 28, 2008 5:40 pm

I'm having problems compiling the BLACS (with MPI) tester. I'm using gfortran 4.1.1 with openmpi 1.1 and an GbE interconnect.

Here is my Bmake.inc diff:

Code: Select all: $ diff Bmake.inc BMAKES/Bmake.MPI-LINUX 16c16 < BTOPdir = /tmp/openmpi-1.1 --- > BTOPdir = $(HOME)/BLACS 50,54c50,53 < MPIdir = /usr/share/openmpi < MPILIBdir = < MPIINCdir = /usr/include/openmpi < # MPILIB = -L/usr/lib64/openmpi < MPILIB = --- > MPIdir = /usr/local/mpich > MPILIBdir = $(MPIdir)/lib/ > MPIINCdir = $(MPIdir)/include > MPILIB = $(MPILIBdir)/libmpich.a 59c58 < BTLIBS = $(BLACSCINIT) $(BLACSFINIT) $(MPILIB) --- > BTLIBS = $(BLACSFINIT) $(BLACSLIB) $(BLACSFINIT) $(MPILIB) 90c89 < SYSINC = --- > SYSINC = -I$(MPIINCdir) 97,98c96 < # INTFACE = -Df77IsF2C < INTFACE = -DAdd_ --- > INTFACE = -Df77IsF2C 145,146c143 < # TRANSCOMM = -DCSameF77 < TRANSCOMM = -DUseMpi2 --- > TRANSCOMM = -DCSameF77 201c198 < F77 = mpif77 --- > F77 = g77 206c203 < CC = mpicc --- > CC = gcc

I compiled and ran: xcmpi_sane xfmpi_sane xintface xsize xsyserrors xtc_CsameF77 in INSTALL and everything seems to complete successfully:

Code: Select all: $ EXE/xsize ISIZE=4 SSIZE=4 DSIZE=8 CSIZE=8 ZSIZE=16 $ EXE/xintface For this platform, set INTFACE = -DAdd_ $ mpirun -np 4 -machinefile /tmp/machines EXE/xcmpi_sane 1: C MPI sanity test passed 3: C MPI sanity test passed 2: C MPI sanity test passed 0: C MPI sanity test passed $ mpirun -np 4 -machinefile /tmp/machines EXE/xfmpi_sane 1 F77 MPI sanity test passed. 3 F77 MPI sanity test passed. 2 F77 MPI sanity test passed. 0 F77 MPI sanity test passed. $ mpirun -np 2 -machinefile /tmp/machines EXE/xtc_CsameF77 If this routine does not complete successfully, Do _NOT_ set TRANSCOMM = -DCSameF77 Do _NOT_ set TRANSCOMM = -DCSameF77 $

Then when I got to compile the tester I get a bunch of "undefined reference" errors:

Code: Select all: $ make mpif77 -c blacstest.f make mpif.h make[1]: Entering directory `/home/sbeards/BLACS/TESTING' rm -f mpif.h ln -s /usr/include/openmpi/mpif.h mpif.h make[1]: Leaving directory `/home/sbeards/BLACS/TESTING' mpif77 -c -O btprim_MPI.f mpif77 -c tools.f mpif77 -o /home/sbeards/BLACS/TESTING/EXE/xFbtest_MPI-LINUX-0 blacstest.o btprim_MPI.o tools.o /home/sbeards/BLACS/LIB/blacsCinit_MPI-LINUX-0.a /home/sbeards/BLACS/LIB/blacsF77init_MPI-LINUX-0.a blacstest.o(.text+0x6e): In function `MAIN__': : undefined reference to `blacs_get_' blacstest.o(.text+0x8b): In function `MAIN__': : undefined reference to `blacs_gridinit_' ... blacstest.o(.text+0x6762c): In function `zchkamn_': : undefined reference to `blacs_gridinfo_' /home/sbeards/BLACS/LIB/blacsCinit_MPI-LINUX-0.a(blacs_pinfo_.o)(.text+0x11): In function `blacs_pinfo_': : undefined reference to `BI_F77_MPI_COMM_WORLD' /home/sbeards/BLACS/LIB/blacsCinit_MPI-LINUX-0.a(blacs_pinfo_.o)(.text+0x20): In function `blacs_pinfo_': : undefined reference to `BI_Iam' /home/sbeards/BLACS/LIB/blacsCinit_MPI-LINUX-0.a(blacs_pinfo_.o)(.text+0x29): In function `blacs_pinfo_': : undefined reference to `BI_Np' /home/sbeards/BLACS/LIB/blacsCinit_MPI-LINUX-0.a(blacs_pinfo_.o)(.text+0x66): In function `blacs_pinfo_': : undefined reference to `BI_F77_MPI_COMM_WORLD' /home/sbeards/BLACS/LIB/blacsCinit_MPI-LINUX-0.a(blacs_pinfo_.o)(.text+0x75): In function `blacs_pinfo_': : undefined reference to `bi_f77_get_constants_' /home/sbeards/BLACS/LIB/blacsCinit_MPI-LINUX-0.a(blacs_pinfo_.o)(.text+0x7a): In function `blacs_pinfo_': : undefined reference to `BI_Np' /home/sbeards/BLACS/LIB/blacsCinit_MPI-LINUX-0.a(blacs_pinfo_.o)(.text+0x89): In function `blacs_pinfo_': : undefined reference to `BI_Iam' /home/sbeards/BLACS/LIB/blacsCinit_MPI-LINUX-0.a(blacs_pinfo_.o)(.text+0x9d): In function `blacs_pinfo_': : undefined reference to `BI_Iam' /home/sbeards/BLACS/LIB/blacsCinit_MPI-LINUX-0.a(blacs_pinfo_.o)(.text+0xaa): In function `blacs_pinfo_': : undefined reference to `BI_Np' /home/sbeards/BLACS/LIB/blacsCinit_MPI-LINUX-0.a(blacs_pinfo_.o)(.text+0xd3): In function `blacs_pinfo_': : undefined reference to `BI_BlacsErr' collect2: ld returned 1 exit status make: *** [/home/sbeards/BLACS/TESTING/EXE/xFbtest_MPI-LINUX-0] Error 1

Even though it appears to be in the archive:

Code: Select all: $ nm ../LIB/blacs_MPI-LINUX-0.a |grep blacs_get_ blacs_get_.o: 0000000000000000 T blacs_get_ blacs_get_.oo: $

I'm lost... any ideas?

by **Julie** » Mon Jan 28, 2008 5:53 pm

sc0ttbeardsley,

First, could you give a try to our new BLACS/ScaLAPACK installer.
It should hopefully set all the flags correctly.
you can download it from http://www.netlib.org/scalapack/.

Second, you are not supposed to change BTLIBS! You need the BLACSLIB to link.

hope it helps.
Julie

by **sc0ttbeardsley** » Mon Jan 28, 2008 6:20 pm

Julie wrote:sc0ttbeardsley,

First, could you give a try to our new BLACS/ScaLAPACK installer.
It should hopefully set all the flags correctly.
you can download it from http://www.netlib.org/scalapack/.

OK. I'll try that... Hmm I didn't get too far(see below). OpenMPI suggests I have TRANSCOMM = -DUseMpi2 in there somewhere. Maybe that isn't getting set?

Code: Select all: $ ./setup.py --lapacklib=/usr/lib64/liblapack.a --blaslib=/usr/lib64/libblas.a --downblacs --mpicc=/usr/share/openmpi/bin64/mpicc --mpif77=/usr/share/openmpi/bin64/mpif77 --mpiincdir=/usr/include/openmpi ======================================== Setting up the framework mpicc is /usr/share/openmpi/bin64/mpicc mpif77 is /usr/share/openmpi/bin64/mpif77 MPI include dir is /usr/include/openmpi Checking if mpicc works... yes Checking if mpif77 works... yes Setting Fortran mangling... -DAdd_ Setting download command... urllib2 Setting ranlib command... /usr/bin/ranlib Detecting Fortran compiler... unknown Detecting C compiler... unknown Selected C compiler flags: -O3 Selected Fortran77 compiler flags: -O3 Selected loader flags: Selected NOOPT flags: Checking loader... works ======================================== BLAS installation/verification ======================================== Checking if provided BLAS works... yes ======================================== Lapack installation/verification ======================================== Checking if provided LAPACK works... LAPACK: provided LAPACK cannot be used! aborting... error is: **************************************** /usr/lib64/liblapack.a(ilaenv.o)(.text+0x91): In function `ilaenv_': : undefined reference to `s_copy' /usr/lib64/liblapack.a(ilaenv.o)(.text+0x101): In function `ilaenv_': : undefined reference to `s_copy' /usr/lib64/liblapack.a(ilaenv.o)(.text+0x11e): In function `ilaenv_': : undefined reference to `s_copy' /usr/lib64/liblapack.a(ilaenv.o)(.text+0x138): In function `ilaenv_': : undefined reference to `s_copy' /usr/lib64/liblapack.a(ilaenv.o)(.text+0x172): In function `ilaenv_': : undefined reference to `s_cmp' /usr/lib64/liblapack.a(ilaenv.o)(.text+0x191): In function `ilaenv_': : undefined reference to `s_cmp' /usr/lib64/liblapack.a(ilaenv.o)(.text+0x26e): In function `ilaenv_': : undefined reference to `s_copy' /usr/lib64/liblapack.a(ilaenv.o)(.text+0x2a0): In function `ilaenv_': : undefined reference to `s_cmp' /usr/lib64/liblapack.a(ilaenv.o)(.text+0x2bb): In function `ilaenv_': : undefined reference to `s_cmp' /usr/lib64/liblapack.a(ilaenv.o)(.text+0x2ea): In function `ilaenv_': : undefined reference to `s_cmp' /usr/lib64/liblapack.a(ilaenv.o)(.text+0x326): In function `ilaenv_': : undefined reference to `s_cmp' /usr/lib64/liblapack.a(ilaenv.o)(.text+0x35a): In function `ilaenv_': : undefined reference to `s_cmp' /usr/lib64/liblapack.a(ilaenv.o)(.text+0x385): more undefined references to `s_cmp' follow /usr/lib64/liblapack.a(xerbla.o)(.text+0x15): In function `xerbla_': : undefined reference to `s_wsfe' /usr/lib64/liblapack.a(xerbla.o)(.text+0x29): In function `xerbla_': : undefined reference to `do_fio' /usr/lib64/liblapack.a(xerbla.o)(.text+0x3d): In function `xerbla_': : undefined reference to `do_fio' /usr/lib64/liblapack.a(xerbla.o)(.text+0x44): In function `xerbla_': : undefined reference to `e_wsfe' /usr/lib64/liblapack.a(xerbla.o)(.text+0x52): In function `xerbla_': : undefined reference to `s_stop' collect2: ld returned 1 exit status **************************************** $

Second, you are not supposed to change BTLIBS! You need the BLACSLIB to link.

Yes, I changed it back and I got further but a bunch of the tests failed.

by **Julie** » Mon Jan 28, 2008 6:33 pm

sc0ttbeardsley,
It looks like you are using a BLAS library translated to C. It required the f2c library, add the -lf2c flags should remove these undefined references.
I am assuming that your BLAS library is an implementation of the reference BLAS that provides very poor performance.

I would advice to install your own optimized BLAS library :you can get ATLAS, GOTO, ACML, MKL , and so on...and to let the installer installed LAPACK. (you are sure to get a fresh Fortran LAPACK library).

So :
- First step, use the installer and let him download all the libraries (BLAS and LAPACK included). It will use the Reference BLAS (not optimized)
- Second step: get an optimized BLAS library
- Third step: re-run the installer with that optimized BLAS library.

Julie

by **sc0ttbeardsley** » Mon Jan 28, 2008 7:23 pm

Julie wrote:I would advice to install your own optimized BLAS library :you can get ATLAS, GOTO, ACML, MKL , and so on...and to let the installer installed LAPACK. (you are sure to get a fresh Fortran LAPACK library).

Ahh yes. We have many of these optimized BLAS libraries already installed. Since we're using amd's cpus I'll go with ACML. I'm not sure if I'm using the correct options. I'm running:

Code: Select all: $ ./setup.py --blaslib=/share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a --downblacs --downlapack --mpicc=/usr/share/openmpi/bin64/mpicc --mpif77=/usr/share/openmpi/bin64/mpif77 --mpiincdir=/usr/include/openmpi

And of course I get yet another set of errors;

Code: Select all: $ ./setup.py --blaslib=/share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a --downblacs --downlapack --mpicc=/usr/share/openmpi/bin64/mpicc --mpif77=/usr/share/openmpi/bin64/mpif77 --mpiincdir=/usr/include/openmpi ======================================== Setting up the framework mpicc is /usr/share/openmpi/bin64/mpicc mpif77 is /usr/share/openmpi/bin64/mpif77 MPI include dir is /usr/include/openmpi Checking if mpicc works... yes Checking if mpif77 works... yes Setting Fortran mangling... -DAdd_ Setting download command... urllib2 Setting ranlib command... /usr/bin/ranlib Detecting Fortran compiler... unknown Detecting C compiler... unknown Selected C compiler flags: -O3 Selected Fortran77 compiler flags: -O3 Selected loader flags: Selected NOOPT flags: Checking loader... works ======================================== BLAS installation/verification ======================================== Checking if provided BLAS works... yes ======================================== Lapack installation/verification ======================================== Setting ETIME... EXT_ETIME Writing make.inc... done. Compiling LAPACK (this will take several minutes)... done. (log is in log/laplog) done. ======================================== BLACS installation/verification ======================================== Setting TRANSCOMM... Writing Bmake.inc... done. Compiling BLACS... done. (log is in log/blacslog) ======================================== ScaLAPACK installer is starting now. Buckle up! ======================================== Writing SLmake.inc... done. Compiling ScaLAPACK... done. (log is in log/scalog) Compiling test routines... ScaLAPACK: error building ScaLAPACK test routines stderr: **************************************** /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(sgemvTcomp.o)(.text+0x116): In function `sgemvtcomp_': : undefined reference to `GOMP_parallel_start' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(sgemvTcomp.o)(.text+0x123): In function `sgemvtcomp_': : undefined reference to `GOMP_parallel_end' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssyrk.o)(.text+0x318): In function `ssyrk_': : undefined reference to `GOMP_parallel_start' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssyrk.o)(.text+0x325): In function `ssyrk_': : undefined reference to `GOMP_parallel_end' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssyrk.o)(.text+0x83d): In function `ssyrk_': : undefined reference to `GOMP_parallel_start' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssyrk.o)(.text+0x84a): In function `ssyrk_': : undefined reference to `GOMP_parallel_end' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssyrk.o)(.text+0x97b): In function `ssyrk_': : undefined reference to `GOMP_parallel_start' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssyrk.o)(.text+0x988): In function `ssyrk_': : undefined reference to `GOMP_parallel_end' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssyrk.o)(.text+0xa3b): In function `ssyrk_': : undefined reference to `GOMP_parallel_start' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssyrk.o)(.text+0xa48): In function `ssyrk_': : undefined reference to `GOMP_parallel_end' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssyrk.o)(.text+0xace): In function `ssyrk_.omp_fn.3': : undefined reference to `omp_get_num_threads' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssyrk.o)(.text+0xada): In function `ssyrk_.omp_fn.3': : undefined reference to `omp_get_thread_num' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssyrk.o)(.text+0xdb9): In function `ssyrk_.omp_fn.2': : undefined reference to `omp_get_num_threads' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssyrk.o)(.text+0xdc5): In function `ssyrk_.omp_fn.2': : undefined reference to `omp_get_thread_num' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssyrk.o)(.text+0x108a): In function `ssyrk_.omp_fn.1': : undefined reference to `omp_get_num_threads' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssyrk.o)(.text+0x1096): In function `ssyrk_.omp_fn.1': : undefined reference to `omp_get_thread_num' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssyrk.o)(.text+0x1375): In function `ssyrk_.omp_fn.0': : undefined reference to `omp_get_num_threads' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssyrk.o)(.text+0x1381): In function `ssyrk_.omp_fn.0': : undefined reference to `omp_get_thread_num' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ompaax.o)(.text+0x7): In function `ompaax_': : undefined reference to `omp_get_thread_num_' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ompaay.o)(.text+0x7): In function `ompaay_': : undefined reference to `omp_get_num_threads_' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ompaaz.o)(.text+0x15): In function `ompaaz_': : undefined reference to `GOMP_parallel_start' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ompaaz.o)(.text+0x22): In function `ompaaz_': : undefined reference to `GOMP_parallel_end' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ompaaz.o)(.text+0x37): In function `ompaaz_.omp_fn.0': : undefined reference to `omp_get_num_threads_' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(sgemmcompL.o)(.text+0x50cb): In function `sgemmcompl_': : undefined reference to `GOMP_parallel_start' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(sgemmcompL.o)(.text+0x50d8): In function `sgemmcompl_': : undefined reference to `GOMP_parallel_end' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(sgemmcompS.o)(.text+0x3048): In function `sgemmcomps_': : undefined reference to `GOMP_parallel_start' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(sgemmcompS.o)(.text+0x3055): In function `sgemmcomps_': : undefined reference to `GOMP_parallel_end' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(sgemvNcomp.o)(.text+0x99): In function `sgemvncomp_': : undefined reference to `GOMP_parallel_start' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(sgemvNcomp.o)(.text+0xa6): In function `sgemvncomp_': : undefined reference to `GOMP_parallel_end' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(sgercomp.o)(.text+0xdc): In function `sgercomp_': : undefined reference to `GOMP_parallel_start' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(sgercomp.o)(.text+0xe9): In function `sgercomp_': : undefined reference to `GOMP_parallel_end' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssymmcomp.o)(.text+0x104): In function `ssymmcomp_': : undefined reference to `GOMP_parallel_start' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssymmcomp.o)(.text+0x111): In function `ssymmcomp_': : undefined reference to `GOMP_parallel_end' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssymmcomp.o)(.text+0x1b6): In function `ssymmcomp_.omp_fn.0': : undefined reference to `GOMP_barrier' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(ssymmcomp.o)(.text+0x2be): In function `ssymmcomp_.omp_fn.0': : undefined reference to `GOMP_barrier' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(strmmL.o)(.text+0x222): In function `strmml_': : undefined reference to `GOMP_parallel_start' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(strmmL.o)(.text+0x22f): In function `strmml_': : undefined reference to `GOMP_parallel_end' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(strmmL.o)(.text+0x347): In function `strmml_.omp_fn.0': : undefined reference to `GOMP_barrier' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(strmmU.o)(.text+0x1f2): In function `strmmu_': : undefined reference to `GOMP_parallel_start' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(strmmU.o)(.text+0x1ff): In function `strmmu_': : undefined reference to `GOMP_parallel_end' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(strmmU.o)(.text+0x317): In function `strmmu_.omp_fn.0': : undefined reference to `GOMP_barrier' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(strsmL.o)(.text+0x1a5): In function `strsml_': : undefined reference to `GOMP_parallel_start' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(strsmL.o)(.text+0x1b2): In function `strsml_': : undefined reference to `GOMP_parallel_end' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(strsmL.o)(.text+0x2c7): In function `strsml_.omp_fn.0': : undefined reference to `GOMP_barrier' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(strsmU.o)(.text+0x246): In function `strsmu_': : undefined reference to `GOMP_parallel_start' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(strsmU.o)(.text+0x253): In function `strsmu_': : undefined reference to `GOMP_parallel_end' /share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a(strsmU.o)(.text+0x34f): In function `strsmu_.omp_fn.0': : undefined reference to `GOMP_barrier' collect2: ld returned 1 exit status make[1]: *** [/home/sbeards/scalapack/scalapack_installer_0.9/build/scalapack-1.8.0/TESTING/xspblas1tst] Error 1 make: *** [pblasexe] Error 2 **************************************** $

ACML comes with acml_mp and acml_mv. Perhaps I need them both?

by **sc0ttbeardsley** » Tue Jan 29, 2008 1:26 pm

sc0ttbeardsley wrote:I'm running:

Code: Select all
$ ./setup.py --blaslib=/share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a --downblacs --downlapack --mpicc=/usr/share/openmpi/bin64/mpicc --mpif77=/usr/share/openmpi/bin64/mpif77 --mpiincdir=/usr/include/openmpi

duh... I needed to point to libacml.a. The blacs tester compiles fine now as well as scalapack. Thanks for the pointers.

by **yamen** » Thu Mar 27, 2008 6:36 am

sc0ttbeardsley wrote:
sc0ttbeardsley wrote:I'm running:

Code: Select all
$ ./setup.py --blaslib=/share/apps/acml-4.0.1/gfortran64_mp/lib/libacml_mp.a --downblacs --downlapack --mpicc=/usr/share/openmpi/bin64/mpicc --mpif77=/usr/share/openmpi/bin64/mpif77 --mpiincdir=/usr/include/openmpi

duh... I needed to point to libacml.a. The blacs tester compiles fine now as well as scalapack. Thanks for the pointers.

I wish if you send me your blacslog ans scalalog to verify some issues.
thanks, if you r ok tell me i will give u my mail

LAPACK/ScaLAPACK Development

BLACS tester won't compile

BLACS tester won't compile

Who is online