<html><head></head><body><div style="font-family: Verdana;font-size: 12.0px;"><div>
<div>Kane,</div>
<div> </div>
<div>Thank you, your suggestions worked, although I think I had to go a step further and get into make.sys and comment out the line where it found the intel BLAS libraries and point it to the internal BLAS.</div>
<div>Something about the intel MKL trips up compilation for us, my other researcher isn't able to get it to work either and he's got a good 20 years of experience on me.</div>
<div> </div>
<div>-Andrew</div>
<div>
<div name="quote" style="margin:10px 5px 5px 10px; padding: 10px 0 10px 10px; border-left:2px solid #C3D9E5; word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space;">
<div style="margin:0 0 10px 0;"><b>Sent:</b> Monday, November 09, 2015 at 10:23 PM<br/>
<b>From:</b> "Kane O'Donnell" <kane.odonnell@gmail.com><br/>
<b>To:</b> "PWSCF Forum" <pw_forum@pwscf.org><br/>
<b>Subject:</b> Re: [Pw_forum] compile attempt with external BLAS and intel MKL (espresso-5.2.1)</div>
<div name="quoted-content">
<div>
<div> </div>
Hi Andrew,
<div> </div>
<div>
<div>Are you trying to just build espresso 5.2.1, or are you trying to build it using some custom linear algebra libraries? On a Cray you’re encouraged strongly *not* to stuff around with custom BLAS/FFT/scalapack/etc. The programming environments are set up so you don’t need to do that, and for example on our XC40 you can build SVN espresso just with:</div>
<div> </div>
<div>module swap PrgEnv-cray PrgEnv-gnu</div>
<div>./configure —enable-parallel —with-scalapack=yes FC=ftn CC=cc </div>
<div>make all</div>
<div> </div>
<div>You can do the same for PrgEnv-intel (it’s exactly the same configure line) but it’s still wise to use the MKL link line advisor to change make.sys as necessary - you can copy and paste directly from the link line advisor as Cray set $MKLROOT properly when you load PrgEnv-intel.</div>
<div> </div>
<div>Our cluster guys made a wiki entry about QE on the XC40 using the intel suite here:</div>
<div> </div>
<div><a href="https://portal.ivec.org/docs/Supercomputers/Magnus/Quantum_Espresso" target="_blank">https://portal.ivec.org/docs/Supercomputers/Magnus/Quantum_Espresso</a></div>
<div> </div>
<div>It’s not quite the same as the link line advisor but it works (except XSpectra, you need the gnu environment to get that to work on our XC40 for some reason). </div>
<div> </div>
<div>Kane</div>
<div> </div>
<div> </div>
<div>
<div>
<blockquote>
<div>On 10 Nov 2015, at 01:10, Andrew Downs <<a href="andrew.downs@mail.com" target="_parent">andrew.downs@mail.com</a>> wrote:</div>
<div>
<div>
<div style="font-family: Verdana;font-size: 12.0px;">
<div>Hello,</div>
<div> </div>
<div>I've been able to jump a few hurdles that have come up in my compile process, but this one has me stumped.</div>
<div>I'm compiling on a Cray XC-40, and another researcher here was able to build 5.1.1 with out BLAS and MKL libraries.</div>
<div>He and I assumed 5.2.1 should also work under the same circumstances, but this may turn out not to be the case.</div>
<div> </div>
<div>my configure line is as follows:</div>
<div><br/>
./configure ARCH=x86_64 MPIF90=ftn FFLAGS="-O3" CC=icc CFLAGS=-O3 --prefix=/usr/cta/unsupported/qe/espresso-5.2.1</div>
<div> </div>
<div>relevant part of make.sys:</div>
<div> </div>
<div>
<div>LDFLAGS=--static -I/opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/include/ -I/opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/include/intel64/lp64/<br/>
BLAS_LIBS=/opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/lib/intel64/libmkl_sequential.a -Wl,--end-group /opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/lib/intel64/libmkl_blacs_intelmpi_lp64.a -lpthread -lm<br/>
LAPACK_LIBS=/opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/lib/intel64/libmkl_intel_lp64.a /opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/lib/intel64/libmkl_core.a<br/>
SCALAPACK_LIBS=/opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/lib/intel64/libmkl_scalapack_lp64.a -Wl,--start-group<br/>
FFT_LIBS=/opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/lib/intel64/libmkl_cdft_core.a</div>
<div> </div>
</div>
<div> </div>
<div>make all output:</div>
<div>ftn --static -I/opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/include/ -I/opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/include/intel64/lp64/ -o pw.x \<br/>
pwscf.o libpw.a ../../Modules/libqemod.a ../../flib/ptools.a ../../flib/flib.a ../../clib/clib.a ../../iotk/src/libiotk.a /opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/lib/intel64/libmkl_scalapack_lp64.a -Wl,--start-group /opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/lib/intel64/libmkl_intel_lp64.a /opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/lib/intel64/libmkl_core.a /opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/lib/intel64/libmkl_cdft_core.a /opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/lib/intel64/libmkl_sequential.a -Wl,--end-group /opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/lib/intel64/libmkl_blacs_intelmpi_lp64.a -lpthread -lm<br/>
/opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/lib/intel64/libmkl_core.a(mkl_memory.o): In function `mkl_serv_set_memory_limit':<br/>
../../../../serv/kernel/mkl_memory.c:(.text+0x521): warning: Using 'dlopen' in statically linked applications requires at runtime the shared libraries from the glibc version used for linking<br/>
/opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/lib/intel64/libmkl_blacs_intelmpi_lp64.a(dgesd2d_.o): In function `dgesd2d_':<br/>
../../../../scalapack/BLACS/SRC/MPI/dgesd2d_.c:(.text+0x92): undefined reference to `mkl_serv_get_mpi_wrappers'<br/>
/opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/lib/intel64/libmkl_blacs_intelmpi_lp64.a(dgesd2d_.o): In function `dsendrecv_':<br/>
../../../../scalapack/BLACS/SRC/MPI/dgesd2d_.c:(.text+0x142): undefined reference to `mkl_serv_get_mpi_wrappers'<br/>
../../../../scalapack/BLACS/SRC/MPI/dgesd2d_.c:(.text+0x162): undefined reference to `mkl_serv_get_mpi_wrappers'<br/>
../../../../scalapack/BLACS/SRC/MPI/dgesd2d_.c:(.text+0x1aa): undefined reference to `mkl_serv_get_mpi_wrappers'<br/>
../../../../scalapack/BLACS/SRC/MPI/dgesd2d_.c:(.text+0x1da): undefined reference to `mkl_serv_get_mpi_wrappers'<br/>
/opt/intel/compilers_and_libraries_2016.0.109/linux/mkl/lib/intel64/libmkl_blacs_intelmpi_lp64.a(dgesd2d_.o):../../../../scalapack/BLACS/SRC/MPI/dgesd2d_.c:(.text+0x1ea): more undefined references to `mkl_serv_get_mpi_wrappers' follow<br/>
make[2]: *** [pw.x] Error 1<br/>
make[2]: Leaving directory `/p/home/adowns/espresso-5.2.1/PW/src'<br/>
make[1]: *** [pw] Error 1<br/>
make[1]: Leaving directory `/p/home/adowns/espresso-5.2.1/PW'<br/>
make: *** [pw] Error 1<br/>
</div>
</div>
</div>
_______________________________________________<br/>
Pw_forum mailing list<br/>
<a href="Pw_forum@pwscf.org" target="_parent">Pw_forum@pwscf.org</a><br/>
<a href="http://pwscf.org/mailman/listinfo/pw_forum" target="_blank">http://pwscf.org/mailman/listinfo/pw_forum</a></div>
</blockquote>
</div>
</div>
</div>
_______________________________________________ Pw_forum mailing list Pw_forum@pwscf.org <a href="http://pwscf.org/mailman/listinfo/pw_forum" target="_blank">http://pwscf.org/mailman/listinfo/pw_forum</a></div>
</div>
</div>
</div>
</div></div></body></html>