<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    Dear Miller,<br>
    <br>
    the missing symbols are contained within the OpneMPI library (see
    below). This is because you are linking Blacs compiled for OpenMPI.<br>
    <br>
    [igirotto@argo lib]$ pwd<br>
    /opt/openmpi/1.4.5/pgi/10.9/lib<br>
    <br>
    [igirotto@argo lib]$ readelf -Ws libmpi.so | grep ompi_mpi_float<br>
       992: 00000000002d22a0   512 OBJECT  GLOBAL DEFAULT   21
    ompi_mpi_float_int<br>
      1880: 00000000002d08a0   512 OBJECT  GLOBAL DEFAULT   21
    ompi_mpi_float<br>
      6886: 00000000002d22a0   512 OBJECT  GLOBAL DEFAULT   21
    ompi_mpi_float_int<br>
      7774: 00000000002d08a0   512 OBJECT  GLOBAL DEFAULT   21
    ompi_mpi_float<br>
    <br>
    Whether you are not using OpenMPI library you should either find the
    right version of Blacs for the MPI library you are using or switch
    using OpenMPI if it's available.<br>
    On the other hand, if you are certainly using OpenMPI to compile I
    guess something it's missing within the environment as suggested
    previously from Layla.<br>
    <br>
    Ivan<br>
    <br>
    <pre class="moz-signature" cols="72">-- 

Ivan Girotto - <a class="moz-txt-link-abbreviated" href="mailto:igirotto@ictp.it">igirotto@ictp.it</a>
High Performance Computing Specialist
Information & Communication Technology Section
The Abdus Salam - <a class="moz-txt-link-abbreviated" href="http://www.ictp.it">www.ictp.it</a>
International Centre for Theoretical Physics
Strada Costiera, 11 - 34151 Trieste - IT
Tel +39.040.2240.484
Fax +39.040.2240.249
</pre>
    <br>
    <br>
    On 16/08/2012 08:52, Layla Martin-Samos wrote:
    <blockquote
cite="mid:CAGCSmJRyAfhhqA52USX_TZXV7KTR+YJmDMaw2Vr7PUAf9cBDGg@mail.gmail.com"
      type="cite">Dear Miller, it doest not look like an
      espresso-Makefile (make.sys) related problem but more like an
      environment problem. Is in the lib
      /opt/intel/Compiler/11.1/056/mkl/lib/em64/libmkl_blacs_openmpi_lp64.a<br>
      that the compiler does not manage to link some mpi basic
      definitions. It really looks like something in your Cray
      environment has not been loaded correctly, or is not compatible. <br>
      <br>
      hope it helps<br>
      <br>
      Layla<br>
      <br>
      <br>
      <div class="gmail_quote">2012/8/15 Miller, MJ ERDC-RDE-ITL-MS
        Contractor <span dir="ltr"><<a moz-do-not-send="true"
            href="mailto:MJ.Miller@erdc.dren.mil" target="_blank">MJ.Miller@erdc.dren.mil</a>></span><br>
        <blockquote class="gmail_quote" style="margin:0 0 0
          .8ex;border-left:1px #ccc solid;padding-left:1ex">
          <div link="blue" vlink="purple" lang="EN-US">
            Classification: UNCLASSIFIED<br>
            Caveats: FOUO<br>
            <br>
            <div>
              <p class="MsoNormal">QE:</p>
              <p class="MsoNormal"> </p>
              <p class="MsoNormal">I’m trying to troubleshoot a
                compilation problem on our Cray XE6. The code seems to
                compile following the instructions given in the README,
                but fails to link with the MPI libraries as far as I can
                see. We are getting undefined reference errors that seem
                to indicate at least a library path problem, but may be
                more involved. Our efforts thus far have included
                setting environment variables as described in the README
                file, and swapping compiler and open_mpi versions. Here
                is a excerpt from the compile log where things start to
                go wrong. Please take a look and reply if you can help
                us.</p>
              <p class="MsoNormal"> </p>
              <p class="MsoNormal">make[2]: Entering directory
                `/work/mjmiller/espresso-5.0--htakephi/PW/src'</p>
              <p class="MsoNormal">test -n "" && ( cd ../.. ;
                make -w  || exit 1) || :</p>
              <p class="MsoNormal">mpif90 -static-intel  -openmp -o pw.x
                \</p>
              <p class="MsoNormal">           pwscf.o  libpw.a
                ../../Modules/libqemod.a ../../flib/ptools.a
                ../../flib/flib.a ../../clib/clib.a
                ../../iotk/src/libiotk.a -lmkl_scalapack_lp64
                -lmkl_blacs_openmpi_lp64   -lmkl_intel_lp64 
                -lmkl_intel_thread -lmkl_core</p>
              <p class="MsoNormal">/opt/intel/Compiler/11.1/056/mkl/lib/em64t/libmkl_blacs_openmpi_lp64.a(igesd2d_.o):
                In function `igesd2d_':</p>
              <p class="MsoNormal">_igesd2d_.c:(.text+0x40): undefined
                reference to `ompi_mpi_int'</p>
              <p class="MsoNormal">_igesd2d_.c:(.text+0x99): undefined
                reference to `ompi_mpi_byte'</p>
              <p class="MsoNormal">/opt/intel/Compiler/11.1/056/mkl/lib/em64t/libmkl_blacs_openmpi_lp64.a(sgesd2d_.o):
                In function `sgesd2d_':</p>
              <p class="MsoNormal">_sgesd2d_.c:(.text+0x40): undefined
                reference to `ompi_mpi_float'</p>
              <p class="MsoNormal">_sgesd2d_.c:(.text+0x99): undefined
                reference to `ompi_mpi_byte'</p>
              <p class="MsoNormal">/opt/intel/Compiler/11.1/056/mkl/lib/em64t/libmkl_blacs_openmpi_lp64.a(dgesd2d_.o):
                In function `dsendrecv_':</p>
              <p class="MsoNormal">_dgesd2d_.c:(.text+0x8e): undefined
                reference to `ompi_mpi_double'</p>
              <p class="MsoNormal">_dgesd2d_.c:(.text+0xab): undefined
                reference to `ompi_mpi_double'</p>
              <p class="MsoNormal">_dgesd2d_.c:(.text+0x101): undefined
                reference to `ompi_mpi_double'</p>
              <p class="MsoNormal">_dgesd2d_.c:(.text+0x125): undefined
                reference to `ompi_mpi_double'</p>
              <p class="MsoNormal">/opt/intel/Compiler/11.1/056/mkl/lib/em64t/libmkl_blacs_openmpi_lp64.a(dgesd2d_.o):
                In function `dgesd2d_':</p>
              <p class="MsoNormal">_dgesd2d_.c:(.text+0x21a): undefined
                reference to `ompi_mpi_double'</p>
              <p class="MsoNormal">_dgesd2d_.c:(.text+0x273): undefined
                reference to `ompi_mpi_byte'</p>
              <p class="MsoNormal">/opt/intel/Compiler/11.1/056/mkl/lib/em64t/libmkl_blacs_openmpi_lp64.a(cgesd2d_.o):
                In function `cgesd2d_':</p>
              <p class="MsoNormal">_cgesd2d_.c:(.text+0x99): undefined
                reference to `ompi_mpi_byte'</p>
              <p class="MsoNormal">/opt/intel/Compiler/11.1/056/mkl/lib/em64t/libmkl_blacs_openmpi_lp64.a(zgesd2d_.o):
                In function `zgesd2d_':</p>
              <p class="MsoNormal">_zgesd2d_.c:(.text+0x99): undefined
                reference to `ompi_mpi_byte'</p>
              <p class="MsoNormal">/opt/intel/Compiler/11.1/056/mkl/lib/em64t/libmkl_blacs_openmpi_lp64.a(strsd2d_.o):</p>
              <p class="MsoNormal"> </p>
              <p class="MsoNormal">Thanks,</p>
              <p class="MsoNormal">MJ Miller, Ph.D.</p>
              <p class="MsoNormal">ERDC-DSRC</p>
              <p class="MsoNormal">Vicksburg, MS</p>
              <p class="MsoNormal"><a moz-do-not-send="true"
                  href="tel:601-634-7465" value="+16016347465"
                  target="_blank">601-634-7465</a></p>
            </div>
            <br>
            Classification: UNCLASSIFIED<br>
            Caveats: FOUO<br>
            <br>
          </div>
          <br>
          _______________________________________________<br>
          Q-e-developers mailing list<br>
          <a moz-do-not-send="true"
            href="mailto:Q-e-developers@qe-forge.org">Q-e-developers@qe-forge.org</a><br>
          <a moz-do-not-send="true"
            href="http://qe-forge.org/mailman/listinfo/q-e-developers"
            target="_blank">http://qe-forge.org/mailman/listinfo/q-e-developers</a><br>
          <br>
        </blockquote>
      </div>
      <br>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
Q-e-developers mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Q-e-developers@qe-forge.org">Q-e-developers@qe-forge.org</a>
<a class="moz-txt-link-freetext" href="http://qe-forge.org/mailman/listinfo/q-e-developers">http://qe-forge.org/mailman/listinfo/q-e-developers</a>
</pre>
    </blockquote>
    <br>
    <pre class="moz-signature" cols="72">
</pre>
  </body>
</html>