[QE-users] ERROR(FoX), Cannot open file

Thu Nov 7 20:33:41 CET 2019

Paolo,

I discovered that the file in question was the `-machinefile` argument I was passing into `mpirun`. This was being generated and stored in the non-shared /tmp file system. This is certainly not an error with QE. Thank you for your patience.

On 11/6/19 11:10 AM, Ben Comer wrote:

Paolo,

Thanks for your help, I'll let you know if I track down what file is causing the issue.

On 11/6/19 4:25 AM, Paolo Giannozzi wrote:
On Tue, Nov 5, 2019 at 10:36 PM Paolo Giannozzi <p.giannozzi at gmail.com<mailto:p.giannozzi at gmail.com>> wrote:

Yes, I was referring to the "develop" branch of https://gitlab.com/QEF/q-e

Just a clarification: https://github.com/QEF/q-e is a mirror that is automatically aligned to the above gitlab repository

Paolo

. There is no need for the "-D__BEOWULF" option any more. There is nothing I can do unless there is some hint of why and for which file FoX fails

Paolo

On Tue, Nov 5, 2019 at 10:21 PM Ben Comer <bcomer3 at gatech.edu<mailto:bcomer3 at gatech.edu>> wrote:

Thanks for the help,

Paolo,

to confirm, the development version is the "develop" branch of the repo below? Compiling this code also yields the same error. I presume that I don't need the -D__BEOWULF flag that Pietro recommends. I also the error I have listed below thew "ERROR(FoX) Cannot open file" errors.

https://github.com/QEF/q-e

[rich133-k35-19-l.pace.gatech.edu:mpi_rank_0][handle_cqe] Send desc error in msg to 28, wc_opcode=0
[rich133-k35-19-l.pace.gatech.edu:mpi_rank_0][handle_cqe] Msg from 28: wc.status=12, wc.wr_id=0x2a60fb0, wc.opcode=0, vbuf->phead->type=0 = MPIDI_CH3_PKT_EAGER_SEND
[rich133-k35-19-l.pace.gatech.edu:mpi_rank_0][handle_cqe] src/mpid/ch3/channels/mrail/src/gen2/ibv_channel_manager.c:547: [] Got completion with error 12, vendor code=0x81, dest rank=28
: Inappropriate ioctl for device (25)

On 11/4/19 12:22 PM, Paolo Giannozzi wrote:
Try the development version, that no longer assumes that all files are readable by all processors.

Paolo

On Mon, Nov 4, 2019 at 5:22 PM Ben Comer <bcomer3 at gatech.edu<mailto:bcomer3 at gatech.edu>> wrote:
Pietro,

I am running quantum espresso with 56 cores across 2 nodes (28 cores per
node) when I receive this error. The error does not appear when I am
running on a single node (I've tested 1,2,4,8,16, and 28 cores on a
single node.) However, all runs that involve more than one node do have
this issue. Previous messages implied that this was because the nodes
did not share a common file system, which is the case for our cluster.
Each node has it's own /tmp directory located on each node. Please let
me know if I can provide more information.

On 11/4/19 11:08 AM, Pietro Davide Delugas wrote:
> Dear Ben Comer.
> The flag is not valid any more. In fact It was not a fix just a
> configure option to select the old file format rather than the new one.
>
> The old format is no longer supported, that is why the option is not
> recognized by the configure anymore.
>
> Cannot  open file means that the program is not finding some file.
> Could you give more details on how you are running the code in order
> to understand why the error issues?
>
> best regards - Pietro
>
>
>
> On 11/4/19 4:56 PM, Ben Comer wrote:
>> Hello,
>>
>> Since I've switched from espresso 5 to espresso 6.4.1 I've gotten the
>> "ERROR(FoX) Cannot open file" error when running across nodes. I see in
>> the mailing list that the prescribed fix for this is to recompile with
>> the "--enable-xml=no" flag in the "./configure" step. However, when I do
>> this I get a warning saying that the flag was not recognized and I
>> continue to get the error after compilation. Is there any new fix for
>> this issue?
>>
>> Thanks,
>>
>> Ben Comer
>> Georgia Tech
>>
>> _______________________________________________
>> Quantum ESPRESSO is supported by MaX
>> (www.max-centre.eu/quantum-espresso<http://www.max-centre.eu/quantum-espresso>)
>> users mailing list users at lists.quantum-espresso.org<mailto:users at lists.quantum-espresso.org>
>> https://lists.quantum-espresso.org/mailman/listinfo/users
>
>
> _______________________________________________
> Quantum ESPRESSO is supported by MaX (www.max-centre.eu/quantum-espresso<http://www.max-centre.eu/quantum-espresso>)
> users mailing list users at lists.quantum-espresso.org<mailto:users at lists.quantum-espresso.org>
> https://lists.quantum-espresso.org/mailman/listinfo/users
_______________________________________________
Quantum ESPRESSO is supported by MaX (www.max-centre.eu/quantum-espresso<http://www.max-centre.eu/quantum-espresso>)
users mailing list users at lists.quantum-espresso.org<mailto:users at lists.quantum-espresso.org>
https://lists.quantum-espresso.org/mailman/listinfo/users

--
Paolo Giannozzi, Dip. Scienze Matematiche Informatiche e Fisiche,
Univ. Udine, via delle Scienze 208, 33100 Udine, Italy
Phone +39-0432-558216, fax +39-0432-558222

_______________________________________________
Quantum ESPRESSO is supported by MaX (www.max-centre.eu/quantum-espresso<http://www.max-centre.eu/quantum-espresso>)
users mailing list users at lists.quantum-espresso.org<mailto:users at lists.quantum-espresso.org>
https://lists.quantum-espresso.org/mailman/listinfo/users

_______________________________________________
Quantum ESPRESSO is supported by MaX (www.max-centre.eu/quantum-espresso<http://www.max-centre.eu/quantum-espresso>)
users mailing list users at lists.quantum-espresso.org<mailto:users at lists.quantum-espresso.org>
https://lists.quantum-espresso.org/mailman/listinfo/users

--
Paolo Giannozzi, Dip. Scienze Matematiche Informatiche e Fisiche,
Univ. Udine, via delle Scienze 208, 33100 Udine, Italy
Phone +39-0432-558216, fax +39-0432-558222

--
Paolo Giannozzi, Dip. Scienze Matematiche Informatiche e Fisiche,
Univ. Udine, via delle Scienze 208, 33100 Udine, Italy
Phone +39-0432-558216, fax +39-0432-558222

_______________________________________________
Quantum ESPRESSO is supported by MaX (www.max-centre.eu/quantum-espresso<http://www.max-centre.eu/quantum-espresso>)
users mailing list users at lists.quantum-espresso.org<mailto:users at lists.quantum-espresso.org>
https://lists.quantum-espresso.org/mailman/listinfo/users
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.quantum-espresso.org/pipermail/users/attachments/20191107/38139852/attachment.html>