<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Paolo,</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
I believe there is the capability of creating a local scratch folder that is deleted on the end of the job. I will try that as a solution as I don't think I am yet brave enough to go under the hood of QE.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
As far as the Ryzen performance, I used the same open source libraries for both systems (OpenMPI, OpenBLAS, FFTW3). I don't know how to identify if I have a conflict between MPI and multi threading, but I will look into using Intel's MKL and see if that solves
the performance issues. I will also keep searching; the mail you referenced reminded me that there is likely more interest in the performance of epyc rather than ryzen.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
Thanks for the advice.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
-Brad</div>
<div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div id="Signature">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
--------------------------------------------------------</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Bradly Baer</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="font-family:Calibri,Arial,Helvetica,sans-serif; background-color:rgb(255,255,255); display:inline!important">Graduate Research Assistant, Walker Lab</span><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="font-family:Calibri,Arial,Helvetica,sans-serif; background-color:rgb(255,255,255); display:inline!important">Interdisciplinary Materials Science</span><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Vanderbilt University</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
</div>
</div>
<div id="appendonsend"></div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> users <users-bounces@lists.quantum-espresso.org> on behalf of Paolo Giannozzi <p.giannozzi@gmail.com><br>
<b>Sent:</b> Saturday, April 25, 2020 10:30 AM<br>
<b>To:</b> Quantum ESPRESSO users Forum <users@lists.quantum-espresso.org><br>
<b>Subject:</b> Re: [QE-users] QE Performance on cluster and AMD</font>
<div> </div>
</div>
<div>
<div dir="ltr">
<div dir="ltr">On Sat, Apr 25, 2020 at 1:34 AM Baer, Bradly <<a href="mailto:bradly.b.baer@vanderbilt.edu">bradly.b.baer@vanderbilt.edu</a>> wrote:<br>
</div>
<div class="x_gmail_quote">
<div> </div>
<blockquote class="x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left:1px solid rgb(204,204,204); padding-left:1ex">
<div dir="ltr">My submitted jobs for phonon calculations keep being canceled because QE is writing large files to the networked filesystem which is both very slow and under a fairly tight quota.</div>
</blockquote>
<div><br>
</div>
don't you have anything else to use for scratch files? in the worst-case scenario, a local /tmp or /scratch file system, even if not visible to all processors, may do the job (with some caveats)<br>
</div>
<div class="x_gmail_quote"><br>
<blockquote class="x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left:1px solid rgb(204,204,204); padding-left:1ex">
<div dir="ltr"> Files in the _ph0 directory, and appear to be creating one file per processor that I request for my job. Is there some way to have QE load these files in to RAM instead</div>
</blockquote>
<div><br>
</div>
<div>there is some way, but it requires some work and some understanding of how the "buffer" machinery used in the self-consistent code works. If you feel brave enough to work with the latest development version and to perform some tests, I can explain what
to do.</div>
<div><br>
</div>
<blockquote class="x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left:1px solid rgb(204,204,204); padding-left:1ex">
<div dir="ltr">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
A second question: has anyone had success in using QE on AMD Ryzen processors? I have a Ryzen system that is struggling to match the performance of an Intel system that is several years older. Both are running QE6.5 on Ubuntu. From pw.x output, cegterg is
10x slower and cdiaghg is 100x slower on the AMD machine. I had hoped that going from 4 cores to 16 cores would make it faster, not slower!
</div>
</div>
</blockquote>
<div><br>
</div>
100x means that something VERY wrong is happening. Are you sure there isn't some conflict between MPI and multithreading? Please also see the following message, that contains an important piece of information:</div>
<div class="x_gmail_quote"><a href="https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.mail-archive.com%2Fusers%40lists.quantum-espresso.org%2Fmsg37148.html&data=02%7C01%7Cbradly.b.baer%40vanderbilt.edu%7Ca98d116614954748e48f08d7e92da395%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C0%7C637234254548330786&sdata=Y%2FcpGdYuEIi2mb5yJBhvBFM4e1RxSTAkebnAZztzCuY%3D&reserved=0" originalsrc="https://www.mail-archive.com/users@lists.quantum-espresso.org/msg37148.html" shash="LUkoYfrNHwimF9pQsOUw7WaN63hZXN7PO/wggzvhtnga1x27JVMK/tydugJY+iOu8XCKq162f6cqnTGSMYTJT9Uu2JoWR9xCX5Xc0/OqmrHAKdUWGxDSAUocSFR2N26MgCMItUGj1jixJlaHynD6c2Zc3/5gEYBx8QmzkcgJ42s=">https://www.mail-archive.com/users@lists.quantum-espresso.org/msg37148.html</a></div>
<div class="x_gmail_quote"><br>
</div>
<div class="x_gmail_quote">Paolo</div>
<div class="x_gmail_quote"><br>
</div>
<div class="x_gmail_quote">
<blockquote class="x_gmail_quote" style="margin:0px 0px 0px 0.8ex; border-left:1px solid rgb(204,204,204); padding-left:1ex">
<div dir="ltr">
<div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Thanks,</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Bradly Baer</div>
<div id="x_gmail-m_-3744143605268441960Signature">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
--------------------------------------------------------</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Bradly Baer</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="font-family:Calibri,Arial,Helvetica,sans-serif; background-color:rgb(255,255,255); display:inline">Graduate Research Assistant, Walker Lab</span><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<span style="font-family:Calibri,Arial,Helvetica,sans-serif; background-color:rgb(255,255,255); display:inline">Interdisciplinary Materials Science</span><br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
Vanderbilt University</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif; font-size:12pt; color:rgb(0,0,0)">
<br>
</div>
</div>
</div>
</div>
_________________<br>
Quantum ESPRESSO is supported by MaX (<a href="https://nam04.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.max-centre.eu%2Fquantum-espresso&data=02%7C01%7Cbradly.b.baer%40vanderbilt.edu%7Ca98d116614954748e48f08d7e92da395%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C0%7C637234254548340782&sdata=gYD0LRnmRcyRE7ne4lowIVxzc5aNalQxdlI7RRvxFM8%3D&reserved=0" originalsrc="http://www.max-centre.eu/quantum-espresso" shash="Gf42DppvUtKqLp/OWwIrKk6SsSNPH8oRDEhenEkOZJ2XYjoyoPN9wpqV+BmqbZWd6OvyKGZpXjay3GGEoFJN8al+b20Izo+wpkNoSlXmoK6Pmiqby1iIDJzVYnD1adiVweanSBDachaSRU+S1G2q2c0QSX/NnL0gIwJ4Ag0Knp8=" rel="noreferrer" target="_blank">www.max-centre.eu/quantum-espresso</a>)<br>
users mailing list <a href="mailto:users@lists.quantum-espresso.org" target="_blank">
users@lists.quantum-espresso.org</a><br>
<a href="https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Flists.quantum-espresso.org%2Fmailman%2Flistinfo%2Fusers&data=02%7C01%7Cbradly.b.baer%40vanderbilt.edu%7Ca98d116614954748e48f08d7e92da395%7Cba5a7f39e3be4ab3b45067fa80faecad%7C0%7C0%7C637234254548340782&sdata=BlSAR6HXWIHijzqS1BZQ%2FRW%2BXPAmKUzJ14IvSA%2FbgBg%3D&reserved=0" originalsrc="https://lists.quantum-espresso.org/mailman/listinfo/users" shash="UU+tXFxuxCuinKlWpHikmsrPdIps316DtIcZcAMZfMNVENrH3KrWkazbF9m1Tej91YfudbLBGGxWwqgmce4RTsbqwEDKtdQhn8GZ+kX+ha+t67nK+VxOUfAQ6XMLvvFayKYuXgMEi3OEneUZRblbLVMU6B4MSX+WzAJMA+ucA+U=" rel="noreferrer" target="_blank">https://lists.quantum-espresso.org/mailman/listinfo/users</a></blockquote>
</div>
<br clear="all">
<br>
-- <br>
<div dir="ltr" class="x_gmail_signature">
<div dir="ltr">
<div>
<div dir="ltr">
<div>Paolo Giannozzi, Dip. Scienze Matematiche Informatiche e Fisiche,<br>
Univ. Udine, via delle Scienze 208, 33100 Udine, Italy<br>
Phone +39-0432-558216, fax +39-0432-558222<br>
<br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</body>
</html>