<div dir="ltr"><div>The memory usage is very hard to estimate in general. Morever it depends upon a number of factors. Old versions for instance used
to keep
by default a single set of wavefunctions for one k-point, store those for the other k-points to disk. Since some time the default is to keep wavefunctions for all k-points in memory. Recent versions of QE have a better estimate of how much memory is allocated.</div><div><br></div><div>Paolo<br></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Oct 22, 2019 at 6:10 PM Eric Glen Suter <<a href="mailto:esuter@uga.edu">esuter@uga.edu</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div dir="ltr">
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Hi all,</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
I'm running jobs with a relatively high number of kpoints with QE 6.2. For a while I was using the dynamical memory estimates output by the pw.x executable as a guidepost for requesting memory on a cluster, and this worked well when I had a relatively small
number of kpoints. But it turns out that for these dense grids I need significantly more than the estimate indicates. The estimate says a few hundred Mb, but the actual resources used indicate it's more on the order of several tens of Gb.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
I find in the user manual an estimate of the number of double precision complex floating point numbers that would be needed (
<div title="Page 14" style="font-family:-webkit-standard">
<div>
<div>
<p><span style="font-size:12pt;font-family:CMMI12">O<span> </span></span><span style="font-size:12pt;font-family:CMR12">=<span> </span></span><span style="font-size:12pt;font-family:CMMI12">mMN<span> </span></span><span style="font-size:12pt;font-family:CMR12">+<span> </span></span><span style="font-size:12pt;font-family:CMMI12">PN<span> </span></span><span style="font-size:12pt;font-family:CMR12">+<span> </span></span><span style="font-size:12pt;font-family:CMMI12">pN</span><span style="font-size:8pt;font-family:CMR8;vertical-align:-2pt">1</span><span style="font-size:12pt;font-family:CMMI12">N</span><span style="font-size:8pt;font-family:CMR8;vertical-align:-2pt">2</span><span style="font-size:12pt;font-family:CMMI12">N</span><span style="font-size:8pt;font-family:CMR8;vertical-align:-2pt">3<span> </span></span><span style="font-size:12pt;font-family:CMR12">+<span> </span></span><span style="font-size:12pt;font-family:CMMI12">qN</span><span style="font-size:8pt;font-family:CMMI8;vertical-align:-2pt">r</span><span style="font-size:8pt;font-family:CMR8;vertical-align:-2pt">1</span><span style="font-size:12pt;font-family:CMMI12">N</span><span style="font-size:8pt;font-family:CMMI8;vertical-align:-2pt">r</span><span style="font-size:8pt;font-family:CMR8;vertical-align:-2pt">2</span><span style="font-size:12pt;font-family:CMMI12">N</span><span style="font-size:8pt;font-family:CMMI8;vertical-align:-2pt">r</span><span style="font-size:8pt;font-family:CMR8;vertical-align:-2pt">3</span></p>
</div>
</div>
</div>
) and this seems to give an estimate on the order of what the output file says. </div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Is there something I'm missing that goes into determining how much memory a job should take? I'm mostly interested to know if there's a good way to predict how much memory future jobs will need so I can make a more educated guess when I request memory.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Any insights you can offer are greatly appreciated.</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
<br>
</div>
<div style="font-family:Calibri,Arial,Helvetica,sans-serif;font-size:12pt;color:rgb(0,0,0)">
Best regards,</div>
<div id="gmail-m_1608388777665408085Signature">
<div id="gmail-m_1608388777665408085divtagdefaultwrapper" dir="ltr" style="font-size:12pt;color:rgb(0,0,0);font-family:Calibri,Helvetica,sans-serif">
<p style="margin-top:0px;margin-bottom:0px">Eric Suter</p>
<p style="margin-top:0px;margin-bottom:0px">----------------------------</p>
<p style="margin-top:0px;margin-bottom:0px">PhD Candidate, Dept. of Physics and Astronomy</p>
<p style="margin-top:0px;margin-bottom:0px">Center for Simulational Physics</p>
<p style="margin-top:0px;margin-bottom:0px">University of Georgia</p>
<p style="margin-top:0px;margin-bottom:0px">----------------------------</p>
<p style="margin-top:0px;margin-bottom:0px">email: <a href="mailto:esuter@uga.edu" target="_blank">esuter@uga.edu</a></p>
<p style="margin-top:0px;margin-bottom:0px">phone: 912-856-3071</p>
<p style="margin-top:0px;margin-bottom:0px"></p>
</div>
</div>
</div>
_______________________________________________<br>
Quantum ESPRESSO is supported by MaX (<a href="http://www.max-centre.eu/quantum-espresso" rel="noreferrer" target="_blank">www.max-centre.eu/quantum-espresso</a>)<br>
users mailing list <a href="mailto:users@lists.quantum-espresso.org" target="_blank">users@lists.quantum-espresso.org</a><br>
<a href="https://lists.quantum-espresso.org/mailman/listinfo/users" rel="noreferrer" target="_blank">https://lists.quantum-espresso.org/mailman/listinfo/users</a></blockquote></div><br clear="all"><br>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div>Paolo Giannozzi, Dip. Scienze Matematiche Informatiche e Fisiche,<br>Univ. Udine, via delle Scienze 208, 33100 Udine, Italy<br>Phone +39-0432-558216, fax +39-0432-558222<br><br></div></div></div></div></div>