<html><body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div>I pulled down the current CVS version, compiled as I did with the previous snapshot and got the same behavior:</div><div><br></div><div>When I ran on 128 cores in vn mode with -ntg 4 -ndiag 121, I got a cholesky error:</div><div><br></div><div>When I ran on 128 cores in dual mode with -ntg 4 -ndiag 121, I got the cholesky error:</div><div><div><br></div><div>When I ran on 128 cores in smp mode with -ntg 4 -ndiag 121, it ran fine.</div><div><br></div><div>I guess I have 2 options:</div><div><br></div><div>1) try larger systems in SMP mode with the CVS version, see how big I can get before things blow up. I'll just have to deal with the extra cost of the idle CPUs.</div><div><br></div><div>2) climb into the code with a debugger to see if I can see anything going on (things I am interested in now are how much memory is actually available to the code, how much it is using, if there is something funny going on in the different modes). I'll probably have to construct a smaller system that does the same thing first.</div><div><br></div><div>I don't want to abandon PW/CP just yet because this code has demonstrated decent physics, and other codes would require me to do develop PPs that give me results I can be confident in or way too much work to get them scalable. Unfortunately - I also need to get it running on the BG/P as I have a big allocation on that machine that is otherwise wasted.</div></div><div><br></div><div>Dave</div><div><br></div><div><br></div><div apple-content-edited="true"> <span class="Apple-style-span" style="border-collapse: separate; color: rgb(0, 0, 0); font-family: Helvetica; font-size: 14px; font-style: normal; font-variant: normal; font-weight: normal; letter-spacing: normal; line-height: normal; orphans: 2; text-align: auto; text-indent: 0px; text-transform: none; white-space: normal; widows: 2; word-spacing: 0px; -webkit-border-horizontal-spacing: 0px; -webkit-border-vertical-spacing: 0px; -webkit-text-decorations-in-effect: none; -webkit-text-size-adjust: auto; -webkit-text-stroke-width: 0; "><div style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; "><div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Helvetica" size="3" style="font: normal normal normal 12px/normal Helvetica; font-size: 12px; ">David E. Farrell</font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font class="Apple-style-span" size="3"><span class="Apple-style-span" style="font-size: 12px; ">Post-Doctoral Fellow</span></font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font class="Apple-style-span" size="3"><span class="Apple-style-span" style="font-size: 12px; ">Department of Materials Science and Engineering</span></font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Helvetica" size="3" style="font: normal normal normal 12px/normal Helvetica; font-size: 12px; ">Northwestern University</font></div><div style="margin-top: 0px; margin-right: 0px; margin-bottom: 0px; margin-left: 0px; "><font face="Helvetica" size="3" style="font: normal normal normal 12px/normal Helvetica; font-size: 12px; ">email: <a href="mailto:d-farrell2@northwestern.edu">d-farrell2@northwestern.edu</a></font></div></div></div></span> </div><br></body></html>