<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<div class="moz-cite-prefix">Dear all,</div>
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">just to share my limited experience
with TSUBASA (please correct me if its wrong):</div>
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">You can use it with any standard
C/C++/Fortran MPI/OpenMP code, the code runs completely on the
card. There is some work for back loading onto the host CPU and
also some work on using the card in a offload fashion, but I have
no clue about the status of these projects. If I remember
correctly those projects are C/C++ LLVM only.<br>
</div>
<div class="moz-cite-prefix">Vectorizable code naturally performs
exceptionally good, however, unvectorizable code is only performed
via an ARM core and you will for sure find some routines that are
extremely slow and more or less irrelevant on standard CPUs.</div>
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">NEC provides
BLAS/FFTW/Lapack/SCALapack, compiling CPMD was possible out of the
box. My biggest issue was indeed the support of OpenMP
parallelization in those libraries as well as support for nested
OpenMP in general.<br>
</div>
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">However, I am looking forward to see
the code changes done by NEC, and of course, the performance.<br>
</div>
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">Best,</div>
<div class="moz-cite-prefix">Tobias</div>
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">On 5/28/20 3:21 PM, IWATA NAOKI(岩田 直樹)
wrote:<br>
</div>
<blockquote type="cite"
cite="mid:TY2PR01MB26526BBB4F265307F222C3DBDC8E0@TY2PR01MB2652.jpnprd01.prod.outlook.com">
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<meta name="Generator" content="Microsoft Word 15 (filtered
medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:游ゴシック;
panose-1:2 11 4 0 0 0 0 0 0 0;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"ＭＳ Ｐゴシック";
panose-1:2 11 6 0 7 2 5 8 2 4;}
@font-face
{font-family:"\@ＭＳ Ｐゴシック";}
@font-face
{font-family:"\@游ゴシック";
panose-1:2 11 4 0 0 0 0 0 0 0;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0mm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"ＭＳ Ｐゴシック";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0mm;
mso-margin-bottom-alt:auto;
margin-left:0mm;
font-size:12.0pt;
font-family:"ＭＳ Ｐゴシック";}
span.18
{mso-style-type:personal-reply;
font-family:游ゴシック;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:游ゴシック;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:99.25pt 30.0mm 30.0mm 30.0mm;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026">
<v:textbox inset="5.85pt,.7pt,5.85pt,.7pt" />
</o:shapedefaults></xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div class="WordSection1">
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"
lang="EN-US">Dear Ye and Paolo,<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"
lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"
lang="EN-US">Thank you very much for your quick response and
your interest in SX-Aurora TSUBASA.<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"
lang="EN-US">I will answer your questions and will provide
the code to you later.<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"
lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"
lang="EN-US">At this moment, please look at the following
site:<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"
lang="EN-US"><a href="https://www.hpc.nec/index.en"
moz-do-not-send="true">https://www.hpc.nec/index.en</a><o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"
lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"
lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"
lang="EN-US">Best Regards,<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"
lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"
lang="EN-US">Naoki Iwata.<o:p></o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"
lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span
style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"
lang="EN-US"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0mm
0mm 0mm 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1
1.0pt;padding:3.0pt 0mm 0mm 0mm">
<p class="MsoNormal"><b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif"
lang="EN-US">From:</span></b><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif"
lang="EN-US"> Ye Luo <a class="moz-txt-link-rfc2396E" href="mailto:xw111luoye@gmail.com"><xw111luoye@gmail.com></a>
<br>
<b>Sent:</b> Thursday, May 28, 2020 1:09 AM<br>
<b>To:</b> General discussion list for Quantum
ESPRESSO developers
<a class="moz-txt-link-rfc2396E" href="mailto:developers@lists.quantum-espresso.org"><developers@lists.quantum-espresso.org></a><br>
<b>Cc:</b> IWATA NAOKI(</span><span
style="font-size:11.0pt">岩田 直樹</span><span
style="font-size:11.0pt;font-family:"Calibri",sans-serif"
lang="EN-US">) <a class="moz-txt-link-rfc2396E" href="mailto:n-iwata-da@nec.com"><n-iwata-da@nec.com></a><br>
<b>Subject:</b> ##freemail## Re: [QE-developers]
SX-Aurora TSUBASA<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Hi Naoki,<o:p></o:p></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Could you put
the code on gitlab or github for us to preview?<o:p></o:p></span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Could you say a
bit more how did you "port"? Which part of QE was
ported? How did you port?<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">NEC aurora is an
accelerator but it is not a GPU. How did you program
it?<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">I was aware of FFT
libraries for SX-Aurora. Did you use SX-Aurora via
library?<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">The code path to
SX in FFTXLIB is not maintained for a long time I
guess. Perhaps it is time to clean/refactor that part.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Regarding compiler
options, do you have a customized compiler? Or it is
gfortran or flang and you just need to just pass some
-D flags?<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Best,<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Ye<o:p></o:p></span></p>
</div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">===================<br>
Ye Luo, Ph.D.<br>
Computational Science Division &
Leadership Computing Facility<br>
Argonne National Laboratory<o:p></o:p></span></p>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">On Wed, May 27,
2020 at 10:15 AM IWATA NAOKI(</span>岩田 直樹<span
lang="EN-US">) <<a href="mailto:n-iwata-da@nec.com"
moz-do-not-send="true">n-iwata-da@nec.com</a>>
wrote:<o:p></o:p></span></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC
1.0pt;padding:0mm 0mm 0mm
6.0pt;margin-left:4.8pt;margin-right:0mm">
<p class="MsoNormal"><span lang="EN-US">Dear developers,<br>
<br>
My name Naoki Iwata from NEC Corporation in Japan.<br>
We are developing and selling a newer
vector-supercomputer, SX-Aurora TSUBASA.<br>
<a href="https://www.nec.com/en/global/solutions/hpc/"
target="_blank" moz-do-not-send="true">https://www.nec.com/en/global/solutions/hpc/</a><br>
<br>
We have ported and optimized QUANTAM ESPRESSO v6.3 for
SX-Aurora TSUBASA.<br>
So we would like to ask you to implement our compile
options and source code changes
<br>
for the optimization for SX-Aurora TSUBASA into the
original QUANTUM ESPRESSO <br>
makefile and source code.<br>
I looked at the users' guide, I found the description
of SX-6 and SX-8. They are old system.<br>
So we also would like to update it to SX-Aurora
TSUBASA.<br>
What should we do for that?<br>
<br>
Best Regards,<br>
<br>
Naoki Iwata<br>
-----<br>
Naoki Iwata (<a href="mailto:n-iwata-da@nec.com"
target="_blank" moz-do-not-send="true">n-iwata-da@nec.com</a>)<br>
NEC AI Platform Division<br>
<br>
_______________________________________________<br>
developers mailing list<br>
<a href="mailto:developers@lists.quantum-espresso.org"
target="_blank" moz-do-not-send="true">developers@lists.quantum-espresso.org</a><br>
<a
href="https://lists.quantum-espresso.org/mailman/listinfo/developers"
target="_blank" moz-do-not-send="true">https://lists.quantum-espresso.org/mailman/listinfo/developers</a><o:p></o:p></span></p>
</blockquote>
</div>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
developers mailing list
<a class="moz-txt-link-abbreviated" href="mailto:developers@lists.quantum-espresso.org">developers@lists.quantum-espresso.org</a>
<a class="moz-txt-link-freetext" href="https://lists.quantum-espresso.org/mailman/listinfo/developers">https://lists.quantum-espresso.org/mailman/listinfo/developers</a>
</pre>
</blockquote>
<p><br>
</p>
<pre class="moz-signature" cols="72">--
M.Sc. Tobias Klöffel
=======================================================
HPC (High Performance Computing) group
Erlangen Regional Computing Center(RRZE)
Friedrich-Alexander-Universität Erlangen-Nürnberg
Martensstr. 1
91058 Erlangen
Room: 1.133
Phone: +49 (0) 9131 / 85 - 20101
=======================================================
E-mail: <a class="moz-txt-link-abbreviated" href="mailto:tobias.kloeffel@fau.de">tobias.kloeffel@fau.de</a></pre>
</body>
</html>