<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:"ＭＳ 明朝";
panose-1:2 2 6 9 4 2 5 8 3 4;}
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:游ゴシック;
panose-1:2 11 4 0 0 0 0 0 0 0;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"ＭＳ Ｐゴシック";
panose-1:2 11 6 0 7 2 5 8 2 4;}
@font-face
{font-family:"\@游ゴシック";
panose-1:2 11 4 0 0 0 0 0 0 0;}
@font-face
{font-family:"\@ＭＳ Ｐゴシック";}
@font-face
{font-family:"\@ＭＳ 明朝";
panose-1:2 2 6 9 4 2 5 8 3 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0mm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"ＭＳ Ｐゴシック",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0mm;
margin-right:0mm;
margin-bottom:0mm;
margin-left:42.0pt;
margin-bottom:.0001pt;
mso-para-margin-top:0mm;
mso-para-margin-right:0mm;
mso-para-margin-bottom:0mm;
mso-para-margin-left:4.0gd;
mso-para-margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"ＭＳ Ｐゴシック",serif;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0mm;
mso-margin-bottom-alt:auto;
margin-left:0mm;
font-size:12.0pt;
font-family:"ＭＳ Ｐゴシック",serif;}
span.19
{mso-style-type:personal;
font-family:游ゴシック;
color:#1F497D;}
span.20
{mso-style-type:personal;
font-family:游ゴシック;
color:#1F497D;}
span.21
{mso-style-type:personal-compose;
font-family:游ゴシック;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:99.25pt 30.0mm 30.0mm 30.0mm;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:1356690934;
mso-list-type:hybrid;
mso-list-template-ids:1273136726 -1993454496 67698699 67698701 67698689 67698699 67698701 67698689 67698699 67698701;}
@list l0:level1
{mso-level-start-at:0;
mso-level-number-format:bullet;
mso-level-text:-;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:18.0pt;
text-indent:-18.0pt;
font-family:游ゴシック;
mso-bidi-font-family:"Times New Roman";}
@list l0:level2
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:42.0pt;
text-indent:-21.0pt;
font-family:Wingdings;}
@list l0:level3
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:63.0pt;
text-indent:-21.0pt;
font-family:Wingdings;}
@list l0:level4
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:84.0pt;
text-indent:-21.0pt;
font-family:Wingdings;}
@list l0:level5
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:105.0pt;
text-indent:-21.0pt;
font-family:Wingdings;}
@list l0:level6
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:126.0pt;
text-indent:-21.0pt;
font-family:Wingdings;}
@list l0:level7
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:147.0pt;
text-indent:-21.0pt;
font-family:Wingdings;}
@list l0:level8
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:168.0pt;
text-indent:-21.0pt;
font-family:Wingdings;}
@list l0:level9
{mso-level-number-format:bullet;
mso-level-text:;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:189.0pt;
text-indent:-21.0pt;
font-family:Wingdings;}
ol
{margin-bottom:0mm;}
ul
{margin-bottom:0mm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026">
<v:textbox inset="5.85pt,.7pt,5.85pt,.7pt" />
</o:shapedefaults></xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="JA" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">Dear Ye and Paolo,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">I am very sorry for my late response.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">I will answer your questions:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoListParagraph" style="margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l0 level1 lfo2">
<![if !supportLists]><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><span style="mso-list:Ignore">-<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">SX-Aurora TSUBASA consists of VH(Vector Host: standard x86 server)
<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left:18.0pt;mso-para-margin-left:0gd"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">and VE(Vector Engine).<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l0 level1 lfo2">
<![if !supportLists]><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><span style="mso-list:Ignore">-<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">You can just compile your program with the NEC original compiler on VH,<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left:18.0pt;mso-para-margin-left:0gd"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">then you can generate a vectorized code running on VE.<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left:18.0pt;mso-para-margin-left:0gd"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">It is much easier to program the code than the GPGPU programming.<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left:18.0pt;mso-para-margin-left:0gd"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">But such accelerator programming model is also available on SX-Aurora TSUBASA.<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left:18.0pt;mso-para-margin-left:0gd"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">See page 5&7 of attached file.<o:p></o:p></span></p>
<p class="MsoListParagraph" style="margin-left:18.0pt;mso-para-margin-left:0gd;text-indent:-18.0pt;mso-list:l0 level1 lfo2">
<![if !supportLists]><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><span style="mso-list:Ignore">-<span style="font:7.0pt "Times New Roman"">
</span></span></span><![endif]><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">You can also use the optimized libraries such FFT, BLAS, LAPACK, etc. for VE.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">Since I sent the following email, we have applied our optimization to v6.4.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">So I will send the source code to you via the NEC security site.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">Please look at the code and please let me know if you have any questions.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">Best Regards,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">Naoki Iwata<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0mm 0mm 0mm 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0mm 0mm 0mm">
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> IWATA NAOKI(</span><span style="font-size:11.0pt">岩田 直樹</span><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">)
<n-iwata-da@nec.com> <br>
<b>Sent:</b> Thursday, May 28, 2020 10:21 PM<br>
<b>To:</b> Ye Luo <xw111luoye@gmail.com>; Paolo Giannozzi <p.giannozzi@gmail.com><br>
<b>Cc:</b> General discussion list for Quantum ESPRESSO developers <developers@lists.quantum-espresso.org>; IWATA NAOKI(</span><span style="font-size:11.0pt">岩田 直樹</span><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">) <n-iwata-da@nec.com><br>
<b>Subject:</b> Re: [QE-developers] SX-Aurora TSUBASA<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">Dear Ye and Paolo,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">Thank you very much for your quick response and your interest in SX-Aurora TSUBASA.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">I will answer your questions and will provide the code to you later.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">At this moment, please look at the following site:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><a href="https://www.hpc.nec/index.en"><span style="font-size:11.0pt;font-family:游ゴシック">https://www.hpc.nec/index.en</span></a></span><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">Best Regards,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D">Naoki Iwata.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;font-family:游ゴシック;color:#1F497D"><o:p> </o:p></span></p>
<div style="border:none;border-left:solid blue 1.5pt;padding:0mm 0mm 0mm 4.0pt">
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0mm 0mm 0mm">
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">From:</span></b><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif"> Ye Luo <</span><span lang="EN-US"><a href="mailto:xw111luoye@gmail.com"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">xw111luoye@gmail.com</span></a></span><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">>
<br>
<b>Sent:</b> Thursday, May 28, 2020 1:09 AM<br>
<b>To:</b> General discussion list for Quantum ESPRESSO developers <</span><span lang="EN-US"><a href="mailto:developers@lists.quantum-espresso.org"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">developers@lists.quantum-espresso.org</span></a></span><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">><br>
<b>Cc:</b> IWATA NAOKI(</span><span style="font-size:11.0pt">岩田 直樹</span><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">) <</span><span lang="EN-US"><a href="mailto:n-iwata-da@nec.com"><span style="font-size:11.0pt;font-family:"Calibri",sans-serif">n-iwata-da@nec.com</span></a></span><span lang="EN-US" style="font-size:11.0pt;font-family:"Calibri",sans-serif">><br>
<b>Subject:</b> ##freemail## Re: [QE-developers] SX-Aurora TSUBASA<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Hi Naoki,<o:p></o:p></span></p>
</div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">Could you put the code on gitlab or github for us to preview?<o:p></o:p></span></p>
</div>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Could you say a bit more how did you "port"? Which part of QE was ported? How did you port?<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">NEC aurora is an accelerator but it is not a GPU. How did you program it?<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">I was aware of FFT libraries for SX-Aurora. Did you use SX-Aurora via library?<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">The code path to SX in FFTXLIB is not maintained for a long time I guess. Perhaps it is time to clean/refactor that part.<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Regarding compiler options, do you have a customized compiler? Or it is gfortran or flang and you just need to just pass some -D flags?<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Best,<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span lang="EN-US">Ye<o:p></o:p></span></p>
</div>
<div>
<div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">===================<br>
Ye Luo, Ph.D.<br>
Computational Science Division & Leadership Computing Facility<br>
Argonne National Laboratory<o:p></o:p></span></p>
</div>
</div>
</div>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
</div>
</div>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US">On Wed, May 27, 2020 at 10:15 AM IWATA NAOKI(</span>岩田 直樹<span lang="EN-US">) <<a href="mailto:n-iwata-da@nec.com">n-iwata-da@nec.com</a>> wrote:<o:p></o:p></span></p>
</div>
<blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0mm 0mm 0mm 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0mm;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">Dear developers,<br>
<br>
My name Naoki Iwata from NEC Corporation in Japan.<br>
We are developing and selling a newer vector-supercomputer, SX-Aurora TSUBASA.<br>
<a href="https://www.nec.com/en/global/solutions/hpc/" target="_blank">https://www.nec.com/en/global/solutions/hpc/</a><br>
<br>
We have ported and optimized QUANTAM ESPRESSO v6.3 for SX-Aurora TSUBASA.<br>
So we would like to ask you to implement our compile options and source code changes
<br>
for the optimization for SX-Aurora TSUBASA into the original QUANTUM ESPRESSO <br>
makefile and source code.<br>
I looked at the users' guide, I found the description of SX-6 and SX-8. They are old system.<br>
So we also would like to update it to SX-Aurora TSUBASA.<br>
What should we do for that?<br>
<br>
Best Regards,<br>
<br>
Naoki Iwata<br>
-----<br>
Naoki Iwata (<a href="mailto:n-iwata-da@nec.com" target="_blank">n-iwata-da@nec.com</a>)<br>
NEC AI Platform Division<br>
<br>
_______________________________________________<br>
developers mailing list<br>
<a href="mailto:developers@lists.quantum-espresso.org" target="_blank">developers@lists.quantum-espresso.org</a><br>
<a href="https://lists.quantum-espresso.org/mailman/listinfo/developers" target="_blank">https://lists.quantum-espresso.org/mailman/listinfo/developers</a><o:p></o:p></span></p>
</blockquote>
</div>
</div>
</div>
</div>
</body>
</html>