[QE-users] Bad scaling on GPU version QE
Michal Krompiec
michal.krompiec at gmail.com
Wed Jul 10 09:33:45 CEST 2019
Dear Milos,
Thank you. This definitely helps us make an informed decision.
Best,
Michal
On Wed, 10 Jul 2019 at 08:28, Milos Maric <mmaric at nvidia.com> wrote:
> Dear Michal,
>
>
>
> I run benchmarks on 2x Intel Xeon E5-2698 v4 and 2x Intel E5-2698 v4 + 4x
> Nvidia V100 16GB SMX2 (DGX-1V 16GB with only four GPUs enabled).
>
>
>
> Depending on the benchmark I normally see 6x to 11x speedup.
>
>
>
> Best regards,
>
> Miloš
>
>
>
> *From:* users <users-bounces at lists.quantum-espresso.org> *On Behalf Of *Michal
> Krompiec
> *Sent:* Tuesday, July 9, 2019 9:12 PM
> *To:* Quantum ESPRESSO users Forum <users at lists.quantum-espresso.org>
> *Subject:* Re: [QE-users] Bad scaling on GPU version QE
>
>
>
> Dear Pietro,
>
> Thank you very much. Is this implementation restricted to Nvidia GPUs?
>
> Best regards,
>
> Michal
>
>
>
> On Tue, 9 Jul 2019 at 19:14, Pietro BONFA' <pietro.bonfa at unipr.it> wrote:
>
> Dear Michal,
>
> I will hopefully be able to share some new benchmarking results in the
> wiki soon, but for the time being the most accurate estimate is in this
> presentation:
>
> https://on-demand.gputechconf.com/gtc-eu/2018/pdf/e8340-porting-quantum-espresso-to-gpu-accelerated-systems.pdf
> .
>
> In the slides above you will find a comparison between v6.1 and v6.3.
> Depending on the problem size and on the type of simulation, v6.1 can be
> substantially faster.
>
> Our plan is to close the gap with the future releases, since the
> difference mainly comes from partially implemented features (for
> example, charge density mixing, exchange and correlation, forces and
> stress are accelerated in v6.1 but not in v6.4). This, however, must be
> done with care in order to keep the GPU development sustainable.
>
> Hope this helps,
> kind regards,
> Pietro Bonfa'
>
>
>
> On 7/8/19 10:27 PM, Michal Krompiec wrote:
> > Dear Pietro,
> > What is the typical speed up vs a cpu-only system? Is this
> > https://www.dcs.warwick.ac.uk/pmbs/pmbs17/PMBS17/pres/paper3.pdf still
> > valid? Can you share any benchmarks on V100?
> > Best,
> > Michal Krompiec
> > Merck KGaA, Darmstadt, Germany
> >
> > On Mon, 8 Jul 2019 at 20:29, Pietro BONFA' <pietro.bonfa at unipr.it
> > <mailto:pietro.bonfa at unipr.it>> wrote:
> >
> > Dear Jing,
> >
> > good point, I'll add the list of accelerated features in the wiki. In
> > the mean time you can check page 21 of the first presentation that
> you
> > can find here: https://gitlab.com/QEF/q-e-gpu/wikis/home#performance
> >
> > Exact exchange will come with the next release but you can already
> try
> > it by compiling this develop branch:
> > https://gitlab.com/QEF/q-e-gpu/tree/gpu-exx
> >
> > Kind regards,
> > Pietro Bonfa'
> >
> > On 7/8/19 8:33 PM, JING YANG wrote:
> > > I am working on the latest version 6.4-a1. I have followed the
> > > instructions on the link you provided during the installation. I
> > would
> > > like to know which part of the calculation in pw being
> accelerated by
> > > GPU. For example, is it boosting the matrix diagonalization
> > during scf
> > > cycles, or boosting the hybrid functional calculations? I am
> > hoping to
> > > GPU acceleration can boost up the calculation on the exact
> > exchange in
> > > hybrid functional calculations. Is this the case?
> > >
> > > Thanks,
> > > Jing
> > >
> > > On Mon, Jul 8, 2019 at 1:57 PM Pietro BONFA'
> > <pietro.bonfa at unipr.it <mailto:pietro.bonfa at unipr.it>
> > > <mailto:pietro.bonfa at unipr.it <mailto:pietro.bonfa at unipr.it>>>
> wrote:
> > >
> > > Dear Jing,
> > >
> > > which GPU-enabled version are you using?
> > > GPU support starting from v6.1 is only available when using
> PGI
> > > compilers (well, in principle, any compiler implementing CUDA
> > Fortran).
> > >
> > > You can find additional information here:
> > >
> > > https://gitlab.com/QEF/q-e-gpu/wikis/home
> > >
> > > Kinds regards,
> > > Pietro Bonfa'
> > >
> > > On 7/8/19 5:01 PM, JING YANG wrote:
> > > > Hi,
> > > > I am trying to test the scaling of GPU version of QE
> > recently. I
> > > > found out the computational time scaling of the GPU
> version is
> > > very bad.
> > > > Is there any unique flags or keywords I don't know about
> > the GPU
> > > > version? I am using gcc-6.2.0, openmpi-1/8/4,
> > > craype-accel-nvidia35. I
> > > > know it is not the recommended set up, but I guess if I can
> > > compile it
> > > > successfully, then it should work normally.
> > > >
> > > > Thanks,
> > > > Jing
> > > >
> > > > _______________________________________________
> > > > Quantum ESPRESSO is supported by MaX
> > > (www.max-centre.eu/quantum-espresso
> > <http://www.max-centre.eu/quantum-espresso>
> > > <http://www.max-centre.eu/quantum-espresso>)
> > > > users mailing list users at lists.quantum-espresso.org
> > <mailto:users at lists.quantum-espresso.org>
> > > <mailto:users at lists.quantum-espresso.org
> > <mailto:users at lists.quantum-espresso.org>>
> > > > https://lists.quantum-espresso.org/mailman/listinfo/users
> > > >
> > >
> > >
> > > --
> > > Pietro Bonfà
> > > Department of Mathematical, Physical and Computer Sciences,
> > > University of Parma,
> > > Italy
> > >
> > > Firma il tuo 5 per mille all’Università di Parma e aiuta così
> i
> > > nostri studenti che vogliono realizzare un’esperienza di
> studio
> > > all’estero - Indica 00308780345 nella tua denuncia dei
> redditi.
> > > _______________________________________________
> > > Quantum ESPRESSO is supported by MaX
> > > (www.max-centre.eu/quantum-espresso
> > <http://www.max-centre.eu/quantum-espresso>
> > > <http://www.max-centre.eu/quantum-espresso>)
> > > users mailing list users at lists.quantum-espresso.org
> > <mailto:users at lists.quantum-espresso.org>
> > > <mailto:users at lists.quantum-espresso.org
> > <mailto:users at lists.quantum-espresso.org>>
> > > https://lists.quantum-espresso.org/mailman/listinfo/users
> > >
> > >
> > > _______________________________________________
> > > Quantum ESPRESSO is supported by MaX
> > (www.max-centre.eu/quantum-espresso
> > <http://www.max-centre.eu/quantum-espresso>)
> > > users mailing list users at lists.quantum-espresso.org
> > <mailto:users at lists.quantum-espresso.org>
> > > https://lists.quantum-espresso.org/mailman/listinfo/users
> > >
> >
> >
> > --
> > Pietro Bonfà
> > Department of Mathematical, Physical and Computer Sciences,
> > University of Parma,
> > Italy
> >
> > Firma il tuo 5 per mille all’Università di Parma e aiuta così i
> > nostri studenti che vogliono realizzare un’esperienza di studio
> > all’estero - Indica 00308780345 nella tua denuncia dei redditi.
> > _______________________________________________
> > Quantum ESPRESSO is supported by MaX
> > (www.max-centre.eu/quantum-espresso
> > <http://www.max-centre.eu/quantum-espresso>)
> > users mailing list users at lists.quantum-espresso.org
> > <mailto:users at lists.quantum-espresso.org>
> > https://lists.quantum-espresso.org/mailman/listinfo/users
> >
> >
> > _______________________________________________
> > Quantum ESPRESSO is supported by MaX (www.max-centre.eu/quantum-espresso
> )
> > users mailing list users at lists.quantum-espresso.org
> > https://lists.quantum-espresso.org/mailman/listinfo/users
> >
>
>
> --
> Pietro Bonfà
> Department of Mathematical, Physical and Computer Sciences,
> University of Parma,
> Italy
>
> Firma il tuo 5 per mille all’Università di Parma e aiuta così i nostri
> studenti che vogliono realizzare un’esperienza di studio all’estero -
> Indica 00308780345 nella tua denuncia dei redditi.
> _______________________________________________
> Quantum ESPRESSO is supported by MaX (www.max-centre.eu/quantum-espresso)
> users mailing list users at lists.quantum-espresso.org
> https://lists.quantum-espresso.org/mailman/listinfo/users
>
>
> -----------------------------------------------------------------------------------
> NVIDIA GmbH
> Wuerselen
> Amtsgericht Aachen
> HRB 8361
> Managing Director: Karen Theresa Burns
>
>
> -----------------------------------------------------------------------------------
> This email message is for the sole use of the intended recipient(s) and
> may contain
> confidential information. Any unauthorized review, use, disclosure or
> distribution
> is prohibited. If you are not the intended recipient, please contact the
> sender by
> reply email and destroy all copies of the original message.
>
> -----------------------------------------------------------------------------------
> _______________________________________________
> Quantum ESPRESSO is supported by MaX (www.max-centre.eu/quantum-espresso)
> users mailing list users at lists.quantum-espresso.org
> https://lists.quantum-espresso.org/mailman/listinfo/users
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.quantum-espresso.org/pipermail/users/attachments/20190710/c51d6865/attachment.html>
More information about the users
mailing list