[CP2K:3240] status of hybrid OpenMP+MPI version

Axel akoh... at gmail.com
Thu May 12 13:50:53 UTC 2011


hi urban,

> Actually, I also get crashes with OpenMPI--but not with MPICH2.  I
> recompiled OpenMPI 1.4.3 with MPI user thread support, and I recompiled
> BLACS and ScaLAPACK with it.  As soon as I use more than 1 thread (only
>
i think that one went away after defining   -D__HAS_NO_OMP_3

> tried popt) it crashes in a BLACS call.
>
> I'll also give the OpenMPI 1.5 development branch a try.
>

hmm... i have this nagging feeling that there may be a race condition 
somewhere
and that it just doesn't show with MPICH.

with experimenting some more, i see that the "degree of badness" in the 
total
energies, for example, is rather low with using only 2 or 3 threads but gets 
large
with 6 or more.

on the other hand, i am _very_ impressed how well the threading 
parallelization
scales (with the .ssmp binary), even to a very large thread count (i have a 
few
48 core maschines to test on).

i hope there is an answer somewhere as to why hybrid parallelization does 
crash
with OpenMPI...

cheers,
    axel.

Regards,
> Urban
>
> > 
> > thanks for your help,
> >      axel.
> > 
> > 
> >         just make sure we're on the same page. the input(s) that
> >         are giving me the problems are the water benchmark inputs.
> >         in tests/QS/benchmark/
> >         
> >         
> >         the cp2k.?smp binaries work fine for OMP_NUM_THREADS=1,
> >         but as soon as i enable more than one thread with cp2k.psmp
> >         and multiple MPI tasks, i get NaNs or random energies.
> >         cp2k.ssmp appears to be working for both intel 11.1 and
> >         gfortran 4.4.4
> >         
> >         
> >         thanks,
> >             axel.
> >         
> >         
> >                 Cheers,
> >                 Urban.
> >                 
> >                 > 
> >                 > in any case, i'll give it a try.
> >                 > 
> >                 > 
> >                 > thanks,
> >                 >      axel.
> >                 > 
> >                 > -- 
> >                 > You received this message because you are subscribed
> >                 to the Google
> >                 > Groups "cp2k" group.
> >                 > To post to this group, send email to
> >                 cp... at googlegroups.com.
> >                 > To unsubscribe from this group, send email to cp2k
> >                 > +uns... at googlegroups.com.
> >                 > For more options, visit this group at
> >                 > http://groups.google.com/group/cp2k?hl=en.
> >                 
> >                 
> > 
> > -- 
> > You received this message because you are subscribed to the Google
> > Groups "cp2k" group.
> > To post to this group, send email to cp... at googlegroups.com.
> > To unsubscribe from this group, send email to cp2k
> > +unsu... at googlegroups.com.
> > For more options, visit this group at
> > http://groups.google.com/group/cp2k?hl=en.
>
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.cp2k.org/archives/cp2k-user/attachments/20110512/8ddce781/attachment.htm>


More information about the CP2K-user mailing list