<html xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"> <head> <meta http-equiv="Content-Type" content="text/html; charset=utf-8"> <meta name="Generator" content="Microsoft Word 15 (filtered medium)"> <style></style> </head> <body lang="en-CH" link="blue" vlink="purple" style="word-wrap:break-word"> <div class="WordSection1"> <p class="MsoNormal"><span lang="DE-CH" style="font-size:11.0pt;mso-fareast-language:EN-US">Hi Ava<o:p></o:p></span></p> <p class="MsoNormal"><span lang="DE-CH" style="font-size:11.0pt;mso-fareast-language:EN-US"><o:p> </o:p></span></p> <p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;mso-fareast-language:EN-US">Thanks for testing. Indeed, the .sif file does not seem to work with the host MPI properly. These .sif files were directly built with apptainer. This was a test and we will not provide such containers in the future any longer. Instead, I suggest the download of a cp2k production docker container. Could you test such a docker container with apptainer? You can download it with the command <o:p></o:p></span></p> <p class="MsoNormal" style="text-indent:36.0pt"><span lang="EN-US" style="font-size:11.0pt;mso-fareast-language:EN-US">apptainer pull docker://mkrack/cp2k:2023.2_mpich_generic_psmp<o:p></o:p></span></p> <p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;mso-fareast-language:EN-US">or<o:p></o:p></span></p> <p class="MsoNormal" style="text-indent:36.0pt"><span lang="EN-US" style="font-size:11.0pt;mso-fareast-language:EN-US">apptainer pull docker://mkrack/cp2k:2023.2_openmpi_generic_psmp<o:p></o:p></span></p> <p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;mso-fareast-language:EN-US">depending on your host MPI version.<o:p></o:p></span></p> <p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;mso-fareast-language:EN-US">A list of the available docker containers can be found <a href="https://hub.docker.com/repository/docker/mkrack/cp2k/tags?page=1&ordering=last_updated"> here</a>.<o:p></o:p></span></p> <p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;mso-fareast-language:EN-US"><o:p> </o:p></span></p> <p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;mso-fareast-language:EN-US">Best<o:p></o:p></span></p> <p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;mso-fareast-language:EN-US"><o:p> </o:p></span></p> <p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;mso-fareast-language:EN-US">Matthias<o:p></o:p></span></p> <p class="MsoNormal"><span lang="EN-US" style="font-size:11.0pt;mso-fareast-language:EN-US"><o:p> </o:p></span></p> <div id="mail-editor-reference-message-container"> <div> <div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm"> <p class="MsoNormal" style="mso-margin-top-alt:0cm;margin-right:0cm;margin-bottom:12.0pt;margin-left:36.0pt"> <b><span style="font-size:12.0pt;color:black">From: </span></b><span style="font-size:12.0pt;color:black">cp2k@googlegroups.com <cp2k@googlegroups.com> on behalf of Ava Rajh <ava.rajh@gmail.com><br> <b>Date: </b>Thursday, 19 October 2023 at 12:17<br> <b>To: </b>cp2k <cp2k@googlegroups.com><br> <b>Subject: </b>Re: [CP2K:19391] Help with running cp2k in parallel with Slurm<o:p></o:p></span></p> </div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt"><o:p> </o:p></span></p> <div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt">Sorry for the confusion, I read the output wrong, <o:p></o:p></span></p> </div> <div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt">and if I put the ntasks in the header of the batch file I get the same result as running just with srun, so the number of tasks determines the number of programs running with one MPI rank each. <o:p></o:p></span></p> </div> <div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt"><o:p> </o:p></span></p> </div> <div> <div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt">On Thursday, October 19, 2023 at 10:20:39 AM UTC+2 Ava Rajh wrote:<o:p></o:p></span></p> </div> <blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm"> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt"><o:p> </o:p></span></p> <div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt">Hi Matthias, <o:p></o:p></span></p> </div> <div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt"><o:p> </o:p></span></p> </div> <div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt">Thank you for the reply<o:p></o:p></span></p> </div> <div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt"><o:p> </o:p></span></p> </div> <div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt">I tried both, first just with the srun command and as part of the #SBATCH file. <o:p></o:p></span></p> </div> <div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt">If I run the "srun" command and specify the number of tasks I get the before mentioned multiple copies of the same program with 1 MPI rank each. The same happens if I run the command outside the container without the srun and specify the number of tasks with just: mpiexec -n 4 <o:p></o:p></span></p> </div> <div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt"><o:p> </o:p></span></p> </div> <div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt">and if I put the ntasks in the header of the batch file, then I just get one copy of the program with 1 MPI rank, no matter how many -ntasks are defined. <o:p></o:p></span></p> </div> <div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt"><o:p> </o:p></span></p> </div> <div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt">Any idea about how to start my calculation would be very helpful, thank you. <o:p></o:p></span></p> </div> <div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt">kind regards, Ava<o:p></o:p></span></p> </div> <div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt"><o:p> </o:p></span></p> </div> <div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt"><o:p> </o:p></span></p> </div> <div> <div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt">On Wednesday, October 18, 2023 at 7:21:22 PM UTC+2 Krack Matthias wrote:<o:p></o:p></span></p> </div> <blockquote style="border:none;border-left:solid #CCCCCC 1.0pt;padding:0cm 0cm 0cm 6.0pt;margin-left:4.8pt;margin-right:0cm"> <div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:36.0pt"> <span lang="DE-CH" style="font-size:11.0pt">Hi Ava</span><span style="font-size:11.0pt"><o:p></o:p></span></p> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:36.0pt"> <span lang="DE-CH" style="font-size:11.0pt"> </span><span style="font-size:11.0pt"><o:p></o:p></span></p> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:36.0pt"> <span lang="EN-US" style="font-size:11.0pt">Do you run the “srun” command as part of a SLURM batch job file with a #SBATCH header section or interactively?</span><span style="font-size:11.0pt"><o:p></o:p></span></p> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:36.0pt"> <span lang="EN-US" style="font-size:11.0pt">Your guess is right, the –ntasks flag defines the number of MPI ranks.</span><span style="font-size:11.0pt"><o:p></o:p></span></p> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:36.0pt"> <span lang="EN-US" style="font-size:11.0pt"> </span><span style="font-size:11.0pt"><o:p></o:p></span></p> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:36.0pt"> <span lang="EN-US" style="font-size:11.0pt">Best</span><span style="font-size:11.0pt"><o:p></o:p></span></p> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:36.0pt"> <span lang="EN-US" style="font-size:11.0pt"> </span><span style="font-size:11.0pt"><o:p></o:p></span></p> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:36.0pt"> <span lang="EN-US" style="font-size:11.0pt">Matthias</span><span style="font-size:11.0pt"><o:p></o:p></span></p> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:36.0pt"> <span lang="EN-US" style="font-size:11.0pt"> </span><span style="font-size:11.0pt"><o:p></o:p></span></p> </div> </div> <div> <div> <div> <div> <div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm"> <p class="MsoNormal" style="mso-margin-top-alt:auto;margin-bottom:12.0pt;margin-left:72.0pt"> <b><span style="font-size:12.0pt;color:black">From: </span></b><span style="font-size:12.0pt;color:black">cp...@googlegroups.com <cp...@googlegroups.com> on behalf of Ava Rajh <ava....@gmail.com><br> <b>Date: </b>Wednesday, 18 October 2023 at 14:17<br> <b>To: </b>cp2k <cp...@googlegroups.com><br> <b>Subject: </b>[CP2K:19379] Help with running cp2k in parallel with Slurm</span><span style="font-size:11.0pt"><o:p></o:p></span></p> </div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:72.0pt"> <span style="font-size:11.0pt">Dear all, <br> <br> I am trying to run cp2k on our HPC cluster and I am new in doing any kind of parallel computing and work on a cluster, so I would appreciate if some help and I apologize if I am missing something obvious. <o:p></o:p></span></p> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:72.0pt"> <span style="font-size:11.0pt">I am trying to use Cp2k in combination with apptainer and I followed instructions at <a href="https://github.com/cp2k/cp2k/tree/master/tools/apptainer" target="_blank"> https://github.com/cp2k/cp2k/tree/master/tools/apptainer</a> <o:p></o:p></span></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:72.0pt"> <span style="font-size:11.0pt"> <o:p></o:p></span></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:72.0pt"> <span style="font-size:11.0pt">I have a .sif file in my work directory and if I work within it (Running MPI within the container), everything works perfectly and I can set the number of MPI threads. <o:p></o:p></span></p> </div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:72.0pt"> <span style="font-size:11.0pt"> <o:p></o:p></span></p> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:72.0pt"> <span style="font-size:11.0pt">But when trying to run it through slurm, I can't seem to be able to set the number of MPI processes per node. If i start a command like: <o:p></o:p></span></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:72.0pt"> <span style="font-size:11.0pt">srun --ntasks=2 apptainer run -B $PWD cp2k-2023.2_mpich_generic_psmp.sif cp2k -i H2O-32.in<o:p></o:p></span></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:72.0pt"> <span style="font-size:11.0pt">it just starts 2 instances of the program that run at the same time, and for each, the total number of message passing processes is 1. I am able to set and change the number of OpenMP threads though. <o:p></o:p></span></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:72.0pt"> <span style="font-size:11.0pt">So my question would be first, am I wrongly assuming that --ntasks X should correspond to the number of MPI threads? And if I am, how would I set it. <o:p></o:p></span></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:72.0pt"> <span style="font-size:11.0pt"> <o:p></o:p></span></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:72.0pt"> <span style="font-size:11.0pt">Please let me know if I need to provide any more information to diagnose the issue. <o:p></o:p></span></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:72.0pt"> <span style="font-size:11.0pt">Thank you very much for the help and kind regards, <o:p></o:p></span></p> </div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:72.0pt"> <span style="font-size:11.0pt">Ava Rajh<o:p></o:p></span></p> </div> </div> </div> </div> </div> <div> <div> <div> <div> <p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:72.0pt"> <span style="font-size:11.0pt">-- <br> You received this message because you are subscribed to the Google Groups "cp2k" group.<br> To unsubscribe from this group and stop receiving emails from it, send an email to cp2k+uns...@googlegroups.com.<br> To view this discussion on the web visit <a href="https://groups.google.com/d/msgid/cp2k/2393b350-7de0-4599-97e0-4f52ffec0c5en%40googlegroups.com?utm_medium=email&utm_source=footer" target="_blank"> https://groups.google.com/d/msgid/cp2k/2393b350-7de0-4599-97e0-4f52ffec0c5en%40googlegroups.com</a>.<o:p></o:p></span></p> </div> </div> </div> </div> </blockquote> </div> </blockquote> </div> <p class="MsoNormal" style="margin-left:36.0pt"><span style="font-size:11.0pt">-- <br> You received this message because you are subscribed to the Google Groups "cp2k" group.<br> To unsubscribe from this group and stop receiving emails from it, send an email to <a href="mailto:cp2k+unsubscribe@googlegroups.com">cp2k+unsubscribe@googlegroups.com</a>.<br> To view this discussion on the web visit <a href="https://groups.google.com/d/msgid/cp2k/1a89bd22-860c-4922-a2b6-bd20232ca770n%40googlegroups.com?utm_medium=email&utm_source=footer"> https://groups.google.com/d/msgid/cp2k/1a89bd22-860c-4922-a2b6-bd20232ca770n%40googlegroups.com</a>.<o:p></o:p></span></p> </div> </div> </div> </body> </html> <p></p> -- <br /> You received this message because you are subscribed to the Google Groups "cp2k" group.<br /> To unsubscribe from this group and stop receiving emails from it, send an email to <a href="mailto:cp2k+unsubscribe@googlegroups.com">cp2k+unsubscribe@googlegroups.com</a>.<br /> To view this discussion on the web visit <a href="https://groups.google.com/d/msgid/cp2k/ZRAP278MB0827D6DA09823659200590A5F4D4A%40ZRAP278MB0827.CHEP278.PROD.OUTLOOK.COM?utm_medium=email&utm_source=footer">https://groups.google.com/d/msgid/cp2k/ZRAP278MB0827D6DA09823659200590A5F4D4A%40ZRAP278MB0827.CHEP278.PROD.OUTLOOK.COM</a>.<br />