[CP2K-user] {Spam?} [CP2K:12029] Performance of CP2K for MPT vs IntelMPI

Christmas Mwk cst... at gmail.com
Sat Aug 3 15:36:02 UTC 2019


Hi,

 
>
> You can try to launch the jobs with I_MPI_DEBUG=5
>
I 've tried that and you can find the debug output attached. In the 
MPI_startup() section it seems that each process is placed correctly on 
each core and no oversubscription or anything like that is observed. 
However I'm not sure what the last line means (I_MPI_PIN_MAPPING). Could 
you please guide me through how to make CP2K with IntelMPI scale across 
multiple nodes? Or is the performance as expected? I launch the executable 
by:

export OMP_NUM_THREADS=1

export I_MPI_PIN_DOMAIN=core

export I_MPI_DEBUG=5

mpirun -n 144 -ppn 36 -genv I_MPI_DEBUG=5 -genv I_MPI_PIN_DOMAIN=core -genv 
OMP_NUM_THREADS=1 -print-rank-map 
/lustre/home/d167/s1887443/scc/cp2k/exe/broadwell-o2-libs/cp2k.psmp -i 
H2O-64.inp -o out.txt

~                                                                          
                                                                            
                                                   


 

> MKL should include FFTW3 and thus there is no need for a separate 
> installation of that lib.
>
>  
>
Will the choice of FFTW3 affect the scaling performance though?

Best, 
Chris
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.cp2k.org/archives/cp2k-user/attachments/20190803/05c55563/attachment.htm>
-------------- next part --------------
(r1i3n3.ib0.icexa.epcc.ed.ac.uk:0,4,8,12,16,20,24,28,32,36,40,44,48,52,56,60,64,68,72,76,80,84,88,92,96,100,104,108,112,116,120,124,128,132,136,140)
(r1i3n11.ib0.icexa.epcc.ed.ac.uk:1,5,9,13,17,21,25,29,33,37,41,45,49,53,57,61,65,69,73,77,81,85,89,93,97,101,105,109,113,117,121,125,129,133,137,141)
(r1i3n16.ib0.icexa.epcc.ed.ac.uk:2,6,10,14,18,22,26,30,34,38,42,46,50,54,58,62,66,70,74,78,82,86,90,94,98,102,106,110,114,118,122,126,130,134,138,142)
(r1i3n17.ib0.icexa.epcc.ed.ac.uk:3,7,11,15,19,23,27,31,35,39,43,47,51,55,59,63,67,71,75,79,83,87,91,95,99,103,107,111,115,119,123,127,131,135,139,143)
[0] MPI startup(): Multi-threaded optimized library
[88] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[112] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[2] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[10] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[108] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[86] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[60] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[4] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[132] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[117] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[68] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[124] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[3] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[35] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[63] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[107] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[143] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[128] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[130] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[87] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[135] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[59] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[64] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[56] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[0] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[38] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[14] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[12] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[95] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[82] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[99] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[103] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[90] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[131] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[116] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[47] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[114] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[111] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[76] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[58] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[62] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[41] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[46] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[93] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[96] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[85] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[129] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[94] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[81] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[54] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[34] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[16] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[120] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[27] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[18] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[53] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[139] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[84] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[24] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[44] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[101] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[36] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[52] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[80] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[31] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[140] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[43] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[104] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[136] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[55] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[32] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[20] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[109] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[48] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[100] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[83] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[40] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[28] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[8] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[97] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[110] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[92] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[119] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[123] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[77] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[23] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[125] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[67] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[29] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[115] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[79] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[91] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[19] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[15] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[39] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[69] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[51] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[127] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[74] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[72] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[11] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[7] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[71] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[42] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[122] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[6] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[26] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[121] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[22] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[30] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[75] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[98] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[134] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[138] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[106] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[102] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[66] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[118] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[142] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[70] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[78] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[57] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[126] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[13] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[50] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[37] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[33] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[61] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[133] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[1] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[89] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[5] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[17] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[65] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[9] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[141] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[105] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[113] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[137] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[21] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[49] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[45] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[25] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[73] DAPL startup(): trying to open DAPL provider from I_MPI_DAPL_PROVIDER: ofa-v2-mlx5_0-1u
[112] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[112] MPI startup(): shm and dapl data transfer modes
[88] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[88] MPI startup(): shm and dapl data transfer modes
[10] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[10] MPI startup(): shm and dapl data transfer modes
[2] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[2] MPI startup(): shm and dapl data transfer modes
[86] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[86] MPI startup(): shm and dapl data transfer modes
[108] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[108] MPI startup(): shm and dapl data transfer modes
[4] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[4] MPI startup(): shm and dapl data transfer modes
[130] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[130] MPI startup(): shm and dapl data transfer modes
[132] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[132] MPI startup(): shm and dapl data transfer modes
[60] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[60] MPI startup(): shm and dapl data transfer modes
[143] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[14] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[14] MPI startup(): shm and dapl data transfer modes
[117] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[117] MPI startup(): shm and dapl data transfer modes
[143] MPI startup(): shm and dapl data transfer modes
[35] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[35] MPI startup(): shm and dapl data transfer modes
[38] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[3] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[38] MPI startup(): shm and dapl data transfer modes
[3] MPI startup(): shm and dapl data transfer modes
[68] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[63] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[68] MPI startup(): shm and dapl data transfer modes
[63] MPI startup(): shm and dapl data transfer modes
[107] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[107] MPI startup(): shm and dapl data transfer modes
[82] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[82] MPI startup(): shm and dapl data transfer modes
[41] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[41] MPI startup(): shm and dapl data transfer modes
[114] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[114] MPI startup(): shm and dapl data transfer modes
[135] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[90] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[135] MPI startup(): shm and dapl data transfer modes
[90] MPI startup(): shm and dapl data transfer modes
[59] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[59] MPI startup(): shm and dapl data transfer modes
[87] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[124] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[124] MPI startup(): shm and dapl data transfer modes
[87] MPI startup(): shm and dapl data transfer modes
[129] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[129] MPI startup(): shm and dapl data transfer modes
[85] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[128] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[85] MPI startup(): shm and dapl data transfer modes
[64] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[128] MPI startup(): shm and dapl data transfer modes
[56] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[58] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[64] MPI startup(): shm and dapl data transfer modes
[56] MPI startup(): shm and dapl data transfer modes
[58] MPI startup(): shm and dapl data transfer modes
[93] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[0] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[95] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[93] MPI startup(): shm and dapl data transfer modes
[0] MPI startup(): shm and dapl data transfer modes
[95] MPI startup(): shm and dapl data transfer modes
[81] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[12] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[81] MPI startup(): shm and dapl data transfer modes
[12] MPI startup(): shm and dapl data transfer modes
[103] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[103] MPI startup(): shm and dapl data transfer modes
[76] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[76] MPI startup(): shm and dapl data transfer modes
[111] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[116] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[62] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[99] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[101] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[111] MPI startup(): shm and dapl data transfer modes
[99] MPI startup(): shm and dapl data transfer modes
[116] MPI startup(): shm and dapl data transfer modes
[101] MPI startup(): shm and dapl data transfer modes
[62] MPI startup(): shm and dapl data transfer modes
[96] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[47] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[96] MPI startup(): shm and dapl data transfer modes
[54] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[53] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[47] MPI startup(): shm and dapl data transfer modes
[54] MPI startup(): shm and dapl data transfer modes
[53] MPI startup(): shm and dapl data transfer modes
[131] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[131] MPI startup(): shm and dapl data transfer modes
[18] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[94] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[18] MPI startup(): shm and dapl data transfer modes
[46] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[94] MPI startup(): shm and dapl data transfer modes
[46] MPI startup(): shm and dapl data transfer modes
[34] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[16] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[34] MPI startup(): shm and dapl data transfer modes
[16] MPI startup(): shm and dapl data transfer modes
[44] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[44] MPI startup(): shm and dapl data transfer modes
[120] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[24] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[109] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[36] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[24] MPI startup(): shm and dapl data transfer modes
[120] MPI startup(): shm and dapl data transfer modes
[109] MPI startup(): shm and dapl data transfer modes
[97] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[36] MPI startup(): shm and dapl data transfer modes
[140] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[97] MPI startup(): shm and dapl data transfer modes
[140] MPI startup(): shm and dapl data transfer modes
[84] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[32] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[84] MPI startup(): shm and dapl data transfer modes
[32] MPI startup(): shm and dapl data transfer modes
[28] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[28] MPI startup(): shm and dapl data transfer modes
[104] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[8] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[20] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[80] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[104] MPI startup(): shm and dapl data transfer modes
[20] MPI startup(): shm and dapl data transfer modes
[8] MPI startup(): shm and dapl data transfer modes
[110] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[40] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[100] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[80] MPI startup(): shm and dapl data transfer modes
[110] MPI startup(): shm and dapl data transfer modes
[100] MPI startup(): shm and dapl data transfer modes
[136] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[40] MPI startup(): shm and dapl data transfer modes
[72] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[92] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[136] MPI startup(): shm and dapl data transfer modes
[72] MPI startup(): shm and dapl data transfer modes
[92] MPI startup(): shm and dapl data transfer modes
[55] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[74] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[55] MPI startup(): shm and dapl data transfer modes
[48] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[74] MPI startup(): shm and dapl data transfer modes
[77] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[52] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[48] MPI startup(): shm and dapl data transfer modes
[31] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[77] MPI startup(): shm and dapl data transfer modes
[31] MPI startup(): shm and dapl data transfer modes
[52] MPI startup(): shm and dapl data transfer modes
[83] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[43] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[83] MPI startup(): shm and dapl data transfer modes
[42] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[43] MPI startup(): shm and dapl data transfer modes
[42] MPI startup(): shm and dapl data transfer modes
[6] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[27] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[122] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[6] MPI startup(): shm and dapl data transfer modes
[27] MPI startup(): shm and dapl data transfer modes
[139] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[30] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[122] MPI startup(): shm and dapl data transfer modes
[30] MPI startup(): shm and dapl data transfer modes
[139] MPI startup(): shm and dapl data transfer modes
[106] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[98] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[138] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[19] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[98] MPI startup(): shm and dapl data transfer modes
[106] MPI startup(): shm and dapl data transfer modes
[134] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[138] MPI startup(): shm and dapl data transfer modes
[19] MPI startup(): shm and dapl data transfer modes
[123] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[23] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[134] MPI startup(): shm and dapl data transfer modes
[78] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[102] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[123] MPI startup(): shm and dapl data transfer modes
[70] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[102] MPI startup(): shm and dapl data transfer modes
[23] MPI startup(): shm and dapl data transfer modes
[119] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[78] MPI startup(): shm and dapl data transfer modes
[70] MPI startup(): shm and dapl data transfer modes
[127] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[67] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[26] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[119] MPI startup(): shm and dapl data transfer modes
[66] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[22] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[26] MPI startup(): shm and dapl data transfer modes
[67] MPI startup(): shm and dapl data transfer modes
[22] MPI startup(): shm and dapl data transfer modes
[66] MPI startup(): shm and dapl data transfer modes
[127] MPI startup(): shm and dapl data transfer modes
[7] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[126] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[7] MPI startup(): shm and dapl data transfer modes
[79] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[118] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[115] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[126] MPI startup(): shm and dapl data transfer modes
[142] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[79] MPI startup(): shm and dapl data transfer modes
[115] MPI startup(): shm and dapl data transfer modes
[118] MPI startup(): shm and dapl data transfer modes
[51] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[91] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[11] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[142] MPI startup(): shm and dapl data transfer modes
[51] MPI startup(): shm and dapl data transfer modes
[75] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[15] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[91] MPI startup(): shm and dapl data transfer modes
[125] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[11] MPI startup(): shm and dapl data transfer modes
[75] MPI startup(): shm and dapl data transfer modes
[50] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[15] MPI startup(): shm and dapl data transfer modes
[39] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[125] MPI startup(): shm and dapl data transfer modes
[71] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[50] MPI startup(): shm and dapl data transfer modes
[39] MPI startup(): shm and dapl data transfer modes
[71] MPI startup(): shm and dapl data transfer modes
[29] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[121] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[29] MPI startup(): shm and dapl data transfer modes
[121] MPI startup(): shm and dapl data transfer modes
[69] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[69] MPI startup(): shm and dapl data transfer modes
[57] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[57] MPI startup(): shm and dapl data transfer modes
[13] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[13] MPI startup(): shm and dapl data transfer modes
[37] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[37] MPI startup(): shm and dapl data transfer modes
[61] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[5] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[61] MPI startup(): shm and dapl data transfer modes
[5] MPI startup(): shm and dapl data transfer modes
[133] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[133] MPI startup(): shm and dapl data transfer modes
[113] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[113] MPI startup(): shm and dapl data transfer modes
[1] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[1] MPI startup(): shm and dapl data transfer modes
[33] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[89] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[33] MPI startup(): shm and dapl data transfer modes
[89] MPI startup(): shm and dapl data transfer modes
[9] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[9] MPI startup(): shm and dapl data transfer modes
[45] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[141] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[137] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[45] MPI startup(): shm and dapl data transfer modes
[141] MPI startup(): shm and dapl data transfer modes
[17] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[21] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[137] MPI startup(): shm and dapl data transfer modes
[17] MPI startup(): shm and dapl data transfer modes
[21] MPI startup(): shm and dapl data transfer modes
[49] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[65] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[49] MPI startup(): shm and dapl data transfer modes
[105] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[65] MPI startup(): shm and dapl data transfer modes
[105] MPI startup(): shm and dapl data transfer modes
[25] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[25] MPI startup(): shm and dapl data transfer modes
[73] MPI startup(): DAPL provider ofa-v2-mlx5_0-1u
[73] MPI startup(): shm and dapl data transfer modes
[2] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[2] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[26] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[26] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[38] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[38] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[86] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[86] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[102] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[102] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[41] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[41] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[61] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[61] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[6] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[6] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[97] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[97] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[10] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[10] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[32] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[32] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[44] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[44] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[100] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[100] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[112] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[112] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[140] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[140] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[0] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[0] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[4] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[4] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[8] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[8] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[117] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[117] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[12] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[12] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[14] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[14] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[16] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[16] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[20] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[20] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[24] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[24] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[28] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[28] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[36] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[36] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[40] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[40] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[48] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[48] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[56] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[56] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[60] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[60] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[64] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[64] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[72] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[72] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[80] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[80] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[84] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[84] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[129] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[129] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[18] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[18] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[88] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[88] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[104] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[104] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[116] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[116] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[120] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[120] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[128] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[128] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[136] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[136] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[52] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[52] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[68] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[68] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[76] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[76] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[92] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[92] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[96] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[96] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[108] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[108] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[22] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[22] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[124] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[124] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[1] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[1] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[132] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[132] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[30] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[30] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[5] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[5] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[34] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[34] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[9] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[9] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[42] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[42] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[13] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[13] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[46] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[46] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[17] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[17] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[50] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[50] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[21] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[21] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[54] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[54] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[25] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[25] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[58] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[58] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[23] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[23] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[29] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[29] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[31] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[31] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[62] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[62] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[55] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[55] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[131] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[131] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[139] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[139] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[33] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[33] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[66] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[66] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[3] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[3] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[7] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[7] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[70] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[70] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[37] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[37] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[11] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[11] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[74] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[74] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[45] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[45] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[15] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[15] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[78] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[78] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[82] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[82] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[49] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[49] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[19] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[19] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[90] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[90] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[94] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[94] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[53] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[53] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[27] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[27] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[98] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[98] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[57] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[57] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[106] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[106] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[35] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[35] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[110] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[110] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[65] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[65] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[114] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[114] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[39] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[39] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[118] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[118] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[69] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[69] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[122] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[122] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[126] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[126] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[73] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[73] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[130] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[130] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[43] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[43] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[77] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[77] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[134] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[134] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[138] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[138] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[81] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[81] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[47] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[47] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[142] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[142] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[85] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[85] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[89] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[89] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[51] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[51] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[93] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[93] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[101] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[101] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[105] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[105] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[59] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[59] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[109] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[109] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[113] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[113] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[121] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[121] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[63] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[63] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[125] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[125] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[133] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[133] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[137] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[137] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[67] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[67] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[141] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[141] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[71] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[71] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[75] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[75] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[79] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[79] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[83] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[83] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[87] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[87] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[91] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[91] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[95] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[95] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[99] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[99] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[103] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[103] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[107] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[107] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[111] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[111] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[115] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[115] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[119] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[119] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[123] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[123] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[127] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[127] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[135] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[135] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[143] MPID_nem_init_dapl_coll_fns(): User set DAPL collective mask = 0000
[143] MPID_nem_init_dapl_coll_fns(): Effective DAPL collective mask = 0000
[0] MPI startup(): Rank    Pid      Node name  Pin cpu
[0] MPI startup(): 0       18835    r1i3n3     {18,54}
[0] MPI startup(): 1       24554    r1i3n11    {18,54}
[0] MPI startup(): 2       16097    r1i3n16    {18,54}
[0] MPI startup(): 3       72472    r1i3n17    {18,54}
[0] MPI startup(): 4       18836    r1i3n3     {19,55}
[0] MPI startup(): 5       24555    r1i3n11    {19,55}
[0] MPI startup(): 6       16098    r1i3n16    {19,55}
[0] MPI startup(): 7       72473    r1i3n17    {19,55}
[0] MPI startup(): 8       18837    r1i3n3     {20,56}
[0] MPI startup(): 9       24556    r1i3n11    {20,56}
[0] MPI startup(): 10      16099    r1i3n16    {20,56}
[0] MPI startup(): 11      72474    r1i3n17    {20,56}
[0] MPI startup(): 12      18838    r1i3n3     {21,57}
[0] MPI startup(): 13      24557    r1i3n11    {21,57}
[0] MPI startup(): 14      16100    r1i3n16    {21,57}
[0] MPI startup(): 15      72475    r1i3n17    {21,57}
[0] MPI startup(): 16      18839    r1i3n3     {22,58}
[0] MPI startup(): 17      24558    r1i3n11    {22,58}
[0] MPI startup(): 18      16101    r1i3n16    {22,58}
[0] MPI startup(): 19      72476    r1i3n17    {22,58}
[0] MPI startup(): 20      18840    r1i3n3     {23,59}
[0] MPI startup(): 21      24559    r1i3n11    {23,59}
[0] MPI startup(): 22      16102    r1i3n16    {23,59}
[0] MPI startup(): 23      72477    r1i3n17    {23,59}
[0] MPI startup(): 24      18841    r1i3n3     {24,60}
[0] MPI startup(): 25      24560    r1i3n11    {24,60}
[0] MPI startup(): 26      16103    r1i3n16    {24,60}
[0] MPI startup(): 27      72478    r1i3n17    {24,60}
[0] MPI startup(): 28      18842    r1i3n3     {25,61}
[0] MPI startup(): 29      24561    r1i3n11    {25,61}
[0] MPI startup(): 30      16104    r1i3n16    {25,61}
[0] MPI startup(): 31      72479    r1i3n17    {25,61}
[0] MPI startup(): 32      18843    r1i3n3     {26,62}
[0] MPI startup(): 33      24562    r1i3n11    {26,62}
[0] MPI startup(): 34      16105    r1i3n16    {26,62}
[0] MPI startup(): 35      72480    r1i3n17    {26,62}
[0] MPI startup(): 36      18844    r1i3n3     {27,63}
[0] MPI startup(): 37      24563    r1i3n11    {27,63}
[0] MPI startup(): 38      16106    r1i3n16    {27,63}
[0] MPI startup(): 39      72481    r1i3n17    {27,63}
[0] MPI startup(): 40      18845    r1i3n3     {28,64}
[0] MPI startup(): 41      24564    r1i3n11    {28,64}
[0] MPI startup(): 42      16107    r1i3n16    {28,64}
[0] MPI startup(): 43      72482    r1i3n17    {28,64}
[0] MPI startup(): 44      18846    r1i3n3     {29,65}
[0] MPI startup(): 45      24565    r1i3n11    {29,65}
[0] MPI startup(): 46      16108    r1i3n16    {29,65}
[0] MPI startup(): 47      72483    r1i3n17    {29,65}
[0] MPI startup(): 48      18847    r1i3n3     {30,66}
[0] MPI startup(): 49      24566    r1i3n11    {30,66}
[0] MPI startup(): 50      16109    r1i3n16    {30,66}
[0] MPI startup(): 51      72484    r1i3n17    {30,66}
[0] MPI startup(): 52      18848    r1i3n3     {31,67}
[0] MPI startup(): 53      24567    r1i3n11    {31,67}
[0] MPI startup(): 54      16110    r1i3n16    {31,67}
[0] MPI startup(): 55      72485    r1i3n17    {31,67}
[0] MPI startup(): 56      18849    r1i3n3     {32,68}
[0] MPI startup(): 57      24568    r1i3n11    {32,68}
[0] MPI startup(): 58      16111    r1i3n16    {32,68}
[0] MPI startup(): 59      72486    r1i3n17    {32,68}
[0] MPI startup(): 60      18850    r1i3n3     {33,69}
[0] MPI startup(): 61      24569    r1i3n11    {33,69}
[0] MPI startup(): 62      16112    r1i3n16    {33,69}
[0] MPI startup(): 63      72487    r1i3n17    {33,69}
[0] MPI startup(): 64      18851    r1i3n3     {34,70}
[0] MPI startup(): 65      24570    r1i3n11    {34,70}
[0] MPI startup(): 66      16113    r1i3n16    {34,70}
[0] MPI startup(): 67      72488    r1i3n17    {34,70}
[0] MPI startup(): 68      18852    r1i3n3     {35,71}
[0] MPI startup(): 69      24571    r1i3n11    {35,71}
[0] MPI startup(): 70      16114    r1i3n16    {35,71}
[0] MPI startup(): 71      72489    r1i3n17    {35,71}
[0] MPI startup(): 72      18853    r1i3n3     {0,36}
[0] MPI startup(): 73      24572    r1i3n11    {0,36}
[0] MPI startup(): 74      16115    r1i3n16    {0,36}
[0] MPI startup(): 75      72490    r1i3n17    {0,36}
[0] MPI startup(): 76      18854    r1i3n3     {1,37}
[0] MPI startup(): 77      24573    r1i3n11    {1,37}
[0] MPI startup(): 78      16116    r1i3n16    {1,37}
[0] MPI startup(): 79      72491    r1i3n17    {1,37}
[0] MPI startup(): 80      18855    r1i3n3     {2,38}
[0] MPI startup(): 81      24574    r1i3n11    {2,38}
[0] MPI startup(): 82      16117    r1i3n16    {2,38}
[0] MPI startup(): 83      72492    r1i3n17    {2,38}
[0] MPI startup(): 84      18856    r1i3n3     {3,39}
[0] MPI startup(): 85      24575    r1i3n11    {3,39}
[0] MPI startup(): 86      16118    r1i3n16    {3,39}
[0] MPI startup(): 87      72493    r1i3n17    {3,39}
[0] MPI startup(): 88      18857    r1i3n3     {4,40}
[0] MPI startup(): 89      24576    r1i3n11    {4,40}
[0] MPI startup(): 90      16119    r1i3n16    {4,40}
[0] MPI startup(): 91      72494    r1i3n17    {4,40}
[0] MPI startup(): 92      18858    r1i3n3     {5,41}
[0] MPI startup(): 93      24577    r1i3n11    {5,41}
[0] MPI startup(): 94      16120    r1i3n16    {5,41}
[0] MPI startup(): 95      72495    r1i3n17    {5,41}
[0] MPI startup(): 96      18859    r1i3n3     {6,42}
[0] MPI startup(): 97      24578    r1i3n11    {6,42}
[0] MPI startup(): 98      16121    r1i3n16    {6,42}
[0] MPI startup(): 99      72496    r1i3n17    {6,42}
[0] MPI startup(): 100     18860    r1i3n3     {7,43}
[0] MPI startup(): 101     24579    r1i3n11    {7,43}
[0] MPI startup(): 102     16122    r1i3n16    {7,43}
[0] MPI startup(): 103     72497    r1i3n17    {7,43}
[0] MPI startup(): 104     18861    r1i3n3     {8,44}
[0] MPI startup(): 105     24580    r1i3n11    {8,44}
[0] MPI startup(): 106     16123    r1i3n16    {8,44}
[0] MPI startup(): 107     72498    r1i3n17    {8,44}
[0] MPI startup(): 108     18862    r1i3n3     {9,45}
[0] MPI startup(): 109     24581    r1i3n11    {9,45}
[0] MPI startup(): 110     16124    r1i3n16    {9,45}
[0] MPI startup(): 111     72499    r1i3n17    {9,45}
[0] MPI startup(): 112     18863    r1i3n3     {10,46}
[0] MPI startup(): 113     24582    r1i3n11    {10,46}
[0] MPI startup(): 114     16125    r1i3n16    {10,46}
[0] MPI startup(): 115     72500    r1i3n17    {10,46}
[0] MPI startup(): 116     18864    r1i3n3     {11,47}
[0] MPI startup(): 117     24583    r1i3n11    {11,47}
[0] MPI startup(): 118     16126    r1i3n16    {11,47}
[0] MPI startup(): 119     72501    r1i3n17    {11,47}
[0] MPI startup(): 120     18865    r1i3n3     {12,48}
[0] MPI startup(): 121     24584    r1i3n11    {12,48}
[0] MPI startup(): 122     16127    r1i3n16    {12,48}
[0] MPI startup(): 123     72502    r1i3n17    {12,48}
[0] MPI startup(): 124     18866    r1i3n3     {13,49}
[0] MPI startup(): 125     24585    r1i3n11    {13,49}
[0] MPI startup(): 126     16128    r1i3n16    {13,49}
[0] MPI startup(): 127     72503    r1i3n17    {13,49}
[0] MPI startup(): 128     18867    r1i3n3     {14,50}
[0] MPI startup(): 129     24586    r1i3n11    {14,50}
[0] MPI startup(): 130     16129    r1i3n16    {14,50}
[0] MPI startup(): 131     72504    r1i3n17    {14,50}
[0] MPI startup(): 132     18868    r1i3n3     {15,51}
[0] MPI startup(): 133     24587    r1i3n11    {15,51}
[0] MPI startup(): 134     16130    r1i3n16    {15,51}
[0] MPI startup(): 135     72505    r1i3n17    {15,51}
[0] MPI startup(): 136     18869    r1i3n3     {16,52}
[0] MPI startup(): 137     24588    r1i3n11    {16,52}
[0] MPI startup(): 138     16131    r1i3n16    {16,52}
[0] MPI startup(): 139     72506    r1i3n17    {16,52}
[0] MPI startup(): 140     18870    r1i3n3     {17,53}
[0] MPI startup(): 141     24589    r1i3n11    {17,53}
[0] MPI startup(): 142     16132    r1i3n16    {17,53}
[0] MPI startup(): 143     72507    r1i3n17    {17,53}
[0] MPI startup(): I_MPI_DEBUG=5
[0] MPI startup(): I_MPI_INFO_NUMA_NODE_MAP=mlx5_0:1
[0] MPI startup(): I_MPI_INFO_NUMA_NODE_NUM=2
[0] MPI startup(): I_MPI_PIN_MAPPING=36:0 18,4 19,8 20,12 21,16 22,20 23,24 24,28 25,32 26,36 27,40 28,44 29,48 30,52 31,56 32,60 33,64 34,68 35,72 0,76 1,80 2,84 3,88 4,92 5,96 6,100 7,104 8,108 9,112 10,116 11,120 12,124 13,128 14,132 15,136 16,140 17


More information about the CP2K-user mailing list