<div dir="ltr"><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif">Dear Prof.
Peter Blaha and WIEN2k users,</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif">Then by <span style="color:rgb(31,73,125)">run x lapw1 –p:</span></span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">starting parallel lapw1 at Tue Apr 13 21:04:15 CEST 2021</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">-> starting
parallel LAPW1 jobs at Tue Apr 13 21:04:15 CEST 2021</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">running LAPW1 in parallel mode (using .machines)</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">2 number_of_parallel_jobs</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">[1] 14530</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">[e0467:14538] mca_base_component_repository_open: unable
to open mca_btl_uct: libucp.so.0: cannot open shared object file: No such file
or directory (ignored)</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">WARNING: There was an error initializing an OpenFabrics
device.</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)"> Local host: e0467</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)"> Local device:
mlx4_0</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">MPI_ABORT was invoked on rank 1 in communicator
MPI_COMM_WORLD</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">with errorcode 0.</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">NOTE: invoking MPI_ABORT causes Open MPI to kill all MPI
processes.</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">You may or may not see output from other processes,
depending on</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">exactly when Open MPI kills them.</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">--------------------------------------------------------------------------</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">[e0467:14567] 1 more process has sent help message
help-mpi-btl-openib.txt / error in device init</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">[e0467:14567] 1 more process has sent help message
help-mpi-btl-openib.txt / error in device init</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">[e0467:14567] Set MCA parameter
"orte_base_help_aggregate" to 0 to see all help / error messages</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">[warn] Epoll MOD(1) on fd 27 failed. Old events were 6; read change was 0 (none);
write change was 2 (del): Bad file descriptor</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">></span><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(192,0,0)">Somewhere there should be some
documentation how one runs an mpi job on<br>
your system.</span></p><p style="margin:0cm 0cm 0.0001pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;vertical-align:baseline;line-height:115%;font-size:12pt;font-family:"Times New Roman",serif"><span lang="EN-US" style="color:black">Only I found this: </span></p><p style="margin:0cm 0cm 0.0001pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;vertical-align:baseline;line-height:115%;font-size:12pt;font-family:"Times New Roman",serif"><span style="font-size:11.5pt;line-height:115%;font-family:Arial,sans-serif;color:rgb(51,51,51);border:1pt none windowtext;padding:0cm">Before
ordering a task, it should be encapsulated in an appropriate script
understandable for the queue system, e.g .:</span><span style="font-size:11.5pt;line-height:115%;font-family:Arial,sans-serif;color:rgb(51,51,51)"></span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background:rgb(234,240,255);vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:"Courier New";color:black;border:1pt none windowtext;padding:0cm">/home/users/user/<a href="http://submit_script.sl">submit_script.sl</a></span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:Arial,sans-serif;color:rgb(51,51,51);border:1pt none windowtext;padding:0cm">Sample SLURM script:</span><span style="font-size:11.5pt;font-family:Arial,sans-serif;color:rgb(51,51,51)"></span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background:rgb(234,240,255);vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:"Courier New";color:black;border:1pt none windowtext;padding:0cm">#! / bin / bash -l</span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background:rgb(234,240,255);vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:"Courier New";color:black;border:1pt none windowtext;padding:0cm">#SBATCH -N 1</span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background:rgb(234,240,255);vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:"Courier New";color:black;border:1pt none windowtext;padding:0cm">#SBATCH --mem 5000</span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background:rgb(234,240,255);vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:"Courier New";color:black;border:1pt none windowtext;padding:0cm">#SBATCH --time = 20:00:00</span><span style="font-size:11.5pt;font-family:"Courier New";color:black"></span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background:rgb(234,240,255);vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:"Courier New";color:black;border:1pt none windowtext;padding:0cm"> </span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background:rgb(234,240,255);vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:"Courier New";color:black;border:1pt none windowtext;padding:0cm">/sciezka/do/pliku/binarnego/<a href="http://plik_binarny.in">plik_binarny.in</a>>
/sciezka/do/pliku/wyjsciowego.out</span><span style="font-size:11.5pt;font-family:"Courier New";color:black"></span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:Arial,sans-serif;color:rgb(51,51,51);border:1pt none windowtext;padding:0cm">To order a task to a specific queue,
use the #SBATCH -p parameter, e.g.</span><span style="font-size:11.5pt;font-family:Arial,sans-serif;color:rgb(51,51,51)"></span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background:rgb(234,240,255);vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:"Courier New";color:black;border:1pt none windowtext;padding:0cm">#! / bin / bash -l</span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background:rgb(234,240,255);vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:"Courier New";color:black;border:1pt none windowtext;padding:0cm">#SBATCH -N 1</span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background:rgb(234,240,255);vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:"Courier New";color:black;border:1pt none windowtext;padding:0cm">#SBATCH --mem 5000</span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background:rgb(234,240,255);vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:"Courier New";color:black;border:1pt none windowtext;padding:0cm">#SBATCH --time = 20:00:00</span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background:rgb(234,240,255);vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:"Courier New";color:black;border:1pt none windowtext;padding:0cm">#SBATCH -p standard</span><span style="font-size:11.5pt;font-family:"Courier New";color:black"></span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background:rgb(234,240,255);vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:"Courier New";color:black;border:1pt none windowtext;padding:0cm"> </span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background:rgb(234,240,255);vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:"Courier New";color:black;border:1pt none windowtext;padding:0cm">/sciezka/do/pliku/binarnego/<a href="http://plik_binarny.in">plik_binarny.in</a>>
/siezka/do/pliku/wyjsciowego.out</span><span style="font-size:11.5pt;font-family:"Courier New";color:black"></span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:Arial,sans-serif;color:rgb(51,51,51);border:1pt none windowtext;padding:0cm">The task must then be ordered using
the <b>sbatch</b> command</span><span style="font-size:11.5pt;font-family:Arial,sans-serif;color:rgb(51,51,51)"></span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background:rgb(234,240,255);vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:"Courier New";color:black;border:1pt none windowtext;padding:0cm">sbatch /home/users/user/<a href="http://submit_script.sl">submit_script.sl</a></span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><b><span style="font-size:13.5pt;font-family:Corbel,sans-serif;color:rgb(51,51,51);border:1pt none windowtext;padding:0cm">Ordering interactive tasks</span></b><b><span style="font-size:14.5pt;font-family:Corbel,sans-serif;color:rgb(51,51,51)"></span></b></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:Arial,sans-serif;color:rgb(51,51,51)"><br>
<span style="border:1pt none windowtext;padding:0cm">Interactive tasks can be divided into two groups:</span></span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt 55.2pt;line-height:normal;vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:Symbol;color:rgb(51,51,51)">·<span style="font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:7pt;line-height:normal;font-family:"Times New Roman"">
</span></span><span dir="LTR"></span><span style="font-size:11.5pt;font-family:Arial,sans-serif;color:rgb(51,51,51);border:1pt none windowtext;padding:0cm">interactive task (working in text mode)</span><span style="font-size:11.5pt;font-family:Arial,sans-serif;color:rgb(51,51,51)"></span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt 55.2pt;line-height:normal;vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:10pt;font-family:Symbol;color:rgb(51,51,51)">·<span style="font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:7pt;line-height:normal;font-family:"Times New Roman"">
</span></span><span dir="LTR"></span><span style="font-size:11.5pt;font-family:Arial,sans-serif;color:rgb(51,51,51);border:1pt none windowtext;padding:0cm">interactive task</span><span style="font-size:11.5pt;font-family:Arial,sans-serif;color:rgb(51,51,51)"></span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><b><span style="font-size:12.5pt;font-family:Corbel,sans-serif;color:rgb(51,51,51);border:1pt none windowtext;padding:0cm">Interactive task (working in text mode)</span></b><b><span style="font-size:13pt;font-family:Corbel,sans-serif;color:rgb(51,51,51)"></span></b></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:Arial,sans-serif;color:rgb(51,51,51)"><br>
<span style="border:1pt none windowtext;padding:0cm">Ordering interactive tasks is very simple and in the simplest case
it comes down to issuing the command below.</span></span></p><p class="MsoNormal" style="margin:0cm 0cm 0.0001pt;line-height:normal;background:rgb(234,240,255);vertical-align:baseline;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:11.5pt;font-family:"Courier New";color:black;border:1pt none windowtext;padding:0cm">srun --pty / bin / bash</span><span style="font-size:11.5pt;font-family:"Courier New";color:black"></span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span lang="EN-US" style="font-size:12pt;font-family:"Times New Roman",serif;color:black"> </span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif">Sincerely
yours,</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif">
</p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif">Leila
Mollabashi</span></p></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Wed, Apr 14, 2021 at 12:03 AM leila mollabashi <<a href="mailto:le.mollabashi@gmail.com">le.mollabashi@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><div dir="ltr"><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif">Dear Prof.
Peter Blaha and WIEN2k users,</span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif">Thank you
for your assistances.</span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif">></span> <span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(192,80,77)">At least now the error: "lapw0 not found"
is gone. Do you understand why ??</span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif">Yes, I think
that because now the path is clearly known.</span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif">><span style="color:rgb(192,0,0)">How many slots do you get by this srun command ?</span></span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif">Usually I
went to node with 28 CPUs.</span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif">><span style="color:rgb(192,0,0)">Is this the node with the name e0591
???</span></span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif">Yes, it is.</span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif">><span style="color:rgb(192,0,0)">Of course the .machines file must be consistent (dynamically
adapted)</span></span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(192,0,0)">with the actual nodename.</span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif">Yes, to do
this I use my script.</span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif">>When I
use “<span style="color:rgb(31,73,125)">srun --pty -n 8 /bin/bash</span>”
that goes to the node with 8 free cores, and run x lapw0 –p then this happens:</span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">starting parallel lapw0 at Tue Apr 13 20:50:49 CEST 2021</span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">-------- .machine0 : 4 processors</span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">[1] 12852</span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">[e0467:12859] mca_base_component_repository_open: unable
to open mca_btl_uct: libucp.so.0: cannot open shared object file: No such file
or directory (ignored)</span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">[e0467][[56319,1],1][btl_openib_component.c:1699:init_one_device]
error obtaining device attributes for mlx4_0 errno says Protocol not supported</span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">[e0467:12859] mca_base_component_repository_open: unable
to open mca_pml_ucx: libucp.so.0: cannot open shared object file: No such file
or directory (ignored)</span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">LAPW0 END</span></p>
<p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif;color:rgb(31,73,125)">[1] Done mpirun -np 4
-machinefile .machine0 /home/users/mollabashi/v19.2/lapw0_mpi lapw0.def
>> .time00</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif">Sincerely
yours,</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif">Leila
Mollabashi</span></p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif">
</p><p class="MsoNormal" style="line-height:12.65pt;background-image:initial;background-position:initial;background-size:initial;background-repeat:initial;background-origin:initial;background-clip:initial;margin:0cm 0cm 10pt;font-size:11pt;font-family:Calibri,sans-serif"><span style="font-size:12pt;font-family:"Times New Roman",serif"> </span></p></div>
</blockquote></div>