<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p>That might be an issue worth asking about over in the Spack
      Community [1].</p>
    <p><br>
    </p>
    <p>Not sure if I'm interpreting the message correctly, but if I am,
      the "@<font color="#0000ff">1.5.4</font>:<font color="#ff8000">2</font>"
      in the message from spack info I believe is indicating that
      thread_multiple will be disabled unless OpenMPI version <font
        color="#0000ff">1.5.4</font> [2] to <font color="#ff8000">2</font>
      [3] is being used.  <br>
    </p>
    <p><br>
    </p>
    <p>In the Spack source code of its current latest version 0.20.0
      [4], the openmpi/package.py file has on lines 662-668:</p>
    <p><br>
    </p>
    <p>         # thread_multiple<br>
                  if version in spack.version.ver("1.5.4:2"):<br>
                      match = re.search(r"MPI_THREAD_MULTIPLE:
      (\S+?),?", output)<br>
                      if match and is_enabled(match.group(1)):<br>
                          variants.append("+thread_multiple")<br>
                      else:<br>
                          variants.append("~thread_multiple")<br>
    </p>
    <p><br>
    </p>
    <p>Since you are using OpenMPI 4.1.5, I suspect line 663 might need
      changed for example to "if version in
      spack.version.ver("1.5.4:4.1.5"):".  Perhaps there are other
      changes a Spark developer would know about that might also be
      needed for the MPI_THREAD_MULTIPLE to work with Spack when using
      OpenMPI 4.1.5.<br>
    </p>
    <p><br>
    </p>
    <p>[1]
      <a class="moz-txt-link-freetext" href="https://github.com/spack/spack/blob/develop/README.md#community">https://github.com/spack/spack/blob/develop/README.md#community</a></p>
    <p>[2] <a class="moz-txt-link-freetext" href="https://www.open-mpi.org/software/ompi/v1.5/">https://www.open-mpi.org/software/ompi/v1.5/</a></p>
    <p>[3] <a class="moz-txt-link-freetext" href="https://www.open-mpi.org/software/ompi/v2.0/">https://www.open-mpi.org/software/ompi/v2.0/</a><br>
    </p>
    <p>[4]
<a class="moz-txt-link-freetext" href="https://github.com/spack/spack/blob/v0.20.0/var/spack/repos/builtin/packages/openmpi/package.py">https://github.com/spack/spack/blob/v0.20.0/var/spack/repos/builtin/packages/openmpi/package.py</a><br>
    </p>
    <p><br>
    </p>
    <p>Gavin</p>
    <p>WIEN2k user<br>
    </p>
    <p><br>
    </p>
    <div class="moz-cite-prefix">On 7/4/2023 11:59 AM, Ilias, Miroslav
      wrote:<br>
    </div>
    <blockquote type="cite"
      cite="mid:7c93531f432349f7bb066e4cdcec40bb@gsi.de">
      <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
      <style type="text/css" style="display:none;">P {margin-top:0;margin-bottom:0;}</style>
      <div id="divtagdefaultwrapper"
style="font-size:12pt;color:#000000;font-family:Calibri,Helvetica,sans-serif;"
        dir="ltr">
        <div id="divtagdefaultwrapper" style="font-size: 12pt; color:
          rgb(0, 0, 0); font-family: Calibri, Helvetica, sans-serif,
          "EmojiFont", "Apple Color Emoji",
          "Segoe UI Emoji", NotoColorEmoji, "Segoe UI
          Symbol", "Android Emoji", EmojiSymbols;"
          dir="ltr">
          <p dir="auto" data-sourcepos="3:1-3:73">Hello,</p>
          <p dir="auto" data-sourcepos="3:1-3:73"><br>
          </p>
          <p dir="auto" data-sourcepos="3:1-3:73">sorry for hidden link;</p>
          <p dir="auto" data-sourcepos="3:1-3:73"><br>
          </p>
          <p dir="auto" data-sourcepos="3:1-3:73">the point is that  the
            "<code>ompi_info -a | grep THREAD</code>" says
            <code>MPI_THREAD_MULTIPLE: yes</code>,</p>
          <p dir="auto" data-sourcepos="3:1-3:73"><br>
          </p>
          <p dir="auto" data-sourcepos="5:1-5:160">but  "spack info
            <a class="moz-txt-link-abbreviated" href="mailto:openmpi@4.1.5">openmpi@4.1.5</a>" gives "thread_multiple [off] [@1.5.4:2] on,
            off Enable MPI_THREAD_MULTIPLE support"
            <br>
          </p>
          <p dir="auto" data-sourcepos="5:1-5:160"><br>
          </p>
          <p dir="auto" data-sourcepos="7:1-7:219">Maybe this is the
            case of the ELPA  "WARNING elpa_setup: MPI threading level
            MPI_THREAD_SERALIZED or MPI_THREAD_MULTIPLE required but
            your implementation does not support this! The number of
            OpenMP threads within ELPA will be limited to 1"</p>
        </div>
        <div style="font-size: 12pt; color: rgb(0, 0, 0); font-family:
          Calibri, Helvetica, sans-serif, "EmojiFont",
          "Apple Color Emoji", "Segoe UI Emoji",
          NotoColorEmoji, "Segoe UI Symbol", "Android
          Emoji", EmojiSymbols;" dir="ltr">
          <br>
        </div>
        <div style="font-size: 12pt; color: rgb(0, 0, 0); font-family:
          Calibri, Helvetica, sans-serif, "EmojiFont",
          "Apple Color Emoji", "Segoe UI Emoji",
          NotoColorEmoji, "Segoe UI Symbol", "Android
          Emoji", EmojiSymbols;" dir="ltr">
          I will investigate it deeper, as I need Wien2k parallel as
          fast as possible.</div>
        <div style="font-size: 12pt; color: rgb(0, 0, 0); font-family:
          Calibri, Helvetica, sans-serif, "EmojiFont",
          "Apple Color Emoji", "Segoe UI Emoji",
          NotoColorEmoji, "Segoe UI Symbol", "Android
          Emoji", EmojiSymbols;" dir="ltr">
          <br>
        </div>
        <div style="font-size: 12pt; color: rgb(0, 0, 0); font-family:
          Calibri, Helvetica, sans-serif, "EmojiFont",
          "Apple Color Emoji", "Segoe UI Emoji",
          NotoColorEmoji, "Segoe UI Symbol", "Android
          Emoji", EmojiSymbols;" dir="ltr">
          Intel MPI will come later, again, I need ELPA built with
          Intel. I guess that IntelMPI+MKL  Wien2k is faster than
          OpenMPI+Openblas ?<br>
        </div>
        <div style="font-size: 12pt; color: rgb(0, 0, 0); font-family:
          Calibri, Helvetica, sans-serif, "EmojiFont",
          "Apple Color Emoji", "Segoe UI Emoji",
          NotoColorEmoji, "Segoe UI Symbol", "Android
          Emoji", EmojiSymbols;" dir="ltr">
          <br>
        </div>
        <div style="font-size: 12pt; color: rgb(0, 0, 0); font-family:
          Calibri, Helvetica, sans-serif, "EmojiFont",
          "Apple Color Emoji", "Segoe UI Emoji",
          NotoColorEmoji, "Segoe UI Symbol", "Android
          Emoji", EmojiSymbols;" dir="ltr">
          Best, Miro<br>
          <br>
          <div style="color: rgb(0, 0, 0);">
            <hr tabindex="-1" style="display:inline-block; width:98%">
            <div id="divRplyFwdMsg" dir="ltr"><font
                style="font-size:11pt" face="Calibri, sans-serif"
                color="#000000"><b>From:</b> Wien
                <a class="moz-txt-link-rfc2396E" href="mailto:wien-bounces@zeus.theochem.tuwien.ac.at"><wien-bounces@zeus.theochem.tuwien.ac.at></a> on
                behalf of Laurence Marks
                <a class="moz-txt-link-rfc2396E" href="mailto:laurence.marks@gmail.com"><laurence.marks@gmail.com></a><br>
                <b>Sent:</b> 04 July 2023 18:02<br>
                <b>To:</b> A Mailing list for WIEN2k users<br>
                <b>Subject:</b> Re: [Wien] WARNING elpa_setup during
                lapw1_mpi</font>
              <div> </div>
            </div>
            <div>
              <div dir="auto">
                <div>That is a private site, do I cannot read anything.</div>
                <div dir="auto"><br>
                </div>
                <div dir="auto">All I can suggest is doing a Google
                  search on "missing  MPI_THREAD_MULTIPLE". It looks as
                  if you have to enable this in openmpi configure,
                  although there might be some bugs. There could also be
                  some environmental parameters that need to be set.</div>
                <div dir="auto"><br>
                </div>
                <div dir="auto">Or use Intel mpi. While it does not have
                  everything that some sysadmin want, if you are using
                  mkl & ifort (both free) it integrates trivially. I
                  personally dislike openmpi as it keeps changing and is
                  not always user friendly.<br>
                  <br>
                  <div dir="auto">--<br>
                    Professor Laurence Marks (Laurie)<br>
                    Department of Materials Science and Engineering,
                    Northwestern University<br>
                    <a href="http://www.numis.northwestern.edu"
                      target="_blank" rel="noreferrer"
                      moz-do-not-send="true">www.numis.northwestern.edu</a><br>
                    "Research is to see what everybody else has seen,
                    and to think what nobody else has thought" Albert
                    Szent-Györgyi</div>
                  <br>
                  <div class="gmail_quote" dir="auto">
                    <div dir="ltr" class="gmail_attr">On Tue, Jul 4,
                      2023, 09:33 Ilias, Miroslav <<a
                        href="mailto:M.Ilias@gsi.de" target="_blank"
                        rel="noreferrer" moz-do-not-send="true"
                        class="moz-txt-link-freetext">M.Ilias@gsi.de</a>>
                      wrote:<br>
                    </div>
                    <blockquote class="gmail_quote" style="margin:0 0 0
                      .8ex; border-left:1px #ccc solid;
                      padding-left:1ex">
                      <div dir="ltr">
                        <div
                          id="m_-6053432425532823087m_1484977026330047087divtagdefaultwrapper"
                          dir="ltr" style="font-size:12pt;
                          color:rgb(0,0,0);
font-family:Calibri,Helvetica,sans-serif,"EmojiFont","Apple
                          Color Emoji","Segoe UI
                          Emoji",NotoColorEmoji,"Segoe UI
                          Symbol","Android
                          Emoji",EmojiSymbols">
                          <p>Dear Professor Marks,</p>
                          <p><br>
                          </p>
                          <p>concerning <a
href="https://www.mail-archive.com/wien@zeus.theochem.tuwien.ac.at/msg22621.html"
                              rel="noreferrer noreferrer"
                              target="_blank" moz-do-not-send="true"
                              class="moz-txt-link-freetext">
https://www.mail-archive.com/wien@zeus.theochem.tuwien.ac.at/msg22621.html</a>  :   
                            <br>
                          </p>
                          <p><br>
                          </p>
                          <p>I am trying to find out why is ELPA module
                            complaining of missing  <span
                              style="font-family:monospace"><span
                                style="color:#000000;
                                background-color:#ffffff">MPI_THREAD_MULTIPLE</span>
                              .</span></p>
                          <p><span style="font-family:monospace"><br>
                            </span></p>
                          <p><span style="font-family:monospace">We have
                              a debate on this  <span
                                style="font-family:monospace">
                                <a
                                  href="https://git.gsi.de/SDEGroup/SIR/-/issues/85#note_55392"
                                  rel="noreferrer noreferrer"
                                  target="_blank" moz-do-not-send="true"
                                  class="moz-txt-link-freetext">https://git.gsi.de/SDEGroup/SIR/-/issues/85#note_55392</a></span></span></p>
                          <p><span style="font-family:monospace"><span
                                style="font-family:monospace"><br>
                              </span></span></p>
                          <p><span style="font-family:monospace"><span
                                style="font-family:monospace">If you
                                somebody could comment on this topic as
                                I would like to investigate deeply. Can
                                somebody advice me a short ELPA testing
                                program for this ?</span></span></p>
                          <p><span style="font-family:monospace"><span
                                style="font-family:monospace"><br>
                              </span></span></p>
                          <p><span style="font-family:monospace"><span
                                style="font-family:monospace">Best, Miro<br>
                              </span></span></p>
                          <p><span style="font-family:monospace"><br>
                            </span></p>
                          <p><span style="font-family:monospace"><br>
                            </span></p>
                          <p><span style="font-family:monospace"><br>
                            </span> <br>
                          </p>
                          <p><br>
                          </p>
                          <p><br>
                          </p>
                          <p><br>
                          </p>
                        </div>
                      </div>
                      _______________________________________________<br>
                      Wien mailing list<br>
                      <a href="mailto:Wien@zeus.theochem.tuwien.ac.at"
                        rel="noreferrer noreferrer" target="_blank"
                        moz-do-not-send="true"
                        class="moz-txt-link-freetext">Wien@zeus.theochem.tuwien.ac.at</a><br>
                      <a
                        href="http://zeus.theochem.tuwien.ac.at/mailman/listinfo/wien"
                        rel="noreferrer noreferrer noreferrer"
                        target="_blank" moz-do-not-send="true"
                        class="moz-txt-link-freetext">http://zeus.theochem.tuwien.ac.at/mailman/listinfo/wien</a><br>
                      SEARCH the MAILING-LIST at:  <a
href="http://www.mail-archive.com/wien@zeus.theochem.tuwien.ac.at/index.html"
                        rel="noreferrer noreferrer noreferrer"
                        target="_blank" moz-do-not-send="true"
                        class="moz-txt-link-freetext">
http://www.mail-archive.com/wien@zeus.theochem.tuwien.ac.at/index.html</a><br>
                    </blockquote>
                  </div>
                </div>
              </div>
            </div>
          </div>
        </div>
      </div>
      <br>
      <fieldset class="moz-mime-attachment-header"></fieldset>
      <pre class="moz-quote-pre" wrap="">_______________________________________________
Wien mailing list
<a class="moz-txt-link-abbreviated" href="mailto:Wien@zeus.theochem.tuwien.ac.at">Wien@zeus.theochem.tuwien.ac.at</a>
<a class="moz-txt-link-freetext" href="http://zeus.theochem.tuwien.ac.at/mailman/listinfo/wien">http://zeus.theochem.tuwien.ac.at/mailman/listinfo/wien</a>
SEARCH the MAILING-LIST at:  <a class="moz-txt-link-freetext" href="http://www.mail-archive.com/wien@zeus.theochem.tuwien.ac.at/index.html">http://www.mail-archive.com/wien@zeus.theochem.tuwien.ac.at/index.html</a>
</pre>
    </blockquote>
  </body>
</html>