<p>It is exactly what it says. You are trying to run more tasks on a single cpu than you have memory for. The idea of mpi is to share cpu and memory. If you have a cpu with 24 cores (unlikely) you might run (for instance) 3 tasks each using 8 cores, e.g. with three lines of node:8. </p>
<p>You probably only have 8 cores, so for a large job you might use node:8</p>
<p>Please do a little google searching on the principles of mpi, much better than any email response.</p>
<p>---------------------------<br>
Professor Laurence Marks<br>
Department of Materials Science and Engineering<br>
Northwestern University<br>
<a href="http://www.numis.northwestern.edu">www.numis.northwestern.edu</a> 1-847-491-3996<br>
"Research is to see what everybody else has seen, and to think what nobody else has thought"<br>
Albert Szent-Gyorgi<br>
</p>
<div class="gmail_quote">On Apr 14, 2012 7:49 PM, "hyunjung kim" <<a href="mailto:angpangmokjang@hanmail.net">angpangmokjang@hanmail.net</a>> wrote:<br type="attribution"><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div style="word-wrap:break-word">Dear all,<div></div></div><br><div style="word-wrap:break-word"><div></div><div>(I'm sorry, I forgot to attach file which including error message and job script files)</div><div><br></div>
<div>I constantly got following error messages when the parallel job was submitted.</div><div><br></div><div>I attach it.</div><div>Also the generated .machines file is attached, please check whether it is properly generated or not. I intended to do 24 k-point parallelized job.</div>
<div><br></div><div>The compiler version is </div><div>fortran : ifort, 12.0 (2011.3.174), mpif90 [ I got same error message within ifort 11.1 version, so I guess that fortran version is not the origin of this problem..]</div>
<div>openmpi : 1.4.5</div><div>FFTW2 : 2.1.5</div><div>CC : icc, 12.0 (2011.3.174)</div><div>compiler option</div><div><div> O Compiler options: -FR -mp1 -w -prec_div -pc80 -pad -ip -DINTEL_VML -mcmodel=medium -i-dynamic -traceback -I$(MKLROOT)/include</div>
<div> L Linker Flags: $(FOPT) -L$(MKLROOT)/lib/$(MKL_TARGET_ARCH) -pthread</div><div> P Preprocessor flags '-DParallel'</div><div> R R_LIB (LAPACK+BLAS): -lmkl_lapack95_lp64 -lmkl_intel_lp64 -lmkl_intel_thread -lmkl_core -openmp -lpthread</div>
</div><div><br></div><div><div> RP RP_LIB(SCALAPACK+PBLAS): -lmkl_scalapack_lp64 -lmkl_solver_lp64 -lmkl_blacs_lp64 -L$(FFTWPATH)/lib -lfftw_mpi -lfftw $(R_LIBS)</div><div> FP FPOPT(par.comp.options): -FR -mp1 -w -prec_div -pc80 -pad -ip -DINTEL_VML -mcmodel=medium -i-dynamic -traceback -I$(MKLROOT)/include</div>
<div> MP MPIRUN commando : mpirun -mca btl self,openib -mca plm_rsh_num_concurrent 400 -mca oob_tcp_listen_mode listen_thread -mca plm_rsh_tree_spawn 1 -np _NP_ -machinefile _HOSTS_ _EXEC_</div><div><br></div></div>
<div><br></div><div>The error messages is:</div><div><div>~~~~~~~~~~ <span style="font-family:'Lucida Grande';font-size:12px">abbreviation ~~~~~</span></div><div> LAPW0 END </div><div> LAPW0 END </div>
<div> LAPW0 END </div><div> LAPW0 END </div><div> LAPW0 END</div><div> LAPW0 END </div><div> LAPW0 END</div><div> LAPW0 END</div><div> LAPW0 END</div><div> LAPW0 END</div><div> LAPW0 END</div><div>
LAPW0 END</div><div> LAPW1 END </div><div> LAPW1 END </div><div> LAPW1 END </div><div> LAPW1 END </div><div> LAPW1 END</div><div> LAPW1 END </div><div> LAPW1 END</div><div> LAPW1 END</div>
<div> LAPW1 END</div><div> LAPW1 END</div><div> LAPW1 END</div><div> LAPW1 END</div><div> LAPW1 END </div><div> LAPW1 END </div><div> LAPW1 END </div><div> LAPW1 END </div><div> LAPW1 END</div>
<div> LAPW1 END </div><div> LAPW1 END</div><div> LAPW1 END</div><div> LAPW1 END</div><div> LAPW1 END</div><div> LAPW1 END</div><div> LAPW1 END</div><div>forrtl: severe (41): insufficient virtual memory</div><div>Image PC Routine Line Source</div>
<div>libintlc.so.5 00002B0540E88F7A Unknown Unknown Unknown</div><div>libintlc.so.5 00002B0540E87AF5 Unknown Unknown Unknown</div><div>libifcoremt.so.5 00002B0540058CF2 Unknown Unknown Unknown</div>
<div>libifcoremt.so.5 00002B053FFCAAAB Unknown Unknown Unknown</div><div>libifcoremt.so.5 00002B054001AFBA Unknown Unknown Unknown</div><div>libifcoremt.so.5 00002B054001AE11 Unknown Unknown Unknown</div>
<div>lapwso 00000000004281C0 MAIN__ 131 lapwso.f</div><div>lapwso 0000000000402A9C Unknown Unknown Unknown</div><div>libc.so.6 0000003CFA61D974 Unknown Unknown Unknown</div>
<div>lapwso 00000000004029A9 Unknown Unknown Unknown</div><div>forrtl: severe (41): insufficient virtual memory</div><div>Image PC Routine Line Source</div>
<div>libintlc.so.5 00002B5D32256F7A Unknown Unknown Unknown</div><div>libintlc.so.5 00002B5D32255AF5 Unknown Unknown Unknown</div><div>libifcoremt.so.5 00002B5D31426CF2 Unknown Unknown Unknown</div>
<div>libifcoremt.so.5 00002B5D31398AAB Unknown Unknown Unknown</div><div>libifcoremt.so.5 00002B5D313E8FBA Unknown Unknown Unknown</div><div>libifcoremt.so.5 00002B5D313E8E11 Unknown Unknown Unknown</div>
<div>lapwso 0000000000409A6A hmsout_mp_init_hm 78 modules.f</div><div>lapwso 00000000004280E2 MAIN__ 130 lapwso.f</div><div>lapwso 0000000000402A9C Unknown Unknown Unknown</div>
<div>libc.so.6 0000003CFA61D974 Unknown Unknown Unknown</div></div><div>~~~~~~ <span style="font-family:'Lucida Grande';font-size:12px">abbreviation ~~~~~~</span></div><div><br></div><div>
I note that the compilation was done without any error messages. </div><div><br></div><div>Any advice will be greatly appreciated!</div><div><br></div><div>
<span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:-webkit-auto;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:Courier;word-spacing:0px"><span style="text-indent:0px;letter-spacing:normal;font-variant:normal;text-align:-webkit-auto;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:Courier;word-spacing:0px"><div style="word-wrap:break-word">
<span style="text-indent:0px;letter-spacing:normal;font-variant:normal;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:Courier;word-spacing:0px"><div style="word-wrap:break-word">
<span style="text-indent:0px;letter-spacing:normal;font-variant:normal;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:Courier;word-spacing:0px"><div style="word-wrap:break-word">
<span style="text-indent:0px;letter-spacing:normal;font-variant:normal;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:Courier;word-spacing:0px"><div style="word-wrap:break-word">
<span style="text-indent:0px;letter-spacing:normal;font-variant:normal;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:Courier;word-spacing:0px"><div style="word-wrap:break-word">
<span style="text-indent:0px;letter-spacing:normal;font-variant:normal;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:Courier;word-spacing:0px"><div style="word-wrap:break-word">
<span style="text-indent:0px;letter-spacing:normal;font-variant:normal;font-style:normal;font-weight:normal;line-height:normal;border-collapse:separate;text-transform:none;font-size:medium;white-space:normal;font-family:Courier;word-spacing:0px"><div style="word-wrap:break-word">
<div><div>------------------------------------------------------------------------</div><div>Hyun-Jung Kim (Ph.D student)<span style="white-space:pre-wrap"> </span>| phone : ++82 10 7335 7889</div><div>Department of Physics<span style="white-space:pre-wrap"> </span>| </div>
<div>Hanyang University<span style="white-space:pre-wrap"> </span><span style="white-space:pre-wrap"> </span>| e-mail: <a href="mailto:hyunjung@fhi-berlin.mpg.de" target="_blank">angpangmokjang@h</a><a href="http://anmail.net" target="_blank">anmail.net</a> </div>
<div>17 Haengdang-Dong<span style="white-space:pre-wrap"> </span>| </div><div>133-791 Seongdong-Ku,Seoul/Korea|</div><div>------------------------------------------------------------------------</div><div><span style="white-space:pre-wrap"> </span> www: <a href="http://physics.hanyang.ac.kr/~sst/" target="_blank">http://physics.hanyang.ac.kr/~sst/</a></div>
<div>------------------------------------------------------------------------</div></div><div><br></div></div></span><br></div></span><br></div></span><br></div></span><br></div></span><br></div></span><br></div></span><br>
</span><br>
</div>
<br></div><br>_______________________________________________<br>
Wien mailing list<br>
<a href="mailto:Wien@zeus.theochem.tuwien.ac.at">Wien@zeus.theochem.tuwien.ac.at</a><br>
<a href="http://zeus.theochem.tuwien.ac.at/mailman/listinfo/wien" target="_blank">http://zeus.theochem.tuwien.ac.at/mailman/listinfo/wien</a><br>
<br></blockquote></div>