[Wien] Large memory consumption of MPI k-point parallel version

Robert Laskowski rolask at theochem.tuwien.ac.at
Tue Apr 8 21:03:08 CEST 2008


could you:   grep allocate  *.output1_1* 
or send struct and in1.

regards

Robert

It should tell you what was allocated

On Tuesday 08 April 2008, Oleg Rubel wrote:
> On Mon, 7 Apr 2008, Peter Blaha wrote:
> > The program does of course NOT use more memory.
> >
> > My guess is that your queuing system limits the memory used by
> > ALL !! processes spanned by this job.
> >
> > And of course, when 1 k-point needs 3 GB, 4 k-parallel jobs need in
> > total 14 GB (distributed on 16 instead of just 4 nodes).
> 
> Below is the memory report for each process in the case of the job with 4 
> and 4x4 processes. In the case of 16 processes, the master node really 
> takes more than 9 GB of memory.
> 
>      marc-hn:/home/ag_hlo/acct/user/rubel/2008/04/04> grep "Max. VMem" 1513186*
>      1513186-0:   Max. VMem (Bytes): 2904838144
>      1513186-1:   Max. VMem (Bytes): 2906505216
>      1513186-2:   Max. VMem (Bytes): 2832220160
>      1513186-3:   Max. VMem (Bytes): 2982559744
> 
>      marc-hn:/home/ag_hlo/acct/user/rubel/2008/04/06> grep "Max. VMem" 1517148*
>      1517148-0:   Max. VMem (Bytes): 1001832448
>      1517148-1:   Max. VMem (Bytes): 1248092160
>      1517148-10:   Max. VMem (Bytes): 1329168384
>      1517148-11:   Max. VMem (Bytes): 1329176576
>      1517148-12:   Max. VMem (Bytes): 1329172480
>      1517148-13:   Max. VMem (Bytes): 1329176576
>      1517148-14:   Max. VMem (Bytes): 1329176576
>      1517148-15:   Max. VMem (Bytes): 2791628800
>      1517148-16:   Max. VMem (Bytes): 1947533312
>      1517148-17:   Max. VMem (Bytes): 1971404800
>      1517148-18:   Max. VMem (Bytes): 1973506048
>      1517148-19:   Max. VMem (Bytes): 2837716992
>      1517148-2:   Max. VMem (Bytes): 1329172480
>      1517148-20:   Max. VMem (Bytes): 1947533312
>      1517148-21:   Max. VMem (Bytes): 1967624192
>      1517148-22:   Max. VMem (Bytes): 1966006272
>      1517148-23:   Max. VMem (Bytes): 2861715456
>      1517148-24:   Max. VMem (Bytes): 2792050688
>      1517148-25:   Max. VMem (Bytes): 2847371264
>      1517148-26:   Max. VMem (Bytes): 2852257792
>      1517148-27:   Max. VMem (Bytes): 9712762880
>      1517148-3:   Max. VMem (Bytes): 1329172480
>      1517148-4:   Max. VMem (Bytes): 1329176576
>      1517148-5:   Max. VMem (Bytes): 1329172480
>      1517148-6:   Max. VMem (Bytes): 1329172480
>      1517148-7:   Max. VMem (Bytes): 1329168384
>      1517148-8:   Max. VMem (Bytes): 1289355264
>      1517148-9:   Max. VMem (Bytes): 1289351168
> 
> Oleg Rubel
> _______________________________________________
> Wien mailing list
> Wien at zeus.theochem.tuwien.ac.at
> http://zeus.theochem.tuwien.ac.at/mailman/listinfo/wien
> 



-- 
Dr Robert Laskowski

Vienna University of Technology, 
Institute of Materials Chemistry, 
Getreidemarkt 9/165-TC, A-1060 Vienna

tel. +43 1 58801 15686
Fax  +43 1 58801 15698


More information about the Wien mailing list