[Wien] Large memory consumption of MPI k-point parallel version

Oleg Rubel rubel at physik.uni-marburg.de
Tue Apr 8 19:31:55 CEST 2008


On Mon, 7 Apr 2008, Peter Blaha wrote:
> The program does of course NOT use more memory.
>
> My guess is that your queuing system limits the memory used by
> ALL !! processes spanned by this job.
>
> And of course, when 1 k-point needs 3 GB, 4 k-parallel jobs need in
> total 14 GB (distributed on 16 instead of just 4 nodes).

Below is the memory report for each process in the case of the job with 4 
and 4x4 processes. In the case of 16 processes, the master node really 
takes more than 9 GB of memory.

     marc-hn:/home/ag_hlo/acct/user/rubel/2008/04/04> grep "Max. VMem" 1513186*
     1513186-0:   Max. VMem (Bytes): 2904838144
     1513186-1:   Max. VMem (Bytes): 2906505216
     1513186-2:   Max. VMem (Bytes): 2832220160
     1513186-3:   Max. VMem (Bytes): 2982559744

     marc-hn:/home/ag_hlo/acct/user/rubel/2008/04/06> grep "Max. VMem" 1517148*
     1517148-0:   Max. VMem (Bytes): 1001832448
     1517148-1:   Max. VMem (Bytes): 1248092160
     1517148-10:   Max. VMem (Bytes): 1329168384
     1517148-11:   Max. VMem (Bytes): 1329176576
     1517148-12:   Max. VMem (Bytes): 1329172480
     1517148-13:   Max. VMem (Bytes): 1329176576
     1517148-14:   Max. VMem (Bytes): 1329176576
     1517148-15:   Max. VMem (Bytes): 2791628800
     1517148-16:   Max. VMem (Bytes): 1947533312
     1517148-17:   Max. VMem (Bytes): 1971404800
     1517148-18:   Max. VMem (Bytes): 1973506048
     1517148-19:   Max. VMem (Bytes): 2837716992
     1517148-2:   Max. VMem (Bytes): 1329172480
     1517148-20:   Max. VMem (Bytes): 1947533312
     1517148-21:   Max. VMem (Bytes): 1967624192
     1517148-22:   Max. VMem (Bytes): 1966006272
     1517148-23:   Max. VMem (Bytes): 2861715456
     1517148-24:   Max. VMem (Bytes): 2792050688
     1517148-25:   Max. VMem (Bytes): 2847371264
     1517148-26:   Max. VMem (Bytes): 2852257792
     1517148-27:   Max. VMem (Bytes): 9712762880
     1517148-3:   Max. VMem (Bytes): 1329172480
     1517148-4:   Max. VMem (Bytes): 1329176576
     1517148-5:   Max. VMem (Bytes): 1329172480
     1517148-6:   Max. VMem (Bytes): 1329172480
     1517148-7:   Max. VMem (Bytes): 1329168384
     1517148-8:   Max. VMem (Bytes): 1289355264
     1517148-9:   Max. VMem (Bytes): 1289351168

Oleg Rubel


More information about the Wien mailing list