[Wien] Large memory consumption of MPI k-point parallel version
Oleg Rubel
rubel at physik.uni-marburg.de
Tue Apr 8 19:31:55 CEST 2008
On Mon, 7 Apr 2008, Peter Blaha wrote:
> The program does of course NOT use more memory.
>
> My guess is that your queuing system limits the memory used by
> ALL !! processes spanned by this job.
>
> And of course, when 1 k-point needs 3 GB, 4 k-parallel jobs need in
> total 14 GB (distributed on 16 instead of just 4 nodes).
Below is the memory report for each process in the case of the job with 4
and 4x4 processes. In the case of 16 processes, the master node really
takes more than 9 GB of memory.
marc-hn:/home/ag_hlo/acct/user/rubel/2008/04/04> grep "Max. VMem" 1513186*
1513186-0: Max. VMem (Bytes): 2904838144
1513186-1: Max. VMem (Bytes): 2906505216
1513186-2: Max. VMem (Bytes): 2832220160
1513186-3: Max. VMem (Bytes): 2982559744
marc-hn:/home/ag_hlo/acct/user/rubel/2008/04/06> grep "Max. VMem" 1517148*
1517148-0: Max. VMem (Bytes): 1001832448
1517148-1: Max. VMem (Bytes): 1248092160
1517148-10: Max. VMem (Bytes): 1329168384
1517148-11: Max. VMem (Bytes): 1329176576
1517148-12: Max. VMem (Bytes): 1329172480
1517148-13: Max. VMem (Bytes): 1329176576
1517148-14: Max. VMem (Bytes): 1329176576
1517148-15: Max. VMem (Bytes): 2791628800
1517148-16: Max. VMem (Bytes): 1947533312
1517148-17: Max. VMem (Bytes): 1971404800
1517148-18: Max. VMem (Bytes): 1973506048
1517148-19: Max. VMem (Bytes): 2837716992
1517148-2: Max. VMem (Bytes): 1329172480
1517148-20: Max. VMem (Bytes): 1947533312
1517148-21: Max. VMem (Bytes): 1967624192
1517148-22: Max. VMem (Bytes): 1966006272
1517148-23: Max. VMem (Bytes): 2861715456
1517148-24: Max. VMem (Bytes): 2792050688
1517148-25: Max. VMem (Bytes): 2847371264
1517148-26: Max. VMem (Bytes): 2852257792
1517148-27: Max. VMem (Bytes): 9712762880
1517148-3: Max. VMem (Bytes): 1329172480
1517148-4: Max. VMem (Bytes): 1329176576
1517148-5: Max. VMem (Bytes): 1329172480
1517148-6: Max. VMem (Bytes): 1329172480
1517148-7: Max. VMem (Bytes): 1329168384
1517148-8: Max. VMem (Bytes): 1289355264
1517148-9: Max. VMem (Bytes): 1289351168
Oleg Rubel
More information about the Wien
mailing list