Reading input file....
Matrix is Float
Matrix is symmetric
Total number of nonzeros expected across all processors is 232232816
File is 4735690648 bytes
Total number of entries read across all processors is 232232816
Reader took 37.2402 seconds
Generating random permutation vector.
Permutation took 61.0917 seconds
Load balance: 1.00038
Matrices read and replicated along layers : time 98.6003
As a whole: 16240000 rows and 344532 columns and 9420832 nonzeros
Restriction Op computed : time 28.1459
Matrix split and distributed along layers: time 0.633182 seconds
Matrix split and distributed along layers: time 0.608419 seconds
Matrix split and distributed along layers: time 0.00424719 seconds
Matrix split and distributed along layers: time 0.0145769 seconds
[NID 05521] 2015-08-17 18:10:43 Apid 14779905: initiated application termination
[NID 05521] 2015-08-17 18:10:45 Apid 14779905: OOM killer terminated this process.
Application 14779905 exit signals: Killed
Application 14779905 resources: utime ~0s, stime ~1s, Rss ~5796, inblocks ~22539, outblocks ~59276
Reading input file....
Matrix is Float
Matrix is symmetric
Total number of nonzeros expected across all processors is 232232816
File is 4735690648 bytes
Total number of entries read across all processors is 232232816
Reader took 41.7986 seconds
Generating random permutation vector.
Permutation took 79.1101 seconds
Load balance: 1.00025
Matrices read and replicated along layers : time 121.064
As a whole: 16240000 rows and 344383 columns and 9417147 nonzeros
Restriction Op computed : time 38.7344
Matrix split and distributed along layers: time 12.3785 seconds
Matrix split and distributed along layers: time 1.2682 seconds
Matrix split and distributed along layers: time 0.196948 seconds
Matrix split and distributed along layers: time 0.0161068 seconds
[NID 05521] 2015-08-17 18:13:56 Apid 14779981: initiated application termination
[NID 05521] 2015-08-17 18:13:58 Apid 14779981: OOM killer terminated this process.
Application 14779981 exit signals: Killed
Application 14779981 resources: utime ~0s, stime ~1s, Rss ~5796, inblocks ~22553, outblocks ~59276
Reading input file....
Matrix is Float
Matrix is symmetric
Total number of nonzeros expected across all processors is 232232816
File is 4735690648 bytes
Total number of entries read across all processors is 232232816
Reader took 100.601 seconds
Generating random permutation vector.
Permutation took 147.47 seconds
Load balance: 1.00006
Matrices read and replicated along layers : time 248.195
As a whole: 16240000 rows and 344355 columns and 9418260 nonzeros
Restriction Op computed : time 143.262
Matrix split and distributed along layers: time 42.5986 seconds
Matrix split and distributed along layers: time 5.62388 seconds
Matrix split and distributed along layers: time 0.680287 seconds
Matrix split and distributed along layers: time 0.105656 seconds
[NID 05521] 2015-08-17 18:21:44 Apid 14780056: initiated application termination
[NID 05521] 2015-08-17 18:21:47 Apid 14780056: OOM killer terminated this process.
Application 14780056 exit signals: Killed
Application 14780056 resources: utime ~0s, stime ~1s, Rss ~5792, inblocks ~11277, outblocks ~29638
Reading input file....
Matrix is Float
Matrix is symmetric
Total number of nonzeros expected across all processors is 232232816
File is 4735690648 bytes
Total number of entries read across all processors is 232232816
Reader took 99.8238 seconds
Generating random permutation vector.
Permutation took 143.325 seconds
Load balance: 1.00004
Matrices read and replicated along layers : time 243.149
As a whole: 16240000 rows and 344290 columns and 9415603 nonzeros
Restriction Op computed : time 141.298
Matrix split and distributed along layers: time 38.4565 seconds
Matrix split and distributed along layers: time 5.496 seconds
Matrix split and distributed along layers: time 0.628225 seconds
Matrix split and distributed along layers: time 0.113059 seconds
[NID 05521] 2015-08-17 18:29:21 Apid 14780152: initiated application termination
[NID 05521] 2015-08-17 18:29:24 Apid 14780152: OOM killer terminated this process.
Application 14780152 exit signals: Killed
Application 14780152 resources: utime ~0s, stime ~1s, Rss ~5796, inblocks ~22553, outblocks ~59276
Reading input file....
Matrix is Float
Matrix is symmetric
Total number of nonzeros expected across all processors is 232232816
File is 4735690648 bytes
Total number of entries read across all processors is 232232816
Reader took 302.436 seconds
Generating random permutation vector.
aprun: Apid 14780260: Caught signal Terminated, sending to application
=>> PBS: job killed: walltime 1836 exceeded limit 1800
aprun: Apid 14780260: Caught signal Terminated, sending to application
_pmiu_daemon(SIGCHLD): [NID 05521] [c4-3c2s4n1] [Mon Aug 17 18:38:48 2015] PE RANK 1 exit signal Terminated
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
aprun: Apid 14780260: Caught signal Terminated, sending to application
Application 14780260 exit codes: 143
Application 14780260 resources: utime ~539s, stime ~20s, Rss ~5792, inblocks ~11346, outblocks ~29638

 + --------------------------------------------------------------------------
 +        Job name: Rop_nlpkkt200_32
 +          Job Id: 3437813.edique02
 +          System: edison
 +     Queued Time: Mon Aug 17 16:53:24 2015
 +      Start Time: Mon Aug 17 18:08:15 2015
 + Completion Time: Mon Aug 17 18:38:50 2015
 +            User: azad
 +        MOM Host: nid00899
 +           Queue: debug
 +  Req. Resources: mppnodect=2,mppnppn=24,mppwidth=32,walltime=00:30:00
 +  Used Resources: cput=00:00:01,energy_used=0,mem=10808kb,vmem=159764kb,walltime=00:30:36
 +     Acct String: m1982
 +   PBS_O_WORKDIR: /global/u1/a/azad/combinatorial-blas-2.0/CombBLAS/3DSpGEMM/edison_exp/nlpkkt200
 +     Submit Args: batchRop_nlpkkt200_32
 + --------------------------------------------------------------------------

