Reading input file....
Matrix is Float
Total number of nonzeros expected across all processors is 473712505
File is 19662469672 bytes
Total number of entries read across all processors is 473712505
As a whole: 17598889 rows and 17598889 columns and 473712505 nonzeros
Reader took 87.7753 seconds
Generating random permutation vector.
Perfoming random permuation of matrix.
Permutation took 29.7598 seconds
Input load balance: 1.56565
Input matrix read : time 117.535
Computing restriction matrix 
As a whole: 17598889 rows and 17598889 columns and 456113616 nonzeros
As a whole, mis2 has: 367306 nonzeros and length 17598889
Creating a new MPI data type for 10VertexTypeIlE
As a whole, mis2neighUnion has: 17598889 nonzeros and length 17598889
Rop final (before normalization)... As a whole: 17598889 rows and 367306 columns and 17598889 nonzeros
Load balance (before): 1.31838
Load balance (after): 1.01438
Restriction Op computed : time 6.0301
Matrix split and distributed along layers: time 0.081358 seconds
Matrix split and distributed along layers: time 0.0507739 seconds
Matrix split and distributed along layers: time 0.000846863 seconds
Matrix split and distributed along layers: time 0.00134802 seconds

 Processor Grid (row x col x layers x threads): 16x16x1x1 
 prow pcol layer thread comm_bcast   comm_scatter comp_summa comp_merge  comp_scatter  comp_result     other      total
Computing A square
  16   16     1      1  11.597187     0.000000    21.490610   3.773317     0.000000     0.141946     0.387196  37.390256
  16   16     1      1  11.078166     0.000000    21.523165   3.788395     0.000000     0.142028     0.394176  36.925930
Computing RTA
  16   16     1      1   6.107763     0.000000     4.448930   0.115006     0.000000     0.005838     0.184965  10.862502
  16   16     1      1   6.086473     0.000000     4.450482   0.115692     0.000000     0.005804     0.159844  10.818296
Computing RTAR
  16   16     1      1   0.490454     0.000000     0.623918   0.026861     0.000000     0.000416     0.000905   1.142554
  16   16     1      1   0.250163     0.000000     0.628779   0.026945     0.000000     0.000413     0.000722   0.907023
----------------------------
 nnz(A)= 473712505
 nnz(R)= 17598889
 nnz(A^2)= 2187662967
 nnz(RTA)= 77218191
 nnz(RTAR)= 6673528
----------------------------
Application 15461404 resources: utime ~38782s, stime ~2443s, Rss ~1854928, inblocks ~39769015, outblocks ~330596
Reading input file....
Matrix is Float
Total number of nonzeros expected across all processors is 473712505
File is 19662469672 bytes
Total number of entries read across all processors is 473712505
As a whole: 17598889 rows and 17598889 columns and 473712505 nonzeros
Reader took 52.5954 seconds
Generating random permutation vector.
Perfoming random permuation of matrix.
Permutation took 31.4076 seconds
Input load balance: 1.37214
Input matrix read : time 84.0032
Computing restriction matrix 
As a whole: 17598889 rows and 17598889 columns and 456113616 nonzeros
As a whole, mis2 has: 367678 nonzeros and length 17598889
Creating a new MPI data type for 10VertexTypeIlE
As a whole, mis2neighUnion has: 17598889 nonzeros and length 17598889
Rop final (before normalization)... As a whole: 17598889 rows and 367678 columns and 17598889 nonzeros
Load balance (before): 1.21209
Load balance (after): 1.00678
Restriction Op computed : time 8.43152
Matrix split and distributed along layers: time 1.59957 seconds
Matrix split and distributed along layers: time 0.219394 seconds
Matrix split and distributed along layers: time 0.029644 seconds
Matrix split and distributed along layers: time 0.00432086 seconds

 Processor Grid (row x col x layers x threads): 11x11x2x1 
 prow pcol layer thread comm_bcast   comm_scatter comp_summa comp_merge  comp_scatter  comp_result     other      total
Computing A square
  11   11     2      1   6.255884     0.325947    16.823391   4.178694     0.799659     0.138970     0.828763  29.351308
  11   11     2      1   5.708096     0.329215    16.885667   4.181399     0.806505     0.139006     0.870203  28.920091
Computing RTA
  11   11     2      1   4.562184     0.011770     3.525211   0.107986     0.026586     0.008925     0.030444   8.273106
  11   11     2      1   4.505941     0.010821     3.514803   0.108941     0.025726     0.008317     0.038674   8.213223
Computing RTAR
  11   11     2      1   0.263068     0.004653     0.492772   0.027058     0.009568     0.001361     0.002591   0.801071
  11   11     2      1   0.166890     0.003177     0.516582   0.027547     0.009115     0.001502     0.001604   0.726417
----------------------------
 nnz(A)= 473712505
 nnz(R)= 17598889
 nnz(A^2)= 2187662967
 nnz(RTA)= 77241461
 nnz(RTAR)= 44818110
----------------------------
Application 15461431 resources: utime ~35319s, stime ~1977s, Rss ~2573060, inblocks ~39028200, outblocks ~328356
Reading input file....
Matrix is Float
Total number of nonzeros expected across all processors is 473712505
File is 19662469672 bytes
Total number of entries read across all processors is 473712505
As a whole: 17598889 rows and 17598889 columns and 473712505 nonzeros
Reader took 51.8068 seconds
Generating random permutation vector.
Perfoming random permuation of matrix.
Permutation took 34.5433 seconds
Input load balance: 1.26227
Input matrix read : time 86.393
Computing restriction matrix 
As a whole: 17598889 rows and 17598889 columns and 456113616 nonzeros
As a whole, mis2 has: 367383 nonzeros and length 17598889
Creating a new MPI data type for 10VertexTypeIlE
As a whole, mis2neighUnion has: 17598889 nonzeros and length 17598889
Rop final (before normalization)... As a whole: 17598889 rows and 367383 columns and 17598889 nonzeros
Load balance (before): 1.14856
Load balance (after): 1.00455
Restriction Op computed : time 14.0578
Matrix split and distributed along layers: time 2.34511 seconds
Matrix split and distributed along layers: time 0.319674 seconds
Matrix split and distributed along layers: time 0.050812 seconds
Matrix split and distributed along layers: time 0.0108011 seconds

 Processor Grid (row x col x layers x threads): 8x8x4x1 
 prow pcol layer thread comm_bcast   comm_scatter comp_summa comp_merge  comp_scatter  comp_result     other      total
Computing A square
   8    8     4      1   3.101418     0.720775    12.480861   3.723461     1.242441     0.068332     1.352844  22.690133
   8    8     4      1   2.414478     0.719513    12.377922   3.714854     1.259265     0.068570     1.942375  22.496977
Computing RTA
   8    8     4      1   1.385749     0.019713     2.564832   0.102242     0.042833     0.005826     1.262518   5.383713
   8    8     4      1   1.798825     0.015424     2.569376   0.100287     0.039568     0.005596     0.879474   5.408550
Computing RTAR
   8    8     4      1   0.128182     0.003626     0.348149   0.025593     0.007159     0.000726     0.048963   0.562398
   8    8     4      1   0.127770     0.002688     0.353250   0.026254     0.007127     0.000733     0.001043   0.518865
----------------------------
 nnz(A)= 473712505
 nnz(R)= 17598889
 nnz(A^2)= 2187662967
 nnz(RTA)= 77235787
 nnz(RTAR)= 25818528
----------------------------
Application 15461444 resources: utime ~37263s, stime ~2275s, Rss ~2988524, inblocks ~38889968, outblocks ~323254
Reading input file....
Matrix is Float
Total number of nonzeros expected across all processors is 473712505
File is 19662469672 bytes
Total number of entries read across all processors is 473712505
As a whole: 17598889 rows and 17598889 columns and 473712505 nonzeros
Reader took 47.9695 seconds
Generating random permutation vector.
Perfoming random permuation of matrix.
Permutation took 48.6549 seconds
Input load balance: 1.14949
Input matrix read : time 96.6858
Computing restriction matrix 
As a whole: 17598889 rows and 17598889 columns and 456113616 nonzeros
As a whole, mis2 has: 367507 nonzeros and length 17598889
Creating a new MPI data type for 10VertexTypeIlE
As a whole, mis2neighUnion has: 17598889 nonzeros and length 17598889
Rop final (before normalization)... As a whole: 17598889 rows and 367507 columns and 17598889 nonzeros
Load balance (before): 1.08647
Load balance (after): 1.00295
Restriction Op computed : time 30.251
Matrix split and distributed along layers: time 5.08912 seconds
Matrix split and distributed along layers: time 0.81718 seconds
Matrix split and distributed along layers: time 0.129579 seconds
Matrix split and distributed along layers: time 0.030046 seconds

 Processor Grid (row x col x layers x threads): 5x5x8x1 
 prow pcol layer thread comm_bcast   comm_scatter comp_summa comp_merge  comp_scatter  comp_result     other      total
Computing A square
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'terminate called after throwing an instance of 'std::bad_allocstd::bad_alloc'
'
  what():    what():  std::bad_allocstd::bad_alloc

terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
[NID 05754] 2015-09-03 02:34:31 Apid 15461475: initiated application termination
[NID 05754] 2015-09-03 02:34:32 Apid 15461475: OOM killer terminated this process.
Application 15461475 exit signals: Killed
Application 15461475 resources: utime ~0s, stime ~8s, Rss ~5420, inblocks ~96843, outblocks ~255454
Reading input file....
Matrix is Float
Total number of nonzeros expected across all processors is 473712505
File is 19662469672 bytes
Total number of entries read across all processors is 473712505
As a whole: 17598889 rows and 17598889 columns and 473712505 nonzeros
Reader took 54.3006 seconds
Generating random permutation vector.
Perfoming random permuation of matrix.
Permutation took 58.2145 seconds
Input load balance: 1.1116
Input matrix read : time 112.603
Computing restriction matrix 
As a whole: 17598889 rows and 17598889 columns and 456113616 nonzeros
As a whole, mis2 has: 367159 nonzeros and length 17598889
Creating a new MPI data type for 10VertexTypeIlE
As a whole, mis2neighUnion has: 17598889 nonzeros and length 17598889
Rop final (before normalization)... As a whole: 17598889 rows and 367159 columns and 17598889 nonzeros
Load balance (before): 1.06361
Load balance (after): 1.00228
Restriction Op computed : time 44.6825
Matrix split and distributed along layers: time 7.53583 seconds
Matrix split and distributed along layers: time 1.18243 seconds
Matrix split and distributed along layers: time 0.202945 seconds
Matrix split and distributed along layers: time 0.0478611 seconds

 Processor Grid (row x col x layers x threads): 4x4x16x1 
 prow pcol layer thread comm_bcast   comm_scatter comp_summa comp_merge  comp_scatter  comp_result     other      total
Computing A square
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
[NID 05747] 2015-09-03 02:37:37 Apid 15461501: initiated application termination
[NID 05751] 2015-09-03 02:37:40 Apid 15461501: OOM killer terminated this process.
[NID 05752] 2015-09-03 02:37:48 Apid 15461501: OOM killer terminated this process.
[NID 05747] 2015-09-03 02:37:48 Apid 15461501: OOM killer terminated this process.
Application 15461501 exit signals: Killed
Application 15461501 resources: utime ~0s, stime ~10s, Rss ~5420, inblocks ~118388, outblocks ~312223
Reading input file....
Matrix is Float
Total number of nonzeros expected across all processors is 473712505
File is 19662469672 bytes
Total number of entries read across all processors is 473712505
As a whole: 17598889 rows and 17598889 columns and 473712505 nonzeros
Reader took 42.953 seconds
Generating random permutation vector.
Perfoming random permuation of matrix.
Permutation took 30.8773 seconds
Input load balance: 1.3013
Input matrix read : time 73.889
Computing restriction matrix 
As a whole: 17598889 rows and 17598889 columns and 456113616 nonzeros
As a whole, mis2 has: 367770 nonzeros and length 17598889
Creating a new MPI data type for 10VertexTypeIlE
As a whole, mis2neighUnion has: 17598889 nonzeros and length 17598889
Rop final (before normalization)... As a whole: 17598889 rows and 367770 columns and 17598889 nonzeros
Load balance (before): 1.17066
Load balance (after): 1.00432
Restriction Op computed : time 11.6068
Matrix split and distributed along layers: time 0.224871 seconds
Matrix split and distributed along layers: time 0.180341 seconds
Matrix split and distributed along layers: time 0.00245285 seconds
Matrix split and distributed along layers: time 0.0042119 seconds

 Processor Grid (row x col x layers x threads): 9x9x1x3 
 prow pcol layer thread comm_bcast   comm_scatter comp_summa comp_merge  comp_scatter  comp_result     other      total
Computing A square
   9    9     1      3   8.893749     0.000000    15.638403   2.741451     0.000000     0.140211     0.726296  28.140110
   9    9     1      3   8.387846     0.000000    15.695599   2.681249     0.000000     0.140398     0.557496  27.462589
Computing RTA
   9    9     1      3   4.209561     0.000000     2.852448   0.081012     0.000000     0.009921     0.105812   7.258754
   9    9     1      3   4.110675     0.000000     2.837499   0.080426     0.000000     0.009779     0.085113   7.123492
Computing RTAR
   9    9     1      3   0.623834     0.000000     0.464193   0.011750     0.000000     0.000375     0.031673   1.131825
   9    9     1      3   0.408383     0.000000     0.470464   0.011665     0.000000     0.000358     0.040691   0.931561
----------------------------
 nnz(A)= 473712505
 nnz(R)= 17598889
 nnz(A^2)= 2187662967
 nnz(RTA)= 77234521
 nnz(RTAR)= 6679880
----------------------------
Application 15461546 resources: utime ~15437s, stime ~1394s, Rss ~4635484, inblocks ~38938191, outblocks ~323569
Reading input file....
Matrix is Float
Total number of nonzeros expected across all processors is 473712505
File is 19662469672 bytes
Total number of entries read across all processors is 473712505
As a whole: 17598889 rows and 17598889 columns and 473712505 nonzeros
Reader took 99.3928 seconds
Generating random permutation vector.
Perfoming random permuation of matrix.
Permutation took 40.536 seconds
Input load balance: 1.18731
Input matrix read : time 140.019
Computing restriction matrix 
As a whole: 17598889 rows and 17598889 columns and 456113616 nonzeros
As a whole, mis2 has: 367685 nonzeros and length 17598889
Creating a new MPI data type for 10VertexTypeIlE
As a whole, mis2neighUnion has: 17598889 nonzeros and length 17598889
Rop final (before normalization)... As a whole: 17598889 rows and 367685 columns and 17598889 nonzeros
Load balance (before): 1.10613
Load balance (after): 1.0031
Restriction Op computed : time 21.4568
Matrix split and distributed along layers: time 4.65102 seconds
Matrix split and distributed along layers: time 0.701031 seconds
Matrix split and distributed along layers: time 0.102904 seconds
Matrix split and distributed along layers: time 0.0234768 seconds

 Processor Grid (row x col x layers x threads): 6x6x2x3 
 prow pcol layer thread comm_bcast   comm_scatter comp_summa comp_merge  comp_scatter  comp_result     other      total
Computing A square
   6    6     2      3   4.486107     1.041727    13.409016   3.231767     0.931394     0.159483     2.341256  25.600750
   6    6     2      3   4.381713     1.049519    13.408605   3.025068     0.936645     0.155742     1.962650  24.919942
Computing RTA
   6    6     2      3   2.679358     0.035733     2.564217   0.092838     0.031835     0.008859     0.293368   5.706208
   6    6     2      3   2.631689     0.042143     2.556142   0.089646     0.027319     0.005473     0.311494   5.663906
Computing RTAR
   6    6     2      3   0.373245     0.010604     0.352307   0.012489     0.003515     0.000503     0.040320   0.792983
   6    6     2      3   0.246869     0.009003     0.359692   0.012224     0.003499     0.000521     0.021589   0.653397
----------------------------
 nnz(A)= 473712505
 nnz(R)= 17598889
 nnz(A^2)= 2187662967
 nnz(RTA)= 77258458
 nnz(RTAR)= 13073868
----------------------------
Application 15461579 resources: utime ~17721s, stime ~1499s, Rss ~6636524, inblocks ~38709406, outblocks ~262290
Reading input file....
Matrix is Float
Total number of nonzeros expected across all processors is 473712505
File is 19662469672 bytes
Total number of entries read across all processors is 473712505
As a whole: 17598889 rows and 17598889 columns and 473712505 nonzeros
Reader took 99.6158 seconds
Generating random permutation vector.
Perfoming random permuation of matrix.
Permutation took 56.8582 seconds
Input load balance: 1.11167
Input matrix read : time 156.474
Computing restriction matrix 
As a whole: 17598889 rows and 17598889 columns and 456113616 nonzeros
As a whole, mis2 has: 367722 nonzeros and length 17598889
Creating a new MPI data type for 10VertexTypeIlE
As a whole, mis2neighUnion has: 17598889 nonzeros and length 17598889
Rop final (before normalization)... As a whole: 17598889 rows and 367722 columns and 17598889 nonzeros
Load balance (before): 1.0638
Load balance (after): 1.0022
Restriction Op computed : time 43.3237
Matrix split and distributed along layers: time 8.52912 seconds
Matrix split and distributed along layers: time 1.38728 seconds
Matrix split and distributed along layers: time 0.213611 seconds
Matrix split and distributed along layers: time 0.042506 seconds

 Processor Grid (row x col x layers x threads): 4x4x4x3 
 prow pcol layer thread comm_bcast   comm_scatter comp_summa comp_merge  comp_scatter  comp_result     other      total
Computing A square
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
_pmiu_daemon(SIGCHLD): [NID 05753] [c5-3c2s14n1] [Thu Sep  3 02:48:30 2015] PE RANK 53 exit signal Aborted
_pmiu_daemon(SIGCHLD): [NID 05747] [c5-3c2s12n3] [Thu Sep  3 02:48:30 2015] PE RANK 2 exit signal Aborted
[NID 05753] 2015-09-03 02:48:30 Apid 15461611: initiated application termination
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
Application 15461611 exit codes: 134
Application 15461611 exit signals: Killed
Application 15461611 resources: utime ~500s, stime ~12s, Rss ~6662060, inblocks ~86217, outblocks ~227087
Reading input file....
Matrix is Float
Total number of nonzeros expected across all processors is 473712505
File is 19662469672 bytes
Total number of entries read across all processors is 473712505
As a whole: 17598889 rows and 17598889 columns and 473712505 nonzeros
Reader took 78.4517 seconds
Generating random permutation vector.
Perfoming random permuation of matrix.
Permutation took 69.69 seconds
Input load balance: 1.07416
Input matrix read : time 148.194
Computing restriction matrix 
As a whole: 17598889 rows and 17598889 columns and 456113616 nonzeros
As a whole, mis2 has: 367451 nonzeros and length 17598889
Creating a new MPI data type for 10VertexTypeIlE
As a whole, mis2neighUnion has: 17598889 nonzeros and length 17598889
Rop final (before normalization)... As a whole: 17598889 rows and 367451 columns and 17598889 nonzeros
Load balance (before): 1.04168
Load balance (after): 1.00134
Restriction Op computed : time 73.2731
Matrix split and distributed along layers: time 13.8429 seconds
Matrix split and distributed along layers: time 2.63511 seconds
Matrix split and distributed along layers: time 0.373233 seconds
Matrix split and distributed along layers: time 0.0804112 seconds

 Processor Grid (row x col x layers x threads): 3x3x8x3 
 prow pcol layer thread comm_bcast   comm_scatter comp_summa comp_merge  comp_scatter  comp_result     other      total
Computing A square
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
[NID 05755] 2015-09-03 02:52:50 Apid 15461629: initiated application termination
[NID 05755] 2015-09-03 02:52:52 Apid 15461629: OOM killer terminated this process.
aprun: Apid 15461629: Caught signal Terminated, sending to application
=>> PBS: job killed: walltime 1838 exceeded limit 1800
aprun: Apid 15461629: Caught signal Terminated, sending to application
aprun: Apid 15461629: Caught signal Terminated, sending to application
aprun: Apid 15461629: Caught signal Terminated, sending to application
aprun: Apid 15461629: Caught signal Terminated, sending to application
aprun: Apid 15461629: Caught signal Terminated, sending to application
aprun: Apid 15461629: Caught signal Terminated, sending to application
aprun: Apid 15461629: Caught signal Terminated, sending to application
aprun: Apid 15461629: Caught signal Terminated, sending to application
aprun: Apid 15461629: Caught signal Terminated, sending to application
[NID 05748] 2015-09-03 02:52:56 Apid 15461629: OOM killer terminated this process.
Application 15461629 exit signals: Killed
Application 15461629 resources: utime ~0s, stime ~0s, Rss ~5420, inblocks ~96579, outblocks ~255438



Reading input file....
Matrix is Float
Total number of nonzeros expected across all processors is 473712505
File is 19662469672 bytes
Total number of entries read across all processors is 473712505
As a whole: 17598889 rows and 17598889 columns and 473712505 nonzeros
Reader took 45.2176 seconds
Generating random permutation vector.
Perfoming random permuation of matrix.
Permutation took 38.0138 seconds
Input load balance: 1.18718
Input matrix read : time 83.3427
Computing restriction matrix 
As a whole: 17598889 rows and 17598889 columns and 456113616 nonzeros
As a whole, mis2 has: 367516 nonzeros and length 17598889
Creating a new MPI data type for 10VertexTypeIlE
As a whole, mis2neighUnion has: 17598889 nonzeros and length 17598889
Rop final (before normalization)... As a whole: 17598889 rows and 367516 columns and 17598889 nonzeros
Load balance (before): 1.10544
Load balance (after): 1.00246
Restriction Op computed : time 20.1667
Matrix split and distributed along layers: time 0.382629 seconds
Matrix split and distributed along layers: time 0.378938 seconds
Matrix split and distributed along layers: time 0.00510001 seconds
Matrix split and distributed along layers: time 0.0134521 seconds

 Processor Grid (row x col x layers x threads): 6x6x1x6 
 prow pcol layer thread comm_bcast   comm_scatter comp_summa comp_merge  comp_scatter  comp_result     other      total
Computing A square
   6    6     1      6   6.895555     0.000000    14.671096   2.773633     0.000000     0.161677     0.853506  25.355467
   6    6     1      6   6.449408     0.000000    14.659788   2.610649     0.000000     0.163801     0.915653  24.799299
Computing RTA
   6    6     1      6   2.764273     0.000000     2.364846   0.068543     0.000000     0.011772     0.278761   5.488195
   6    6     1      6   2.572700     0.000000     2.398336   0.062203     0.000000     0.010882     0.257581   5.301702
Computing RTAR
   6    6     1      6   0.875775     0.000000     0.438057   0.007184     0.000000     0.000341     0.047475   1.368833
   6    6     1      6   0.670707     0.000000     0.446084   0.007748     0.000000     0.000357     0.066400   1.191296
----------------------------
 nnz(A)= 473712505
 nnz(R)= 17598889
 nnz(A^2)= 2187662967
 nnz(RTA)= 77245838
 nnz(RTAR)= 6675394
----------------------------
Application 15465559 resources: utime ~10372s, stime ~994s, Rss ~8984976, inblocks ~38703672, outblocks ~262025
Reading input file....
Matrix is Float
Total number of nonzeros expected across all processors is 473712505
File is 19662469672 bytes
Total number of entries read across all processors is 473712505
As a whole: 17598889 rows and 17598889 columns and 473712505 nonzeros
Reader took 47.6714 seconds
Generating random permutation vector.
Perfoming random permuation of matrix.
Permutation took 54.0624 seconds
Input load balance: 1.11214
Input matrix read : time 101.847
Computing restriction matrix 
As a whole: 17598889 rows and 17598889 columns and 456113616 nonzeros
As a whole, mis2 has: 367284 nonzeros and length 17598889
Creating a new MPI data type for 10VertexTypeIlE
As a whole, mis2neighUnion has: 17598889 nonzeros and length 17598889
Rop final (before normalization)... As a whole: 17598889 rows and 367284 columns and 17598889 nonzeros
Load balance (before): 1.06402
Load balance (after): 1.00168
Restriction Op computed : time 41.0298
Matrix split and distributed along layers: time 9.35089 seconds
Matrix split and distributed along layers: time 1.39494 seconds
Matrix split and distributed along layers: time 0.229274 seconds
Matrix split and distributed along layers: time 0.034899 seconds

 Processor Grid (row x col x layers x threads): 4x4x2x6 
 prow pcol layer thread comm_bcast   comm_scatter comp_summa comp_merge  comp_scatter  comp_result     other      total
Computing A square
   4    4     2      6   4.021155     1.999506    13.544216   3.399423     1.256126     0.193470     2.192558  26.606455
   4    4     2      6   3.681703     2.332310    13.721631   2.989554     1.768411     0.169343     1.984311  26.647263
Computing RTA
   4    4     2      6   1.781735     0.067856     2.419185   0.101673     0.040355     0.012302     0.385010   4.808116
   4    4     2      6   1.828058     0.068341     2.250215   0.089446     0.042960     0.012458     0.385574   4.677052
Computing RTAR
   4    4     2      6   0.411829     0.013488     0.505266   0.009319     0.005975     0.001403     0.059445   1.006724
   4    4     2      6   0.302522     0.011980     0.482469   0.011407     0.005891     0.001430     0.015491   0.831190
----------------------------
 nnz(A)= 473712505
 nnz(R)= 17598889
 nnz(A^2)= 2187662967
 nnz(RTA)= 77224314
 nnz(RTAR)= 16250802
----------------------------
Application 15465598 resources: utime ~11167s, stime ~1205s, Rss ~13190832, inblocks ~38560643, outblocks ~231620
Reading input file....
Matrix is Float
Total number of nonzeros expected across all processors is 473712505
File is 19662469672 bytes
Total number of entries read across all processors is 473712505
As a whole: 17598889 rows and 17598889 columns and 473712505 nonzeros
Reader took 69.2135 seconds
Generating random permutation vector.
Perfoming random permuation of matrix.
Permutation took 66.0044 seconds
Input load balance: 1.07437
Input matrix read : time 135.261
Computing restriction matrix 
As a whole: 17598889 rows and 17598889 columns and 456113616 nonzeros
As a whole, mis2 has: 367680 nonzeros and length 17598889
Creating a new MPI data type for 10VertexTypeIlE
As a whole, mis2neighUnion has: 17598889 nonzeros and length 17598889
Rop final (before normalization)... As a whole: 17598889 rows and 367680 columns and 17598889 nonzeros
Load balance (before): 1.04188
Load balance (after): 1.00066
Restriction Op computed : time 69.0336
Matrix split and distributed along layers: time 14.0547 seconds
Matrix split and distributed along layers: time 2.33424 seconds
Matrix split and distributed along layers: time 0.370987 seconds
Matrix split and distributed along layers: time 0.086118 seconds

 Processor Grid (row x col x layers x threads): 3x3x4x6 
 prow pcol layer thread comm_bcast   comm_scatter comp_summa comp_merge  comp_scatter  comp_result     other      total
Computing A square
   3    3     4      6   1.664470     4.230431     9.443486   3.597092     1.795829     0.153287     3.098159  23.982754
   3    3     4      6   1.896480     4.505099     9.476035   3.075922     1.537549     0.152647     3.363683  24.007415
Computing RTA
   3    3     4      6   1.309932     0.141063     1.778541   0.104208     0.057219     0.010718     0.116304   3.517985
   3    3     4      6   1.288400     0.121479     1.721023   0.116485     0.050818     0.008968     0.058513   3.365686
Computing RTAR
   3    3     4      6   0.224861     0.019602     0.301600   0.011231     0.006259     0.000455     0.012257   0.576266
   3    3     4      6   0.169950     0.016718     0.296510   0.011169     0.007079     0.000464     0.015588   0.517478
----------------------------
 nnz(A)= 473712505
 nnz(R)= 17598889
 nnz(A^2)= 2187662967
 nnz(RTA)= 77244767
 nnz(RTAR)= 13071649
----------------------------
Application 15465641 resources: utime ~13738s, stime ~1412s, Rss ~15480600, inblocks ~38547504, outblocks ~259476
Reading input file....
Matrix is Float
Total number of nonzeros expected across all processors is 473712505
File is 19662469672 bytes
Total number of entries read across all processors is 473712505
As a whole: 17598889 rows and 17598889 columns and 473712505 nonzeros
Reader took 136.624 seconds
Generating random permutation vector.
Perfoming random permuation of matrix.
Permutation took 110.741 seconds
Input load balance: 1.03722
Input matrix read : time 247.365
Computing restriction matrix 
As a whole: 17598889 rows and 17598889 columns and 456113616 nonzeros
As a whole, mis2 has: 367391 nonzeros and length 17598889
Creating a new MPI data type for 10VertexTypeIlE
As a whole, mis2neighUnion has: 17598889 nonzeros and length 17598889
Rop final (before normalization)... As a whole: 17598889 rows and 367391 columns and 17598889 nonzeros
Load balance (before): 1.02096
Load balance (after): 1.00057
Restriction Op computed : time 155.46
Matrix split and distributed along layers: time 29.3341 seconds
Matrix split and distributed along layers: time 5.56527 seconds
Matrix split and distributed along layers: time 1.10151 seconds
Matrix split and distributed along layers: time 0.24024 seconds

 Processor Grid (row x col x layers x threads): 2x2x8x6 
 prow pcol layer thread comm_bcast   comm_scatter comp_summa comp_merge  comp_scatter  comp_result     other      total
Computing A square
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
terminate called after throwing an instance of 'std::bad_alloc'
  what():  std::bad_alloc
_pmiu_daemon(SIGCHLD): [NID 05893] [c6-3c2s1n1] [Thu Sep  3 09:57:28 2015] PE RANK 28 exit signal Aborted
_pmiu_daemon(SIGCHLD): [NID 05887] [c6-3c1s15n3] [Thu Sep  3 09:57:29 2015] PE RANK 5 exit signal Aborted
[NID 05892] 2015-09-03 09:57:29 Apid 15465723: initiated application termination
[NID 05892] 2015-09-03 09:57:30 Apid 15465723: OOM killer terminated this process.
Application 15465723 exit codes: 134
Application 15465723 exit signals: Killed
Application 15465723 resources: utime ~1473s, stime ~30s, Rss ~14374652, inblocks ~86921, outblocks ~227124
Reading input file....
Matrix is Float
Total number of nonzeros expected across all processors is 473712505
File is 19662469672 bytes
Total number of entries read across all processors is 473712505
As a whole: 17598889 rows and 17598889 columns and 473712505 nonzeros
Reader took 481.088 seconds
Generating random permutation vector.
Perfoming random permuation of matrix.
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
=>> PBS: job killed: walltime 1837 exceeded limit 1800
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
aprun: Apid 15465885: Caught signal Terminated, sending to application
_pmiu_daemon(SIGCHLD): [NID 05887] [c6-3c1s15n3] [Thu Sep  3 10:08:55 2015] PE RANK 4 exit signal Terminated
_pmiu_daemon(SIGCHLD): [NID 05888] [c6-3c2s0n0] [Thu Sep  3 10:08:55 2015] PE RANK 9 exit signal Terminated
_pmiu_daemon(SIGCHLD): [NID 05889] [c6-3c2s0n1] [Thu Sep  3 10:08:55 2015] PE RANK 12 exit signal Terminated
_pmiu_daemon(SIGCHLD): [NID 05886] [c6-3c1s15n2] [Thu Sep  3 10:08:55 2015] PE RANK 1 exit signal Terminated
Application 15465885 exit codes: 143
Application 15465885 resources: utime ~2694s, stime ~10s, Rss ~9792, inblocks ~44501, outblocks ~113528

 + --------------------------------------------------------------------------
 +        Job name: Rop_Nalu_R3_fine_grid_256_1
 +          Job Id: 3528137.edique02
 +          System: edison
 +     Queued Time: Thu Sep  3 08:56:31 2015
 +      Start Time: Thu Sep  3 09:38:20 2015
 + Completion Time: Thu Sep  3 10:09:05 2015
 +            User: azad
 +        MOM Host: nid00898
 +           Queue: debug
 +  Req. Resources: mppnodect=11,mppnppn=24,mppwidth=256,walltime=00:30:00
 +  Used Resources: cput=00:00:01,energy_used=0,mem=10816kb,vmem=159364kb,walltime=00:30:47
 +     Acct String: m1982
 +   PBS_O_WORKDIR: /global/u1/a/azad/combinatorial-blas-2.0/CombBLAS/3DSpGEMM/edison_exp/Nalu_R3_fine_grid
 +     Submit Args: batchRop_Nalu_R3_fine_grid_256_1
 + --------------------------------------------------------------------------

