OUTPUT of run 2 of at most 100:
```
W_q.0 first 48 singular values: [5.0385 4.9994 4.7025 4.377  4.3428 4.2944 4.0581 4.0325 3.9503 3.9226 3.7953 3.7436 3.7024 3.6308 3.6084 3.5301 3.4694 3.4156 3.3249 3.2407 3.1963
 3.0492 2.8994 2.7778 2.6226 2.526  2.411  2.3704 2.2612 2.1858 2.1548 2.0897 2.0468 2.0064 1.927  1.8521 1.8265 1.7527 1.7504 1.685  1.6599 1.6231
 1.5999 1.5427 1.5015 1.4688 1.4388 1.4052]
singular values 64,96,128,192,256,320,384: [1.0116 0.6385 0.5023 0.3374 0.2096 0.1008 0.0006]
W_k.0 first 48 singular values: [6.2042 5.0521 4.5716 4.5372 4.3914 4.2894 4.2839 4.2083 4.1192 4.0728 3.9591 3.9166 3.8164 3.7144 3.6762 3.5481 3.4758 3.4002 3.3555 3.2717 3.1133
 3.0071 2.9759 2.5777 2.5256 2.4521 2.3805 2.3248 2.2941 2.2108 2.1249 2.0938 2.0501 1.9858 1.9423 1.8583 1.8195 1.7392 1.7032 1.6831 1.6343 1.6321
 1.5743 1.5319 1.5167 1.4825 1.4721 1.4361]
singular values 64,96,128,192,256,320,384: [1.0208 0.6407 0.5068 0.3471 0.2228 0.1081 0.0001]
W_v.0 first 48 singular values: [4.5533 4.0243 3.7382 3.4973 3.4646 3.3672 3.2791 3.2148 3.1361 3.1132 3.0727 3.0202 2.9534 2.8934 2.8666 2.8461 2.8031 2.7388 2.7018 2.6739 2.5894
 2.5749 2.5363 2.4657 2.4438 2.4085 2.2455 2.0897 2.0349 1.9668 1.6206 1.4925 1.4029 1.3239 1.2111 1.188  1.1286 1.1118 1.0779 1.0586 1.042  1.0188
 0.9988 0.9903 0.9674 0.9492 0.9227 0.91  ]
singular values 64,96,128,192,256,320,384: [0.685  0.5275 0.4409 0.3124 0.2032 0.0994 0.0002]
W_fc.0 first 48 singular values: [18.1104 12.2798  8.4726  7.9016  7.7793  7.442   7.1458  7.1094  7.0083  6.8053  6.7211  6.5398  6.3779  6.3286  6.2698  6.2168  6.2037  6.0345
  6.0235  5.9437  5.8446  5.7365  5.7016  5.6681  5.6093  5.5798  5.498   5.4472  5.3773  5.3341  5.2437  5.203   5.1406  5.1261  4.9896  4.9434
  4.9202  4.8457  4.7874  4.7161  4.6694  4.6008  4.5188  4.4395  4.4082  4.3845  4.3074  4.2416]
singular values 64,96,128,192,256,320,384: [3.2813 1.7448 1.2638 0.9404 0.7499 0.5961 0.4206]
W_proj.0 first 48 singular values: [10.9319  7.576   6.6285  6.2932  6.166   5.9239  5.886   5.7686  5.7059  5.6097  5.4949  5.4626  5.4044  5.3131  5.1933  5.1607  5.1191  5.0699
  5.0033  4.9374  4.8767  4.7926  4.6927  4.6637  4.6514  4.6368  4.5477  4.5258  4.4869  4.4042  4.329   4.2833  4.2468  4.2063  4.1781  4.1409
  4.1201  4.1053  4.0623  4.0225  3.9971  3.9583  3.9344  3.9041  3.8574  3.8499  3.7981  3.7584]
singular values 64,96,128,192,256,320,384: [3.2682 2.5003 1.9364 1.1717 0.7078 0.4323 0.2442]
W_proj.3 first 48 singular values: [28.1752 20.2934 19.2921 19.1349 18.7081 18.5697 18.1393 17.7759 17.4845 16.5396 15.9131 15.6096 14.9752 14.8725 14.4167 14.3133 13.3269 12.9707
 12.5934 12.3698 12.2251 12.0191 11.3225 11.115  10.7693  9.2267  8.5731  7.929   6.5001  5.2712  3.9657  3.1843  2.7917  2.6972  2.6532  2.5552
  2.511   2.4709  2.3788  2.29    2.25    2.2147  2.1167  2.0811  2.0364  2.0107  1.9843  1.9692]
singular values 64,96,128,192,256,320,384: [1.6923 1.3641 1.1385 0.8324 0.6319 0.4812 0.3244]

L0 QK eigenvalues with greatest absolute value:
L0H0 [-0.049 +0.j      0.0061+0.0086j  0.0061-0.0086j -0.0029+0.j     -0.0011+0.0016j -0.0011-0.0016j -0.0016+0.j     -0.0015+0.0002j -0.0015-0.0002j
 -0.0007+0.0012j -0.0007-0.0012j -0.0013+0.j      0.0009+0.0007j  0.0009-0.0007j -0.001 +0.0004j -0.001 -0.0004j]
L0H1 [ 0.2178-0.3452j  0.2178+0.3452j -0.2844+0.j     -0.1232+0.1495j -0.1232-0.1495j -0.0978+0.0983j -0.0978-0.0983j -0.032 -0.0412j -0.032 +0.0412j
  0.0256-0.0327j  0.0256+0.0327j -0.0399+0.j      0.0001+0.032j   0.0001-0.032j  -0.0279+0.012j  -0.0279-0.012j ]
L0H2 [ 0.0905+0.j      0.0535+0.j     -0.022 +0.j     -0.0133+0.0007j -0.0133-0.0007j  0.0114+0.j     -0.01  +0.j     -0.0057+0.0041j -0.0057-0.0041j
 -0.0069+0.j     -0.0056+0.001j  -0.0056-0.001j   0.0054+0.j     -0.0039+0.j     -0.0036+0.j     -0.0019-0.0027j]
L0H3 [-0.0775-0.0055j -0.0775+0.0055j -0.0198+0.j      0.006 +0.0166j  0.006 -0.0166j  0.0075+0.j     -0.0062+0.0016j -0.0062-0.0016j -0.0045+0.001j
 -0.0045-0.001j  -0.0019+0.004j  -0.0019-0.004j  -0.0035+0.j     -0.0019-0.0025j -0.0019+0.0025j  0.0003-0.0031j]
L0H4 [-0.0012-0.0006j -0.0012+0.0006j  0.0001-0.0007j  0.0001+0.0007j -0.0005+0.0005j -0.0005-0.0005j -0.0007+0.j      0.0006+0.j     -0.0004+0.0005j
 -0.0004-0.0005j -0.0006+0.0001j -0.0006-0.0001j -0.0002+0.0005j -0.0002-0.0005j  0.0004+0.0004j  0.0004-0.0004j]
L0H5 [ 0.2071+0.2748j  0.2071-0.2748j  0.1137+0.1719j  0.1137-0.1719j  0.1785+0.j      0.1545+0.0845j  0.1545-0.0845j  0.0348+0.1657j  0.0348-0.1657j
  0.0944+0.1369j  0.0944-0.1369j -0.0407+0.139j  -0.0407-0.139j   0.0076+0.1389j  0.0076-0.1389j -0.045 +0.1213j]

L0 QK pairwise normalized Frobenius inner products:
[[ 1.     0.179  0.112  0.206  0.063  0.093]
 [ 0.179  1.     0.21  -0.15   0.005  0.413]
 [ 0.112  0.21   1.    -0.247 -0.006  0.113]
 [ 0.206 -0.15  -0.247  1.    -0.027 -0.098]
 [ 0.063  0.005 -0.006 -0.027  1.    -0.004]
 [ 0.093  0.413  0.113 -0.098 -0.004  1.   ]]

L1 QK pairwise normalized Frobenius inner products:
[[1.    0.302 0.393 0.326 0.337 0.265]
 [0.302 1.    0.525 0.591 0.568 0.566]
 [0.393 0.525 1.    0.539 0.579 0.451]
 [0.326 0.591 0.539 1.    0.608 0.524]
 [0.337 0.568 0.579 0.608 1.    0.48 ]
 [0.265 0.566 0.451 0.524 0.48  1.   ]]

Earlier-head output to later-head query/key weight composition.
Each entry: ||Q_l C_earlier||F/(||Q_l||F ||C_earlier||F), and analogous K; random-isotropic scale ~0.051.
earlier: L0H0 L0H1 L0H2 L0H3 L0H4 L0H5
L1H0 Q [0.075 0.085 0.095 0.063 0.074 0.089] K [0.273 0.066 0.076 0.122 0.339 0.072]
L1H1 Q [0.074 0.076 0.062 0.054 0.08  0.09 ] K [0.393 0.037 0.093 0.152 0.499 0.06 ]
L1H2 Q [0.073 0.079 0.061 0.056 0.079 0.09 ] K [0.376 0.041 0.089 0.145 0.481 0.058]
L1H3 Q [0.082 0.073 0.056 0.06  0.092 0.084] K [0.397 0.04  0.094 0.154 0.505 0.059]
L1H4 Q [0.078 0.076 0.062 0.059 0.084 0.09 ] K [0.389 0.04  0.093 0.15  0.493 0.06 ]
L1H5 Q [0.068 0.076 0.068 0.054 0.074 0.093] K [0.375 0.042 0.086 0.143 0.472 0.066]
earlier: L0H0 L0H1 L0H2 L0H3 L0H4 L0H5 L1H0 L1H1 L1H2 L1H3 L1H4 L1H5
L2H0 Q [0.04  0.054 0.052 0.043 0.041 0.058 0.07  0.055 0.059 0.06  0.057 0.058] K [0.153 0.051 0.064 0.079 0.182 0.06  0.064 0.052 0.055 0.051 0.051 0.051]
L2H1 Q [0.039 0.048 0.063 0.044 0.029 0.067 0.071 0.055 0.063 0.058 0.058 0.054] K [0.053 0.063 0.065 0.049 0.047 0.076 0.065 0.064 0.068 0.07  0.068 0.063]
L2H2 Q [0.044 0.053 0.044 0.043 0.049 0.08  0.058 0.056 0.066 0.064 0.063 0.054] K [0.196 0.047 0.065 0.087 0.256 0.065 0.061 0.05  0.057 0.053 0.055 0.049]
L2H3 Q [0.044 0.055 0.05  0.044 0.053 0.055 0.062 0.058 0.059 0.057 0.061 0.057] K [0.202 0.048 0.065 0.09  0.262 0.057 0.059 0.048 0.051 0.049 0.05  0.049]
L2H4 Q [0.051 0.054 0.046 0.046 0.056 0.059 0.063 0.058 0.059 0.061 0.06  0.057] K [0.194 0.049 0.082 0.095 0.239 0.059 0.072 0.05  0.055 0.051 0.053 0.049]
L2H5 Q [0.035 0.052 0.065 0.045 0.034 0.052 0.074 0.056 0.059 0.056 0.055 0.057] K [0.132 0.047 0.066 0.072 0.154 0.054 0.059 0.049 0.05  0.05  0.05  0.05 ]
earlier: L0H0 L0H1 L0H2 L0H3 L0H4 L0H5 L1H0 L1H1 L1H2 L1H3 L1H4 L1H5 L2H0 L2H1 L2H2 L2H3 L2H4 L2H5
L3H0 Q [0.029 0.048 0.046 0.041 0.027 0.055 0.054 0.049 0.052 0.05  0.051 0.05  0.051 0.054 0.047 0.051 0.053 0.053] K [0.072 0.051 0.059 0.051 0.088 0.057 0.057 0.05  0.052 0.05  0.052 0.049 0.051 0.049 0.052 0.051 0.05  0.052]
L3H1 Q [0.033 0.046 0.052 0.05  0.029 0.056 0.051 0.05  0.053 0.05  0.05  0.048 0.051 0.06  0.042 0.046 0.051 0.056] K [0.057 0.051 0.058 0.051 0.055 0.068 0.055 0.054 0.06  0.057 0.059 0.053 0.054 0.052 0.061 0.055 0.057 0.054]
L3H2 Q [0.03  0.05  0.052 0.042 0.032 0.052 0.056 0.052 0.051 0.05  0.051 0.051 0.054 0.052 0.049 0.055 0.053 0.055] K [0.1   0.05  0.058 0.055 0.128 0.055 0.055 0.049 0.05  0.051 0.051 0.05  0.05  0.047 0.05  0.049 0.049 0.051]
L3H3 Q [0.037 0.05  0.058 0.047 0.035 0.046 0.054 0.05  0.049 0.049 0.05  0.05  0.053 0.059 0.044 0.052 0.052 0.062] K [0.06  0.05  0.058 0.05  0.068 0.049 0.055 0.049 0.049 0.05  0.051 0.051 0.048 0.061 0.048 0.048 0.048 0.051]
L3H4 Q [0.034 0.049 0.059 0.045 0.032 0.048 0.063 0.051 0.051 0.05  0.05  0.052 0.053 0.057 0.045 0.053 0.055 0.062] K [0.09  0.05  0.058 0.055 0.11  0.049 0.055 0.049 0.053 0.049 0.048 0.05  0.049 0.05  0.05  0.049 0.05  0.051]
L3H5 Q [0.035 0.058 0.05  0.045 0.034 0.074 0.06  0.056 0.063 0.063 0.064 0.055 0.049 0.058 0.047 0.058 0.053 0.056] K [0.046 0.066 0.058 0.049 0.043 0.078 0.063 0.061 0.068 0.068 0.068 0.057 0.054 0.045 0.075 0.069 0.056 0.059]

Layer-0 effective input-weight joint spectrum:
[6.4889 4.6815 2.7741 2.6602 2.5992 2.5298 2.3742 2.3592 2.2576 2.214  2.1753 2.1461 2.0689 2.0138 1.9794 1.9185 1.8535 1.8279 1.7753 1.7229 1.6336
 1.589  1.5141 1.4681 1.3811 1.3263 1.2661 1.2373 1.2072 1.1464 1.1285 1.0592 1.0497 1.0198 0.9817 0.9733 0.9634 0.9526 0.9036 0.8889 0.8757 0.8618
 0.8589 0.8444 0.831  0.8131 0.8028 0.7882 0.7749 0.7711 0.7611 0.7454 0.7388 0.7307 0.7202 0.705  0.6951 0.6842 0.6685 0.6595 0.6454 0.6379 0.6269
 0.6116 0.602  0.5964 0.5907 0.5717 0.5658 0.562  0.5522 0.5455 0.5351 0.5271 0.5184 0.511  0.5082 0.4943 0.4891 0.4805]
L0 ln1 gain quantiles: [0.0165 0.0879 0.1295 0.182  0.3262 0.614  0.7758 1.0134]

Final projection column norms quantiles: [1.305  1.7987 1.9599 2.1321 2.3282 2.5114 4.6207]

```