OUTPUT of run 2 of at most 100:
```

LAYER 0 (gain-weighted matrices; no LayerNorm evaluation)
L0H0 QKnorm 0.4367 QKsv [0.4114 0.0916 0.0567 0.0368 0.0343 0.0289] QKtrace -0.0379 OVnorm 9.0429 bias_key/query_norm [0.1091 0.1694]
L0H1 QKnorm 0.2362 QKsv [0.1997 0.0761 0.0422 0.0353 0.0279 0.0247] QKtrace -0.1115 OVnorm 6.9661 bias_key/query_norm [0.0267 0.0107]
L0H2 QKnorm 32.6269 QKsv [11.3199 10.1995  9.7194  9.6486  9.272   8.7533] QKtrace 9.5999 OVnorm 2.54 bias_key/query_norm [1.1448 1.5108]
L0H3 QKnorm 3.1569 QKsv [2.8706 0.9529 0.621  0.3398 0.261  0.2181] QKtrace 1.5753 OVnorm 1.7662 bias_key/query_norm [0.4283 0.3216]
L0H4 QKnorm 0.8508 QKsv [0.7136 0.4284 0.1319 0.0522 0.0419 0.0328] QKtrace -0.5674 OVnorm 4.0336 bias_key/query_norm [0.0901 0.0772]
L0H5 QKnorm 0.6206 QKsv [0.6073 0.0861 0.0369 0.0299 0.0271 0.023 ] QKtrace -0.2776 OVnorm 9.3107 bias_key/query_norm [0.1299 0.2023]

LAYER 1 (gain-weighted matrices; no LayerNorm evaluation)
L1H0 QKnorm 7.0989 QKsv [4.7823 3.8586 1.9815 1.5518 1.0526 0.8946] QKtrace -5.1542 OVnorm 10.1223 bias_key/query_norm [10.8591 13.1828]
L1H1 QKnorm 10.5253 QKsv [7.0546 5.3302 3.2915 2.1355 1.6238 1.4283] QKtrace -9.2943 OVnorm 10.3335 bias_key/query_norm [18.2783 18.644 ]
L1H2 QKnorm 12.41 QKsv [7.9573 6.8828 3.0682 2.603  2.115  1.8171] QKtrace -12.955 OVnorm 9.1806 bias_key/query_norm [20.7031 23.8558]
L1H3 QKnorm 11.0075 QKsv [7.3565 5.9091 3.2626 2.029  1.764  1.3744] QKtrace -9.2582 OVnorm 10.0512 bias_key/query_norm [18.809  18.7776]
L1H4 QKnorm 11.6052 QKsv [7.5816 6.9475 2.8775 2.0717 1.5464 1.3804] QKtrace -9.9582 OVnorm 10.401 bias_key/query_norm [18.3219 23.5867]
L1H5 QKnorm 10.7065 QKsv [7.146  5.914  2.9776 1.8365 1.6321 1.4794] QKtrace -8.1163 OVnorm 10.6202 bias_key/query_norm [14.0211 19.6845]

LAYER 2 (gain-weighted matrices; no LayerNorm evaluation)
L2H0 QKnorm 19.5056 QKsv [5.5592 5.0376 4.8195 4.5062 4.2407 4.0516] QKtrace -0.173 OVnorm 16.3068 bias_key/query_norm [13.5928 13.0054]
L2H1 QKnorm 16.5448 QKsv [4.2136 3.5951 3.4598 3.3372 3.2779 3.161 ] QKtrace 4.237 OVnorm 17.7221 bias_key/query_norm [5.9578 7.4963]
L2H2 QKnorm 12.9062 QKsv [4.8575 4.024  3.2103 2.5372 2.3832 2.2932] QKtrace -8.8427 OVnorm 20.5752 bias_key/query_norm [ 6.0447 12.5128]
L2H3 QKnorm 16.6966 QKsv [4.4958 4.2052 3.9324 3.5228 3.2925 3.1557] QKtrace -5.9051 OVnorm 17.5062 bias_key/query_norm [11.702  11.0247]
L2H4 QKnorm 18.7551 QKsv [5.0228 4.8342 4.2578 4.0652 3.7358 3.6109] QKtrace -3.8054 OVnorm 16.624 bias_key/query_norm [12.6211 13.1065]
L2H5 QKnorm 18.0092 QKsv [5.1073 4.3177 3.95   3.8098 3.7436 3.615 ] QKtrace -5.578 OVnorm 16.6842 bias_key/query_norm [12.0719 11.6318]

LAYER 3 (gain-weighted matrices; no LayerNorm evaluation)
L3H0 QKnorm 17.8612 QKsv [3.6121 3.3594 3.345  3.2422 3.2067 3.1565] QKtrace 27.2957 OVnorm 22.5984 bias_key/query_norm [2.0652 2.089 ]
L3H1 QKnorm 14.6476 QKsv [2.6208 2.5393 2.4737 2.4472 2.4061 2.3836] QKtrace 50.449 OVnorm 40.8686 bias_key/query_norm [1.9323 1.0931]
L3H2 QKnorm 12.0463 QKsv [3.7667 3.2887 2.8452 2.6572 2.4694 2.3229] QKtrace 1.7643 OVnorm 26.8815 bias_key/query_norm [2.3165 2.2163]
L3H3 QKnorm 12.7936 QKsv [3.9788 3.2199 2.6861 2.4313 2.3645 2.3594] QKtrace 0.8934 OVnorm 27.4312 bias_key/query_norm [2.8828 2.4488]
L3H4 QKnorm 14.8484 QKsv [4.2301 3.3    3.1849 2.9889 2.8823 2.6888] QKtrace 7.2288 OVnorm 24.1979 bias_key/query_norm [2.4576 2.0855]
L3H5 QKnorm 6.679 QKsv [2.075  1.8792 1.6976 1.57   1.5251 1.2757] QKtrace 0.7931 OVnorm 45.4008 bias_key/query_norm [1.3167 0.7099]

Normalized trace(A_lh @ B_0j), columns L0H0..L0H5
L1H0 [ 0.0388  0.0163 -0.0054 -0.0187  0.032   0.0041]
L1H1 [ 0.0457  0.0329 -0.0001 -0.0143  0.0496  0.0187]
L1H2 [ 0.0497  0.0415  0.0145 -0.0059  0.054   0.0222]
L1H3 [ 0.0584  0.0467  0.0147 -0.0099  0.0601  0.0281]
L1H4 [ 0.0796  0.0707  0.0133 -0.0046  0.0839  0.0459]
L1H5 [ 0.0386  0.0174  0.0059 -0.0139  0.0363 -0.0111]
L2H0 [ 0.0156  0.0124 -0.005  -0.0182  0.0183  0.0159]
L2H1 [ 0.0098  0.0065 -0.0056 -0.0102  0.0104  0.0116]
L2H2 [ 0.0295  0.0238  0.001  -0.0173  0.0355  0.01  ]
L2H3 [ 0.0227  0.0162  0.0029 -0.012   0.023   0.0216]
L2H4 [ 0.0293  0.0219 -0.008  -0.0169  0.0299  0.021 ]
L2H5 [ 0.0222  0.0146  0.0003 -0.0172  0.0214  0.0168]
L3H0 [ 0.0046  0.0048 -0.0022 -0.0031  0.007   0.0069]
L3H1 [-0.0023 -0.0035  0.0949  0.001  -0.0052 -0.0028]
L3H2 [ 0.016   0.0102  0.003  -0.0059  0.0141  0.0221]
L3H3 [ 0.0104  0.0049  0.0012 -0.0018  0.0084  0.0144]
L3H4 [ 0.0196  0.0205 -0.0048 -0.0013  0.0227  0.0282]
L3H5 [-0.005  -0.0047  0.0025 -0.004  -0.0044 -0.003 ]

Largest earlier-head trace compositions (signed normalized trace)
L2H0 [(0.01831488054770177, 'L0H4'), (0.015886681026769052, 'L0H5'), (0.015608857494623197, 'L0H0'), (0.012367579270624375, 'L0H1'), (-0.004385075845198281, 'L1H1')]
L2H1 [(0.011626730747948765, 'L0H5'), (0.010425051990288375, 'L0H4'), (0.009803403048760628, 'L0H0'), (0.006525725144364843, 'L0H1'), (0.0030746091424649824, 'L1H3')]
L2H2 [(0.03548392181702849, 'L0H4'), (0.029485073254451613, 'L0H0'), (0.023778341440254248, 'L0H1'), (0.009965517460207657, 'L0H5'), (0.007742027119735287, 'L1H4')]
L2H3 [(0.023009692499583036, 'L0H4'), (0.022655398470314534, 'L0H0'), (0.02159495944098225, 'L0H5'), (0.016205740027523712, 'L0H1'), (0.002867347983306011, 'L0H2')]
L2H4 [(0.02986057570010887, 'L0H4'), (0.02925880246372659, 'L0H0'), (0.021926972741687572, 'L0H1'), (0.02098021741375207, 'L0H5'), (-0.002996000199168058, 'L1H3')]
L2H5 [(0.022163566772676495, 'L0H0'), (0.02137927166317656, 'L0H4'), (0.01679521007828187, 'L0H5'), (0.014566356586938216, 'L0H1'), (0.00035304827650425267, 'L1H2')]
L3H0 [(0.00703240691007632, 'L0H4'), (0.006910922145819949, 'L0H5'), (0.004752035137208596, 'L0H1'), (0.004570716642140448, 'L0H0'), (-0.002247146526228783, 'L0H2')]
L3H1 [(0.09486606986058785, 'L0H2'), (0.0811171357829096, 'L2H1'), (0.056764532759469445, 'L1H3'), (0.05549793736058776, 'L1H2'), (0.03612116030288871, 'L1H1')]
L3H2 [(0.02205580262173361, 'L0H5'), (0.016017133729234214, 'L0H0'), (0.014117851397887326, 'L0H4'), (0.010234078605252283, 'L0H1'), (0.0029527680839085435, 'L0H2')]
L3H3 [(0.014426395753234358, 'L0H5'), (0.010428059825454958, 'L0H0'), (0.008445143231364794, 'L0H4'), (0.004921340717805306, 'L0H1'), (0.0011732199754640239, 'L0H2')]
L3H4 [(0.028195028938726028, 'L0H5'), (0.022746228327328106, 'L0H4'), (0.020535542760585734, 'L0H1'), (0.019626760961869532, 'L0H0'), (0.0007146672776497601, 'L2H0')]
L3H5 [(0.01675224101706262, 'L2H3'), (0.01151727112046607, 'L2H1'), (0.0111474435163409, 'L1H0'), (0.011067087616306114, 'L2H4'), (0.01010903817591309, 'L2H2')]

L0H2 effective QK spectrum
singular values [11.3199 10.1995  9.7194  9.6486  9.272   8.7533  8.6907  8.1753  7.6461  7.3268  6.89    6.2532  5.8234  5.7713  4.1168  3.9356  3.4309  3.0088
  2.5751  2.3197  1.5122  1.3247  1.0256  0.9255  0.8764  0.7851  0.601   0.4484  0.394   0.3479  0.2969  0.2686  0.2412  0.2179  0.1933  0.1571
  0.156   0.1255  0.1161  0.1043]
largest eigenvalues [ 5.0575+6.5134j  5.0575-6.5134j -1.8401+7.4813j -1.8401-7.4813j  2.6658+7.0019j  2.6658-7.0019j -6.2304+2.6725j -6.2304-2.6725j -6.5315+0.j
  5.2072-3.2762j  5.2072+3.2762j  2.7023-4.0824j  2.7023+4.0824j  4.0955-0.1975j  4.0955+0.1975j  3.3297+0.j     -1.8666+1.9902j -1.8666-1.9902j
 -2.3481+1.0233j -2.3481-1.0233j  0.1685+1.0747j  0.1685-1.0747j -0.946 +0.j     -0.7171-0.0125j]
left/right top-20 subspace overlap [0.9877 0.9845 0.9797 0.975  0.9689 0.9672 0.9649 0.9539 0.9482 0.9435 0.9412 0.9304 0.9103 0.8837 0.8478 0.8088 0.7843 0.6577 0.541  0.3834]

L0 query/key and value subspace overlap with L0H2 dominant QK subspace
L0H0 [0.6828 0.3702 0.8338]
L0H1 [0.4909 0.3968 0.8247]
L0H2 [0.9601 0.971  0.3177]
L0H3 [0.6627 0.7298 0.3891]
L0H4 [0.5381 0.4254 0.7063]
L0H5 [0.6866 0.4371 0.8073]

```