OUTPUT of run 8 of at most 100:
```
L0 MLP substantial-weight neurons: 413 of 1536
Input-norm/output-norm correlation: 0.9611175807816661

RESIDUAL ROW SPECTRA AFTER REMOVING WEIGHT-DERIVED POSITION/WRITE DIRECTIONS
No token identities are assumed; these are orthogonal matrix projections.
posrank=32, prevrank=24, removedrank=68
F spectrum [16.3714  7.9638  6.8664  6.7152  6.4413  6.3209  6.028   5.9496  5.8348  5.8002  5.7713  5.6446  5.6111  5.3835  5.2814  5.1987  5.1542  5.0809  4.9779  4.8831  4.8232  4.7045
  4.6009  4.5693  4.4541  4.4085  4.262   4.1424  4.0963  3.902   3.5697  3.2372  3.1985  3.0433  2.876   2.8055  2.7239  2.6233  2.5241  2.4904  2.4431  2.3608  2.3567  2.2086
  2.2035]
V spectrum [0.3836 0.3595 0.3338 0.3319 0.3126 0.3006 0.2958 0.2921 0.2725 0.2642 0.2523 0.2444 0.2403 0.2318 0.2297 0.2243 0.2218 0.2108 0.1949 0.1884 0.1822 0.169  0.153  0.146  0.1333
 0.1322 0.124  0.1199 0.1104 0.1041 0.0989 0.0971 0.0936 0.0933 0.0887 0.0857 0.0809 0.0786 0.0765 0.0749]
principal cosines between top-28 current/previous read spaces [0.8771 0.856  0.8377 0.8162 0.7984 0.7697 0.7268 0.7024 0.6794 0.6701 0.6304 0.6181 0.6151 0.5672 0.5538 0.5375 0.5089 0.4883 0.4788 0.4622 0.4262 0.3974 0.3261 0.2615 0.2417
 0.161  0.0846 0.0233]
posrank=32, prevrank=48, removedrank=92
F spectrum [15.4008  7.7148  6.7676  6.617   6.3349  6.2195  5.8863  5.8239  5.7411  5.7079  5.5929  5.54    5.4776  5.261   5.1876  5.0951  5.0629  4.9592  4.8608  4.8059  4.6825  4.6327
  4.5339  4.5019  4.3896  4.3077  4.134   4.0281  3.9536  3.7022  3.3755  3.1422  3.0929  2.9269  2.7923  2.7097  2.6476  2.5242  2.4285  2.3966  2.3505  2.2621  2.2158  2.1621
  2.1277]
V spectrum [0.3683 0.3509 0.3223 0.3176 0.3063 0.2913 0.2897 0.285  0.2645 0.2563 0.2447 0.2363 0.2335 0.2281 0.2252 0.2156 0.2105 0.2027 0.1893 0.1819 0.1728 0.1622 0.1495 0.1339 0.1283
 0.1227 0.1184 0.1129 0.1042 0.0982 0.0947 0.0942 0.0885 0.0871 0.083  0.0818 0.0785 0.0752 0.0731 0.0722]
principal cosines between top-28 current/previous read spaces [0.8828 0.8664 0.8586 0.844  0.822  0.8028 0.7263 0.7115 0.7021 0.6861 0.6462 0.6335 0.632  0.595  0.5797 0.5516 0.5302 0.5189 0.489  0.4704 0.4328 0.3587 0.331  0.2785 0.2601
 0.1578 0.1233 0.0035]
posrank=64, prevrank=24, removedrank=100
F spectrum [15.871   7.2694  6.6665  6.3799  6.2806  6.0542  5.8796  5.7198  5.6865  5.6124  5.5581  5.4351  5.3719  5.2527  5.0907  5.0147  4.9406  4.8771  4.8232  4.6524  4.5273  4.4885
  4.4377  4.3689  4.2772  4.2158  4.0526  3.9587  3.9402  3.7967  3.368   3.1353  3.0849  2.9057  2.8065  2.7211  2.637   2.5304  2.4707  2.4268  2.3826  2.2814  2.2634  2.14
  2.1173]
V spectrum [0.2999 0.2904 0.279  0.2628 0.2599 0.2574 0.2475 0.2336 0.2238 0.2154 0.2117 0.2012 0.197  0.193  0.1835 0.1771 0.1651 0.1618 0.1547 0.1379 0.1331 0.1213 0.1132 0.1067 0.1002
 0.0971 0.0879 0.0853 0.084  0.0799 0.0757 0.0734 0.0709 0.0682 0.0651 0.0632 0.0625 0.0609 0.0583 0.0567]
principal cosines between top-28 current/previous read spaces [0.8842 0.8702 0.8551 0.8415 0.8176 0.8059 0.7733 0.747  0.722  0.6946 0.6853 0.6685 0.6224 0.6031 0.5797 0.5595 0.5254 0.5095 0.4807 0.4205 0.3941 0.3695 0.3378 0.2715 0.2158
 0.1279 0.0546 0.006 ]
posrank=64, prevrank=48, removedrank=124
F spectrum [14.9706  7.0356  6.5165  6.2766  6.1428  5.9266  5.6821  5.6168  5.5929  5.4824  5.4387  5.3339  5.2119  5.0944  4.9521  4.92    4.7925  4.7731  4.6524  4.5596  4.4249  4.3942
  4.3302  4.2489  4.1988  4.0836  3.924   3.8409  3.7556  3.5791  3.1291  3.015   2.9696  2.7675  2.7085  2.6021  2.5389  2.4706  2.3548  2.3205  2.2831  2.1965  2.1151  2.0735
  2.0075]
V spectrum [0.2883 0.2832 0.2742 0.2561 0.2536 0.2508 0.24   0.2217 0.216  0.2097 0.2054 0.1951 0.1897 0.1849 0.1755 0.1692 0.1589 0.1571 0.148  0.1281 0.1257 0.1177 0.1072 0.1021 0.0938
 0.0927 0.0843 0.0814 0.077  0.0748 0.0716 0.0703 0.0686 0.0652 0.0628 0.0601 0.0585 0.0571 0.0548 0.0542]
principal cosines between top-28 current/previous read spaces [0.9016 0.8812 0.8691 0.8579 0.8427 0.8244 0.7943 0.7345 0.7302 0.7189 0.6976 0.6719 0.6616 0.6509 0.6231 0.6023 0.5703 0.5206 0.4964 0.4638 0.4083 0.4042 0.3339 0.27   0.2314
 0.1246 0.084  0.0333]
posrank=96, prevrank=24, removedrank=132
F spectrum [14.8055  6.826   6.3299  6.1388  5.9858  5.7719  5.6631  5.5562  5.3892  5.3184  5.2628  5.1207  5.0086  4.7875  4.7518  4.7057  4.6312  4.4776  4.4652  4.3595  4.2894  4.1896
  4.1356  3.9811  3.9365  3.7805  3.7046  3.5839  3.4785  3.2848  3.2313  2.9999  2.9346  2.7326  2.6832  2.5544  2.533   2.4139  2.3671  2.3314  2.2256  2.168   2.1232  2.0475
  1.9686]
V spectrum [0.2584 0.242  0.2287 0.2256 0.2127 0.1968 0.1962 0.1867 0.1796 0.1631 0.1601 0.157  0.1481 0.14   0.1292 0.1288 0.1225 0.1204 0.1175 0.1063 0.1    0.0935 0.0848 0.0837 0.0767
 0.07   0.0686 0.0652 0.0641 0.0621 0.0589 0.0567 0.0554 0.0529 0.052  0.05   0.0478 0.0473 0.0464 0.0446]
principal cosines between top-28 current/previous read spaces [0.883  0.8738 0.8613 0.8386 0.8221 0.7967 0.7613 0.7466 0.726  0.7033 0.6973 0.6766 0.6626 0.648  0.6148 0.5619 0.5357 0.5311 0.5154 0.4374 0.3936 0.3817 0.2598 0.2423 0.1638
 0.1392 0.0528 0.0097]
posrank=96, prevrank=48, removedrank=156
F spectrum [14.0375  6.5446  6.1611  6.0005  5.7795  5.6147  5.4951  5.3895  5.2956  5.2007  5.0815  4.9679  4.8584  4.6647  4.6275  4.5614  4.5146  4.3645  4.3208  4.2658  4.1048  4.0263
  3.8846  3.7689  3.7176  3.6343  3.5805  3.4231  3.2931  3.18    2.9733  2.8699  2.8203  2.5631  2.5283  2.4171  2.3994  2.3314  2.2341  2.2096  2.1435  2.0514  2.0267  1.9361
  1.8627]
V spectrum [0.246  0.2378 0.2226 0.2173 0.203  0.1922 0.1859 0.1823 0.1728 0.158  0.1527 0.1481 0.1405 0.1319 0.1256 0.1237 0.1186 0.1135 0.1103 0.0993 0.0917 0.0885 0.0811 0.0788 0.0744
 0.0672 0.0649 0.0622 0.0606 0.0587 0.056  0.0539 0.0521 0.0488 0.048  0.0472 0.0459 0.0446 0.0432 0.0429]
principal cosines between top-28 current/previous read spaces [0.9039 0.8947 0.8687 0.8536 0.84   0.8027 0.7746 0.7595 0.744  0.7321 0.7153 0.6996 0.6834 0.6692 0.6214 0.6013 0.5761 0.5362 0.5224 0.4663 0.4228 0.4174 0.2799 0.2083 0.1889
 0.1617 0.076  0.0716]

ACTIVE MLP ROW SIMILARITIES
nearest cosine percentiles [0.3449 0.5168 0.615  0.7556 0.9388 0.9725 0.9821 0.9873]

```