OUTPUT of run 8 of at most 100: ``` L0 MLP substantial-weight neurons: 413 of 1536 Input-norm/output-norm correlation: 0.9611175807816661 RESIDUAL ROW SPECTRA AFTER REMOVING WEIGHT-DERIVED POSITION/WRITE DIRECTIONS No token identities are assumed; these are orthogonal matrix projections. posrank=32, prevrank=24, removedrank=68 F spectrum [16.3714 7.9638 6.8664 6.7152 6.4413 6.3209 6.028 5.9496 5.8348 5.8002 5.7713 5.6446 5.6111 5.3835 5.2814 5.1987 5.1542 5.0809 4.9779 4.8831 4.8232 4.7045 4.6009 4.5693 4.4541 4.4085 4.262 4.1424 4.0963 3.902 3.5697 3.2372 3.1985 3.0433 2.876 2.8055 2.7239 2.6233 2.5241 2.4904 2.4431 2.3608 2.3567 2.2086 2.2035] V spectrum [0.3836 0.3595 0.3338 0.3319 0.3126 0.3006 0.2958 0.2921 0.2725 0.2642 0.2523 0.2444 0.2403 0.2318 0.2297 0.2243 0.2218 0.2108 0.1949 0.1884 0.1822 0.169 0.153 0.146 0.1333 0.1322 0.124 0.1199 0.1104 0.1041 0.0989 0.0971 0.0936 0.0933 0.0887 0.0857 0.0809 0.0786 0.0765 0.0749] principal cosines between top-28 current/previous read spaces [0.8771 0.856 0.8377 0.8162 0.7984 0.7697 0.7268 0.7024 0.6794 0.6701 0.6304 0.6181 0.6151 0.5672 0.5538 0.5375 0.5089 0.4883 0.4788 0.4622 0.4262 0.3974 0.3261 0.2615 0.2417 0.161 0.0846 0.0233] posrank=32, prevrank=48, removedrank=92 F spectrum [15.4008 7.7148 6.7676 6.617 6.3349 6.2195 5.8863 5.8239 5.7411 5.7079 5.5929 5.54 5.4776 5.261 5.1876 5.0951 5.0629 4.9592 4.8608 4.8059 4.6825 4.6327 4.5339 4.5019 4.3896 4.3077 4.134 4.0281 3.9536 3.7022 3.3755 3.1422 3.0929 2.9269 2.7923 2.7097 2.6476 2.5242 2.4285 2.3966 2.3505 2.2621 2.2158 2.1621 2.1277] V spectrum [0.3683 0.3509 0.3223 0.3176 0.3063 0.2913 0.2897 0.285 0.2645 0.2563 0.2447 0.2363 0.2335 0.2281 0.2252 0.2156 0.2105 0.2027 0.1893 0.1819 0.1728 0.1622 0.1495 0.1339 0.1283 0.1227 0.1184 0.1129 0.1042 0.0982 0.0947 0.0942 0.0885 0.0871 0.083 0.0818 0.0785 0.0752 0.0731 0.0722] principal cosines between top-28 current/previous read spaces [0.8828 0.8664 0.8586 0.844 0.822 0.8028 0.7263 0.7115 0.7021 0.6861 0.6462 0.6335 0.632 0.595 0.5797 0.5516 0.5302 0.5189 0.489 0.4704 0.4328 0.3587 0.331 0.2785 0.2601 0.1578 0.1233 0.0035] posrank=64, prevrank=24, removedrank=100 F spectrum [15.871 7.2694 6.6665 6.3799 6.2806 6.0542 5.8796 5.7198 5.6865 5.6124 5.5581 5.4351 5.3719 5.2527 5.0907 5.0147 4.9406 4.8771 4.8232 4.6524 4.5273 4.4885 4.4377 4.3689 4.2772 4.2158 4.0526 3.9587 3.9402 3.7967 3.368 3.1353 3.0849 2.9057 2.8065 2.7211 2.637 2.5304 2.4707 2.4268 2.3826 2.2814 2.2634 2.14 2.1173] V spectrum [0.2999 0.2904 0.279 0.2628 0.2599 0.2574 0.2475 0.2336 0.2238 0.2154 0.2117 0.2012 0.197 0.193 0.1835 0.1771 0.1651 0.1618 0.1547 0.1379 0.1331 0.1213 0.1132 0.1067 0.1002 0.0971 0.0879 0.0853 0.084 0.0799 0.0757 0.0734 0.0709 0.0682 0.0651 0.0632 0.0625 0.0609 0.0583 0.0567] principal cosines between top-28 current/previous read spaces [0.8842 0.8702 0.8551 0.8415 0.8176 0.8059 0.7733 0.747 0.722 0.6946 0.6853 0.6685 0.6224 0.6031 0.5797 0.5595 0.5254 0.5095 0.4807 0.4205 0.3941 0.3695 0.3378 0.2715 0.2158 0.1279 0.0546 0.006 ] posrank=64, prevrank=48, removedrank=124 F spectrum [14.9706 7.0356 6.5165 6.2766 6.1428 5.9266 5.6821 5.6168 5.5929 5.4824 5.4387 5.3339 5.2119 5.0944 4.9521 4.92 4.7925 4.7731 4.6524 4.5596 4.4249 4.3942 4.3302 4.2489 4.1988 4.0836 3.924 3.8409 3.7556 3.5791 3.1291 3.015 2.9696 2.7675 2.7085 2.6021 2.5389 2.4706 2.3548 2.3205 2.2831 2.1965 2.1151 2.0735 2.0075] V spectrum [0.2883 0.2832 0.2742 0.2561 0.2536 0.2508 0.24 0.2217 0.216 0.2097 0.2054 0.1951 0.1897 0.1849 0.1755 0.1692 0.1589 0.1571 0.148 0.1281 0.1257 0.1177 0.1072 0.1021 0.0938 0.0927 0.0843 0.0814 0.077 0.0748 0.0716 0.0703 0.0686 0.0652 0.0628 0.0601 0.0585 0.0571 0.0548 0.0542] principal cosines between top-28 current/previous read spaces [0.9016 0.8812 0.8691 0.8579 0.8427 0.8244 0.7943 0.7345 0.7302 0.7189 0.6976 0.6719 0.6616 0.6509 0.6231 0.6023 0.5703 0.5206 0.4964 0.4638 0.4083 0.4042 0.3339 0.27 0.2314 0.1246 0.084 0.0333] posrank=96, prevrank=24, removedrank=132 F spectrum [14.8055 6.826 6.3299 6.1388 5.9858 5.7719 5.6631 5.5562 5.3892 5.3184 5.2628 5.1207 5.0086 4.7875 4.7518 4.7057 4.6312 4.4776 4.4652 4.3595 4.2894 4.1896 4.1356 3.9811 3.9365 3.7805 3.7046 3.5839 3.4785 3.2848 3.2313 2.9999 2.9346 2.7326 2.6832 2.5544 2.533 2.4139 2.3671 2.3314 2.2256 2.168 2.1232 2.0475 1.9686] V spectrum [0.2584 0.242 0.2287 0.2256 0.2127 0.1968 0.1962 0.1867 0.1796 0.1631 0.1601 0.157 0.1481 0.14 0.1292 0.1288 0.1225 0.1204 0.1175 0.1063 0.1 0.0935 0.0848 0.0837 0.0767 0.07 0.0686 0.0652 0.0641 0.0621 0.0589 0.0567 0.0554 0.0529 0.052 0.05 0.0478 0.0473 0.0464 0.0446] principal cosines between top-28 current/previous read spaces [0.883 0.8738 0.8613 0.8386 0.8221 0.7967 0.7613 0.7466 0.726 0.7033 0.6973 0.6766 0.6626 0.648 0.6148 0.5619 0.5357 0.5311 0.5154 0.4374 0.3936 0.3817 0.2598 0.2423 0.1638 0.1392 0.0528 0.0097] posrank=96, prevrank=48, removedrank=156 F spectrum [14.0375 6.5446 6.1611 6.0005 5.7795 5.6147 5.4951 5.3895 5.2956 5.2007 5.0815 4.9679 4.8584 4.6647 4.6275 4.5614 4.5146 4.3645 4.3208 4.2658 4.1048 4.0263 3.8846 3.7689 3.7176 3.6343 3.5805 3.4231 3.2931 3.18 2.9733 2.8699 2.8203 2.5631 2.5283 2.4171 2.3994 2.3314 2.2341 2.2096 2.1435 2.0514 2.0267 1.9361 1.8627] V spectrum [0.246 0.2378 0.2226 0.2173 0.203 0.1922 0.1859 0.1823 0.1728 0.158 0.1527 0.1481 0.1405 0.1319 0.1256 0.1237 0.1186 0.1135 0.1103 0.0993 0.0917 0.0885 0.0811 0.0788 0.0744 0.0672 0.0649 0.0622 0.0606 0.0587 0.056 0.0539 0.0521 0.0488 0.048 0.0472 0.0459 0.0446 0.0432 0.0429] principal cosines between top-28 current/previous read spaces [0.9039 0.8947 0.8687 0.8536 0.84 0.8027 0.7746 0.7595 0.744 0.7321 0.7153 0.6996 0.6834 0.6692 0.6214 0.6013 0.5761 0.5362 0.5224 0.4663 0.4228 0.4174 0.2799 0.2083 0.1889 0.1617 0.076 0.0716] ACTIVE MLP ROW SIMILARITIES nearest cosine percentiles [0.3449 0.5168 0.615 0.7556 0.9388 0.9725 0.9821 0.9873] ```