OUTPUT of run 5 of at most 100:
```
Output-side singular spectra; possible alphabet-sized bottlenecks:
W_proj 0 first 65 [10.931  7.576  6.628  6.293  6.166  5.924  5.886  5.768  5.706  5.61   5.495  5.462  5.404  5.313  5.193  5.161  5.119  5.07   5.003  4.937  4.877
  4.793  4.692  4.664  4.651  4.637  4.548  4.526  4.487  4.404  4.329  4.283  4.246  4.206  4.178  4.141  4.12   4.105  4.061  4.023  3.997  3.958
  3.934  3.904  3.857  3.85   3.797  3.758  3.709  3.694  3.668  3.622  3.618  3.591  3.573  3.516  3.476  3.445  3.421  3.387  3.363  3.343  3.335
  3.268  3.248]
largest early gaps (rank, ratio) [(1, 1.443), (2, 1.143), (3, 1.053), (5, 1.041), (77, 1.025), (14, 1.023), (72, 1.022), (22, 1.021)]
W_o 0 first 65 [6.676 5.235 2.834 2.679 2.619 2.581 2.549 2.515 2.503 2.477 2.449 2.443 2.424 2.404 2.365 2.361 2.319 2.291 2.269 2.259 2.243 2.217 2.2   2.196
 2.173 2.14  2.13  2.116 2.099 2.086 2.039 2.029 2.012 1.995 1.979 1.972 1.934 1.923 1.885 1.876 1.829 1.823 1.816 1.8   1.751 1.736 1.711 1.692
 1.654 1.642 1.613 1.608 1.589 1.572 1.551 1.536 1.498 1.483 1.474 1.437 1.415 1.384 1.358 1.355 1.346]
largest early gaps (rank, ratio) [(2, 1.847), (1, 1.275), (3, 1.058), (44, 1.028), (80, 1.028), (65, 1.027), (40, 1.026), (59, 1.025)]
W_proj 1 first 65 [7.625 7.359 6.907 6.489 6.344 6.223 6.192 6.02  5.949 5.902 5.82  5.756 5.728 5.692 5.674 5.65  5.633 5.608 5.581 5.567 5.544 5.523 5.479 5.457
 5.45  5.408 5.404 5.39  5.374 5.341 5.338 5.309 5.285 5.267 5.257 5.223 5.197 5.193 5.179 5.159 5.154 5.127 5.125 5.112 5.094 5.083 5.082 5.071
 5.055 5.045 5.022 5.014 5.007 4.985 4.975 4.958 4.944 4.929 4.923 4.908 4.894 4.885 4.878 4.863 4.848]
largest early gaps (rank, ratio) [(2, 1.065), (3, 1.064), (1, 1.036), (7, 1.029), (4, 1.023), (5, 1.019), (10, 1.014), (8, 1.012)]
W_o 1 first 65 [4.19  3.651 3.385 3.352 3.24  3.216 3.141 3.115 3.109 3.086 3.031 3.005 2.981 2.95  2.917 2.902 2.877 2.862 2.85  2.829 2.805 2.797 2.78  2.762
 2.723 2.71  2.704 2.691 2.678 2.661 2.656 2.651 2.624 2.612 2.61  2.575 2.559 2.534 2.527 2.52  2.506 2.491 2.472 2.448 2.438 2.428 2.417 2.388
 2.359 2.341 2.327 2.319 2.279 2.268 2.246 2.238 2.228 2.215 2.181 2.157 2.135 2.126 2.099 2.09  2.058]
largest early gaps (rank, ratio) [(1, 1.148), (2, 1.079), (4, 1.034), (6, 1.024), (74, 1.021), (10, 1.018), (52, 1.018), (64, 1.015)]
W_proj 2 first 65 [10.095  8.985  8.075  7.909  7.791  7.656  7.588  7.375  7.212  7.144  7.089  7.034  7.003  6.951  6.73   6.709  6.63   6.572  6.452  6.385  6.341
  6.321  6.252  6.207  6.087  6.     5.905  5.842  5.789  5.765  5.718  5.716  5.679  5.636  5.599  5.562  5.505  5.458  5.415  5.393  5.37   5.36
  5.305  5.281  5.267  5.252  5.238  5.213  5.172  5.164  5.141  5.106  5.081  5.078  5.052  5.037  5.024  5.003  4.989  4.968  4.947  4.943  4.935
  4.924  4.908]
largest early gaps (rank, ratio) [(1, 1.124), (2, 1.113), (14, 1.033), (7, 1.029), (8, 1.023), (3, 1.021), (24, 1.02), (18, 1.019)]
W_o 2 first 65 [4.442 4.073 3.768 3.455 3.44  3.365 3.35  3.297 3.254 3.233 3.178 3.174 3.165 3.149 3.122 3.11  3.08  3.052 3.047 3.012 2.997 2.988 2.971 2.959
 2.956 2.94  2.922 2.91  2.903 2.892 2.879 2.875 2.849 2.833 2.83  2.822 2.811 2.802 2.792 2.775 2.756 2.748 2.739 2.736 2.721 2.703 2.693 2.684
 2.682 2.668 2.667 2.647 2.632 2.63  2.613 2.608 2.599 2.595 2.578 2.576 2.557 2.553 2.534 2.52  2.512]
largest early gaps (rank, ratio) [(1, 1.091), (3, 1.09), (2, 1.081), (5, 1.022), (10, 1.017), (7, 1.016), (8, 1.013), (19, 1.011)]
W_proj 3 first 65 [28.175 20.293 19.292 19.135 18.708 18.57  18.139 17.776 17.484 16.54  15.913 15.61  14.975 14.872 14.417 14.313 13.327 12.971 12.593 12.37  12.224
 12.019 11.322 11.115 10.768  9.226  8.573  7.929  6.499  5.271  3.966  3.184  2.791  2.697  2.653  2.554  2.51   2.47   2.378  2.29   2.25   2.215
  2.117  2.081  2.035  2.01   1.984  1.969  1.951  1.926  1.888  1.868  1.851  1.833  1.816  1.795  1.791  1.781  1.763  1.735  1.721  1.712  1.704
  1.692  1.681]
largest early gaps (rank, ratio) [(1, 1.388), (30, 1.329), (31, 1.246), (29, 1.233), (28, 1.22), (25, 1.167), (32, 1.141), (27, 1.081)]
W_o 3 first 65 [9.173 6.63  4.442 4.111 4.054 4.04  4.006 3.975 3.959 3.942 3.877 3.859 3.845 3.81  3.791 3.775 3.76  3.753 3.713 3.7   3.648 3.64  3.615 3.606
 3.572 3.563 3.53  3.527 3.513 3.475 3.455 3.446 3.407 3.389 3.385 3.364 3.346 3.323 3.319 3.297 3.253 3.234 3.221 3.191 3.183 3.178 3.149 3.137
 3.12  3.087 3.074 3.062 3.048 3.035 3.014 2.981 2.978 2.949 2.933 2.901 2.896 2.88  2.859 2.848 2.831]
largest early gaps (rank, ratio) [(2, 1.493), (1, 1.384), (3, 1.081), (10, 1.017), (20, 1.014), (4, 1.014), (40, 1.014), (32, 1.012)]

Combined final-block outputs first 65 SVs [28.583 20.47  19.507 19.381 18.958 18.841 18.369 18.033 17.725 16.838 16.187 15.891 15.33  15.191 14.751 14.663 13.733 13.356 12.975 12.723 12.62
 12.373 11.68  11.568 11.239 10.383  9.596  8.97   8.36   6.522  5.305  4.821  4.647  4.479  4.455  4.367  4.295  4.207  4.084  4.002  3.977  3.915
  3.906  3.834  3.746  3.717  3.681  3.623  3.601  3.58   3.57   3.529  3.51   3.472  3.453  3.419  3.39   3.374  3.354  3.335  3.32   3.311  3.282
  3.279  3.25 ]

MLP weight-row norm distributions and low-norm fractions:
0 FC norms [0.33  0.371 0.394 0.437 1.766 2.393 3.213 4.287] Proj norms [0.127 0.174 0.201 0.263 1.71  2.098 2.672 3.366] FC < .6 0.635
1 FC norms [0.441 1.869 1.942 2.023 2.11  2.206 2.45  8.68 ] Proj norms [0.325 1.776 1.839 1.908 1.98  2.056 2.257 2.909] FC < .6 0.003
2 FC norms [1.678 1.933 1.979 2.024 2.073 2.121 2.209 2.731] Proj norms [1.597 1.837 1.899 1.965 2.048 2.12  2.25  2.85 ] FC < .6 0.0
3 FC norms [1.746 1.902 1.954 1.995 2.036 2.072 2.176 2.947] Proj norms [1.305 1.799 1.96  2.132 2.328 2.511 2.932 4.621] FC < .6 0.0

L0 positional-versus-value subspace separation:
QK input singular spectrum [5.682 4.22  2.647 2.597 2.532 2.414 2.342 2.272 2.202 2.166 2.134 2.056 2.02  1.963 1.931 1.871 1.813 1.794 1.745 1.683 1.591 1.53  1.473 1.436
 1.268 1.229 1.194 1.125 1.085 1.01  0.982 0.941 0.931 0.881 0.854 0.837 0.818 0.799 0.786 0.775 0.745 0.725 0.714 0.694 0.662 0.657 0.65  0.63
 0.629 0.606 0.589 0.587 0.564 0.559 0.554 0.542 0.539 0.535 0.524 0.514]
V input singular spectrum [3.195 2.304 1.316 0.88  0.809 0.771 0.73  0.704 0.685 0.662 0.638 0.629 0.623 0.621 0.604 0.595 0.582 0.567 0.554 0.55  0.542 0.541 0.522 0.513
 0.496 0.487 0.479 0.475 0.464 0.457 0.447 0.431 0.428 0.424 0.41  0.399 0.389 0.383 0.373 0.369 0.358 0.345 0.334 0.333 0.319 0.313 0.308 0.305
 0.302 0.3   0.295 0.292 0.286 0.281 0.278 0.275 0.27  0.265 0.263 0.258]
rank 2 subspace overlaps [0.974 0.8  ]
rank 4 subspace overlaps [0.984 0.937 0.185 0.064]
rank 8 subspace overlaps [0.986 0.947 0.626 0.335 0.166 0.09  0.051 0.005]
rank 16 subspace overlaps [0.99  0.971 0.851 0.535 0.309 0.292 0.262 0.236 0.21  0.148 0.146 0.1   0.086 0.065 0.029 0.005]
rank 24 subspace overlaps [0.992 0.979 0.906 0.691 0.498 0.452 0.396 0.364 0.321 0.294 0.272 0.244 0.232 0.194 0.179 0.162 0.129 0.122 0.089 0.078 0.069 0.048 0.025 0.01 ]
rank 28 subspace overlaps [0.993 0.985 0.948 0.886 0.664 0.559 0.527 0.5   0.452 0.439 0.35  0.3   0.295 0.275 0.261 0.237 0.201 0.177 0.163 0.142 0.121 0.115 0.102 0.089
 0.047 0.044 0.013 0.007]
rank 32 subspace overlaps [0.995 0.987 0.969 0.905 0.894 0.84  0.733 0.641 0.564 0.523 0.503 0.455 0.416 0.402 0.338 0.302 0.275 0.261 0.24  0.227 0.198 0.184 0.176 0.17
 0.145 0.134 0.102 0.095 0.071 0.061 0.036 0.008]
rank 48 subspace overlaps [0.998 0.995 0.986 0.977 0.976 0.97  0.968 0.963 0.962 0.957 0.954 0.947 0.943 0.933 0.931 0.921 0.909 0.906 0.902 0.889 0.873 0.869 0.84  0.799
 0.785 0.756 0.742 0.665 0.644 0.578 0.463 0.449 0.396 0.342 0.308 0.282 0.236 0.209 0.194 0.173 0.16  0.133 0.114 0.087 0.07  0.052 0.027 0.011]

```