OUTPUT of run 4 of at most 100:
```
L0H2 FACTOR SPECTRA
Q [8.233 8.202 7.942 7.801 7.664 7.624 7.489 7.183 6.92  6.786 6.365 6.104 5.744 5.495 5.092 4.824 4.8   4.416 3.958 3.7   3.402 3.191 3.136 3.04  2.845 2.643 2.306 2.161 2.018
 2.01  1.859 1.738 1.662 1.565 1.498 1.468 1.326 1.293 1.284 1.201 1.14  1.108 1.061 0.98  0.931 0.898 0.865 0.834 0.826 0.754 0.729 0.708 0.691 0.67  0.625 0.587 0.565 0.544
 0.517 0.508 0.481 0.464 0.45  0.396]
K [7.599 7.397 7.284 6.871 6.777 6.611 6.43  6.399 6.334 6.079 5.956 5.883 5.427 5.25  4.905 4.723 4.603 4.177 3.971 3.88  3.538 3.233 2.909 2.851 2.638 2.418 2.12  2.106 1.957
 1.688 1.636 1.586 1.53  1.456 1.341 1.202 1.147 1.128 1.094 1.028 0.997 0.962 0.916 0.868 0.827 0.786 0.772 0.749 0.711 0.668 0.627 0.608 0.597 0.567 0.544 0.526 0.507 0.494
 0.479 0.451 0.438 0.391 0.389 0.364]
V [1.954 1.879 1.847 1.804 1.772 1.733 1.721 1.67  1.648 1.571 1.554 1.52  1.517 1.481 1.442 1.331 1.263 1.231 1.051 0.993 0.938 0.908 0.843 0.811 0.778 0.71  0.695 0.645 0.637
 0.599 0.575 0.565 0.548 0.534 0.526 0.505 0.488 0.477 0.456 0.435 0.427 0.409 0.395 0.382 0.371 0.362 0.35  0.344 0.334 0.323 0.319 0.314 0.302 0.298 0.296 0.284 0.281 0.272
 0.265 0.26  0.259 0.25  0.236 0.23 ]
O [2.254 2.161 2.127 2.101 2.052 2.007 1.972 1.96  1.893 1.855 1.8   1.782 1.708 1.668 1.631 1.542 1.509 1.402 1.263 1.209 1.127 1.112 1.04  1.015 0.957 0.941 0.873 0.844 0.819
 0.748 0.702 0.684 0.646 0.626 0.581 0.515 0.471 0.464 0.414 0.405 0.38  0.351 0.333 0.304 0.287 0.267 0.262 0.23  0.213 0.192 0.186 0.176 0.166 0.151 0.142 0.14  0.13  0.126
 0.121 0.112 0.106 0.098 0.089 0.078]

LATE PROJECTION SPECTRA
layer 0 top 50 [9.826 7.351 6.265 5.869 5.797 5.657 5.516 5.45  5.333 5.242 5.197 5.094 4.98  4.904 4.863 4.819 4.793 4.689 4.627 4.595 4.557 4.523 4.411 4.378 4.283 4.216 4.143 4.125 4.048
 4.025 3.894 3.847 3.808 3.792 3.764 3.711 3.685 3.636 3.595 3.525 3.499 3.479 3.469 3.422 3.39  3.359 3.336 3.319 3.278 3.257] energy top 16/24/28/32/64/128 [0.359 0.467 0.513 0.553 0.781 0.944]
layer 1 top 50 [8.193 7.894 7.199 6.997 6.671 6.433 6.274 6.133 6.099 6.021 5.942 5.865 5.829 5.789 5.698 5.675 5.646 5.629 5.581 5.564 5.553 5.538 5.528 5.477 5.456 5.447 5.438 5.403 5.399
 5.38  5.367 5.351 5.332 5.327 5.314 5.296 5.252 5.235 5.219 5.208 5.197 5.183 5.174 5.17  5.146 5.132 5.118 5.111 5.079 5.067] energy top 16/24/28/32/64/128 [0.117 0.16  0.18  0.201 0.346 0.576]
layer 2 top 50 [9.404 9.187 8.723 8.47  8.04  7.795 7.614 7.45  7.392 7.253 7.223 7.148 7.082 6.972 6.829 6.733 6.637 6.547 6.46  6.404 6.374 6.307 6.209 6.181 6.12  6.091 5.989 5.9   5.88
 5.833 5.758 5.703 5.685 5.645 5.588 5.559 5.491 5.478 5.467 5.429 5.406 5.4   5.378 5.351 5.335 5.295 5.246 5.234 5.196 5.194] energy top 16/24/28/32/64/128 [0.163 0.218 0.243 0.265 0.415 0.632]
layer 3 top 50 [26.309 20.685 19.699 19.261 18.594 18.197 17.862 17.667 17.044 16.749 16.039 15.151 14.756 14.326 14.05  13.5   13.293 12.531 12.401 11.958 11.74  11.594 10.367  8.351  8.064
  7.914  7.461  7.166  5.833  4.072  3.221  3.139  2.842  2.8    2.687  2.571  2.403  2.328  2.244  2.185  2.181  2.116  2.081  2.053  1.996  1.976  1.93   1.918  1.865  1.838] energy top 16/24/28/32/64/128 [0.743 0.903 0.937 0.948 0.967 0.983]

L0 EFFECTIVE MLP INPUT VS EARLY VALUE SUBSPACES
F spectrum [17.903 10.353  7.602  7.51   7.11   6.834  6.74   6.432  6.363  6.22   6.139  6.05   6.015  5.936  5.794  5.626  5.575  5.499  5.421  5.309  5.301  5.117  5.076  4.966  4.945
  4.84   4.814  4.73   4.562  4.559  4.484  4.346  4.149  4.084  4.052  3.912  3.822  3.766  3.706  3.527  3.476  3.411  3.338  3.291  3.237  3.206  3.058  2.967  2.94   2.816]
F @ B02 spectrum [3.742 2.715 2.602 2.407 2.33  1.984 1.953 1.904 1.774 1.624 1.61  1.404 1.328 1.291 1.192 1.158 1.063 0.888 0.697 0.486 0.41  0.374 0.35  0.304 0.264 0.243 0.226 0.199 0.191
 0.181 0.156 0.144 0.129 0.114 0.106 0.093 0.083 0.071 0.063 0.055 0.049 0.047 0.04  0.034 0.031 0.028 0.027 0.021 0.019 0.018]

L0 MLP ROW COSINE CLUSTERING (weight directions, not activations)
F nearest cosine quantiles [0.448 0.785 0.831 0.862 0.887 0.923 0.999]
F clusters 16 inertia 610.18 counts [273 241 239 203 192  70  62  56  40  37  29  21  21  19  18  15]
F clusters 20 inertia 592.89 counts [179 176 175 169 135 116 113  99  90  48  44  38  32  31  21  17  16  13  13  11]
F clusters 24 inertia 574.21 counts [151 141 138 138 132 132 118 118  82  75  63  62  31  23  21  17  15  13  13  12  11  11  10   9]
F clusters 28 inertia 549.29 counts [158 139 130 128 127 122 118 114 106  76  38  31  26  24  23  20  18  16  15  14  14  14  13  12  11  11   9   9]
F clusters 32 inertia 534.21 counts [121 120 118 117 110 108 101  98  91  83  78  77  41  28  25  23  19  19  17  15  15  14  14  12  11  11  11   9   9   7   7   7]
F_B02 nearest cosine quantiles [0.5   0.648 0.691 0.743 0.789 0.853 0.993]
F_B02 clusters 16 inertia 977.39 counts [118 112 111 106 104 103  97  97  97  96  94  90  89  77  75  70]
F_B02 clusters 20 inertia 948.65 counts [109 107 106  99  97  97  87  82  76  76  73  70  69  65  62  54  54  53  52  48]
F_B02 clusters 24 inertia 920.92 counts [107 103  91  90  82  73  64  64  63  63  61  61  60  59  57  56  53  52  51  50  47  47  42  40]
F_B02 clusters 28 inertia 900.91 counts [93 87 74 70 68 67 64 63 62 61 58 55 54 53 52 51 51 51 49 49 46 43 40 38 37 35 34 31]
F_B02 clusters 32 inertia 884.99 counts [74 66 66 64 62 55 55 54 53 52 52 52 50 49 49 49 48 48 45 43 42 42 42 41 40 39 38 37 35 35 33 26]

SHARED LOW-RANK L1 QK STRUCTURE
QK cosines
 [[1.    0.578 0.416 0.448 0.455 0.464]
 [0.578 1.    0.55  0.488 0.556 0.528]
 [0.416 0.55  1.    0.608 0.667 0.564]
 [0.448 0.488 0.608 1.    0.644 0.563]
 [0.455 0.556 0.667 0.644 1.    0.577]
 [0.464 0.528 0.564 0.563 0.577 1.   ]]
key-bias cosines
 [[1.    0.967 0.961 0.961 0.945 0.959]
 [0.967 1.    0.976 0.963 0.967 0.962]
 [0.961 0.976 1.    0.969 0.971 0.966]
 [0.961 0.963 0.969 1.    0.964 0.967]
 [0.945 0.967 0.971 0.964 1.    0.972]
 [0.959 0.962 0.966 0.967 0.972 1.   ]]

```