Last-layer output singular spectra (indices start at 1)
W_proj.3
1 [28.461 22.214 21.34  20.708 19.943 19.662 18.986 18.744 18.295 17.457
 17.132 16.561 15.329 14.874 14.328 13.438 12.667 12.455 12.317 11.531]
21 [11.047  9.084  8.353  8.24   6.37   5.836  4.626  4.583  3.777  3.61
  3.252  3.183  3.086  2.941  2.865  2.801  2.639  2.564  2.538  2.466]
41 [2.419 2.404 2.346 2.31  2.246 2.227 2.155 2.147 2.089 2.069 2.065 2.041
 1.975 1.936 1.921 1.917 1.857 1.848 1.83  1.82 ]
61 [1.798 1.779 1.764 1.737 1.729 1.719 1.709 1.692 1.68  1.661 1.645 1.635
 1.619 1.594 1.589 1.583 1.565 1.55  1.541 1.52 ]
W_o.3
1 [10.477  7.357  5.323  5.294  5.177  5.124  5.049  4.959  4.775  4.751
  4.625  4.565  4.462  4.442  4.262  4.246  4.188  4.105  4.067  4.035]
21 [3.997 3.943 3.93  3.908 3.891 3.859 3.812 3.786 3.763 3.703 3.678 3.629
 3.61  3.577 3.535 3.519 3.48  3.461 3.423 3.409]
41 [3.378 3.356 3.293 3.263 3.23  3.219 3.206 3.18  3.146 3.13  3.116 3.082
 3.065 3.025 3.002 2.975 2.954 2.933 2.915 2.896]
61 [2.846 2.83  2.816 2.812 2.771 2.762 2.733 2.719 2.695 2.671 2.647 2.637
 2.62  2.598 2.588 2.556 2.529 2.52  2.5   2.483]
W_proj.0
1 [10.899  7.702  7.173  6.638  6.541  6.288  6.201  6.133  5.941  5.917
  5.758  5.641  5.552  5.476  5.393  5.363  5.259  5.206  5.171  5.153]
21 [5.057 5.018 4.96  4.88  4.821 4.788 4.77  4.73  4.643 4.579 4.546 4.529
 4.505 4.493 4.44  4.415 4.369 4.315 4.293 4.261]
41 [4.243 4.185 4.134 4.104 4.064 4.049 4.026 3.988 3.967 3.95  3.933 3.901
 3.857 3.804 3.778 3.754 3.74  3.713 3.692 3.683]
61 [3.652 3.612 3.607 3.575 3.564 3.522 3.509 3.497 3.47  3.456 3.446 3.417
 3.4   3.378 3.337 3.302 3.291 3.269 3.238 3.23 ]
Combined final output spectrum [28.906 22.386 21.536 20.936 20.117 19.852 19.175 18.933 18.5   17.69
 17.356 16.855 15.592 15.148 14.621 13.72  12.993 12.791 12.632 11.898
 11.629 10.964  9.897  8.83   8.583  7.096  6.654  6.012  5.627  5.54
  5.494  5.275  5.068  4.893  4.87   4.79   4.636  4.597  4.49   4.43
  4.388  4.347  4.331  4.268  4.176  4.148  4.097  4.043  3.974  3.919
  3.881  3.824  3.798  3.784  3.747  3.718  3.71   3.655  3.618  3.585
  3.569  3.558  3.513  3.49   3.465  3.437  3.421  3.385  3.356  3.33 ]
Adjacent spectral ratios [(np.int64(1), np.float64(1.291)), (np.int64(25), np.float64(1.209)), (np.int64(23), np.float64(1.121)), (np.int64(22), np.float64(1.108)), (np.int64(27), np.float64(1.107)), (np.int64(12), np.float64(1.081)), (np.int64(28), np.float64(1.068)), (np.int64(26), np.float64(1.067)), (np.int64(15), np.float64(1.066)), (np.int64(19), np.float64(1.062)), (np.int64(21), np.float64(1.061)), (np.int64(16), np.float64(1.056))]

L0 OV dominant input/output directions: largest coordinate loadings
H 0
0 in [(373, np.float64(0.176)), (225, np.float64(-0.163)), (134, np.float64(-0.158)), (158, np.float64(-0.154)), (7, np.float64(0.153)), (51, np.float64(0.149))] participation 102.5
0 out [(336, np.float64(0.193)), (96, np.float64(0.158)), (291, np.float64(-0.15)), (327, np.float64(0.149)), (203, np.float64(-0.14)), (202, np.float64(-0.128))] participation 116.1
1 in [(226, np.float64(-0.167)), (301, np.float64(0.152)), (358, np.float64(-0.147)), (21, np.float64(-0.146)), (220, np.float64(-0.132)), (325, np.float64(-0.131))] participation 114.5
1 out [(39, np.float64(-0.263)), (6, np.float64(-0.193)), (282, np.float64(0.186)), (156, np.float64(0.147)), (163, np.float64(0.137)), (152, np.float64(0.133))] participation 74.6
H 1
0 in [(184, np.float64(0.347)), (180, np.float64(0.315)), (99, np.float64(0.271)), (39, np.float64(0.267)), (56, np.float64(-0.254)), (317, np.float64(-0.239))] participation 19.1
0 out [(39, np.float64(0.692)), (58, np.float64(-0.51)), (99, np.float64(0.358)), (21, np.float64(-0.212)), (184, np.float64(0.201)), (153, np.float64(-0.054))] participation 3.1
1 in [(211, np.float64(0.34)), (223, np.float64(-0.262)), (228, np.float64(-0.244)), (65, np.float64(0.231)), (173, np.float64(-0.23)), (124, np.float64(-0.214))] participation 23.6
1 out [(21, np.float64(0.961)), (39, np.float64(0.158)), (58, np.float64(-0.129)), (184, np.float64(0.072)), (306, np.float64(-0.032)), (173, np.float64(-0.029))] participation 1.2
H 2
0 in [(184, np.float64(-0.365)), (180, np.float64(-0.304)), (99, np.float64(-0.298)), (317, np.float64(0.248)), (56, np.float64(0.234)), (39, np.float64(-0.231))] participation 18.5
0 out [(39, np.float64(-0.659)), (58, np.float64(0.494)), (21, np.float64(0.373)), (99, np.float64(-0.355)), (184, np.float64(-0.162)), (153, np.float64(0.045))] participation 3.5
1 in [(211, np.float64(0.3)), (173, np.float64(-0.273)), (223, np.float64(-0.256)), (162, np.float64(0.227)), (256, np.float64(-0.225)), (65, np.float64(0.222))] participation 26.1
1 out [(21, np.float64(0.91)), (39, np.float64(0.221)), (99, np.float64(0.207)), (58, np.float64(-0.201)), (184, np.float64(0.053)), (252, np.float64(-0.03))] participation 1.4
H 3
0 in [(223, np.float64(-0.225)), (26, np.float64(-0.196)), (200, np.float64(-0.17)), (48, np.float64(-0.167)), (359, np.float64(0.145)), (124, np.float64(0.142))] participation 77.7
0 out [(92, np.float64(-0.179)), (86, np.float64(0.169)), (188, np.float64(-0.162)), (18, np.float64(0.16)), (131, np.float64(0.158)), (303, np.float64(0.156))] participation 93.5
1 in [(200, np.float64(-0.229)), (124, np.float64(-0.181)), (53, np.float64(0.177)), (329, np.float64(-0.168)), (74, np.float64(0.167)), (105, np.float64(0.159))] participation 71.0
1 out [(65, np.float64(0.19)), (125, np.float64(0.179)), (320, np.float64(-0.173)), (202, np.float64(-0.168)), (86, np.float64(-0.157)), (287, np.float64(-0.152))] participation 89.9
H 4
0 in [(184, np.float64(-0.413)), (180, np.float64(-0.289)), (256, np.float64(0.28)), (56, np.float64(0.243)), (100, np.float64(0.236)), (69, np.float64(-0.225))] participation 16.5
0 out [(39, np.float64(-0.696)), (58, np.float64(0.511)), (99, np.float64(-0.32)), (184, np.float64(-0.227)), (21, np.float64(-0.182)), (153, np.float64(0.057))] participation 3.2
1 in [(211, np.float64(0.352)), (228, np.float64(-0.274)), (124, np.float64(-0.219)), (65, np.float64(0.219)), (26, np.float64(0.214)), (319, np.float64(0.212))] participation 24.5
1 out [(21, np.float64(0.942)), (99, np.float64(-0.24)), (39, np.float64(-0.097)), (58, np.float64(0.092)), (184, np.float64(0.042)), (148, np.float64(-0.033))] participation 1.3
H 5
0 in [(162, np.float64(-0.328)), (211, np.float64(-0.306)), (223, np.float64(0.278)), (65, np.float64(-0.235)), (354, np.float64(0.203)), (173, np.float64(0.201))] participation 22.4
0 out [(21, np.float64(-0.864)), (99, np.float64(-0.357)), (58, np.float64(0.236)), (39, np.float64(-0.232)), (184, np.float64(0.024)), (153, np.float64(0.019))] participation 1.7
1 in [(99, np.float64(-0.369)), (180, np.float64(-0.315)), (184, np.float64(-0.309)), (162, np.float64(-0.224)), (100, np.float64(0.209)), (317, np.float64(0.207))] participation 18.1
1 out [(39, np.float64(-0.608)), (58, np.float64(0.486)), (21, np.float64(0.469)), (99, np.float64(-0.405)), (180, np.float64(-0.036)), (165, np.float64(-0.026))] participation 3.7

Final output common-subspace concentration
rank 20 MLP projection energy L0..L3 [0.089 0.06  0.1   0.872]
rank 22 MLP projection energy L0..L3 [0.099 0.064 0.106 0.894]
rank 24 MLP projection energy L0..L3 [0.107 0.069 0.112 0.915]
rank 26 MLP projection energy L0..L3 [0.114 0.074 0.118 0.929]
rank 27 MLP projection energy L0..L3 [0.119 0.076 0.12  0.931]
rank 28 MLP projection energy L0..L3 [0.121 0.079 0.123 0.933]
rank 32 MLP projection energy L0..L3 [0.133 0.088 0.133 0.939]
rank 40 MLP projection energy L0..L3 [0.154 0.107 0.154 0.943]

Layer0 FC input spectrum, additional indices
1 [17.584 13.477 11.766 10.188  9.613  9.54   9.344  9.149  8.754  8.681
  8.593  8.39   8.008  7.926  7.84   7.731  7.517  7.386  7.159  7.084]
21 [7.068 6.915 6.889 6.682 6.631 6.491 6.436 6.354 6.307 6.16  6.003 5.909
 5.835 5.661 5.466 5.307 5.289 5.132 5.047 4.957]
41 [4.895 4.443 4.367 4.111 4.038 3.8   3.63  3.408 3.226 3.154 2.964 2.947
 2.817 2.635 2.605 2.501 2.481 2.393 2.351 2.276]
61 [2.201 2.148 2.136 2.101 2.066 2.047 1.993 1.957 1.89  1.858 1.85  1.833
 1.781 1.745 1.734 1.726 1.71  1.675 1.666 1.644]
81 [1.625 1.603 1.579 1.555 1.55  1.533 1.518 1.506 1.492 1.464 1.457 1.437
 1.428 1.414 1.404 1.398 1.381 1.374 1.372 1.362]
