MLP ROW-DIRECTION ASSOCIATION, NOT NEURON ACTIVATIONS
rank 18 rows 516 association eigenvalues [-0.38  -0.331 -0.258 -0.228 -0.15  -0.123 -0.102 -0.049  0.021  0.048  0.129  0.172  0.249  0.29   0.323  0.352  0.509  0.586]
rank 22 rows 523 association eigenvalues [-0.474 -0.409 -0.356 -0.279 -0.238 -0.174 -0.133 -0.075 -0.023 -0.009  0.025  0.059  0.084  0.148  0.173  0.313  0.327  0.359  0.406  0.44   0.525  0.62 ]
rank 24 rows 524 association eigenvalues [-0.593 -0.481 -0.428 -0.365 -0.318 -0.204 -0.16  -0.105 -0.069 -0.02   0.002  0.037  0.045  0.145  0.163  0.262  0.299  0.317  0.351  0.365  0.458  0.476  0.529  0.67 ]
rank 27 rows 525 association eigenvalues [-0.613 -0.56  -0.529 -0.449 -0.354 -0.314 -0.238 -0.218 -0.158 -0.123 -0.075 -0.056  0.013  0.059  0.083  0.154  0.204  0.244  0.28   0.321  0.355  0.386  0.431  0.49   0.511
  0.562  0.688]
rank 32 rows 527 association eigenvalues [-0.727 -0.662 -0.607 -0.567 -0.515 -0.452 -0.424 -0.368 -0.279 -0.234 -0.198 -0.18  -0.11  -0.091  0.025  0.055  0.081  0.126  0.157  0.205  0.224  0.278  0.316  0.349  0.423
  0.439  0.472  0.52   0.553  0.585  0.656  0.738]

INDEPENDENT CLUSTERINGS OF CURRENT/OV-PATH ROW DIRECTIONS
clusters 18 matched center cos quantiles [0.061 0.233 0.436 0.673 0.754] graph eigenvalues [-0.208 -0.167 -0.086 -0.066 -0.008 -0.006  0.029  0.075  0.093  0.119  0.159  0.18   0.206  0.232  0.275  0.277  0.353  1.   ]
cluster counts [18 21 22 22 24 25 26 26 26 27 32 34 34 34 35 37 40 42]
clusters 22 matched center cos quantiles [0.068 0.273 0.495 0.632 0.83 ] graph eigenvalues [-0.301 -0.157 -0.135 -0.098 -0.085 -0.024  0.002  0.052  0.068  0.086  0.096  0.128  0.17   0.199  0.223  0.235  0.273  0.287  0.319  0.392  0.422  1.   ]
cluster counts [14 14 16 16 20 21 21 21 22 22 22 22 23 24 26 27 27 29 30 31 34 43]
clusters 24 matched center cos quantiles [0.027 0.281 0.562 0.628 0.815] graph eigenvalues [-0.274 -0.232 -0.178 -0.153 -0.129 -0.086 -0.07  -0.021 -0.001  0.026  0.043  0.096  0.11   0.121  0.156  0.193  0.206  0.257  0.274  0.285  0.351  0.384  0.413  1.   ]
cluster counts [10 11 12 12 14 15 16 18 19 20 21 21 23 24 25 25 25 26 27 27 30 30 36 38]
24-cluster association table (unlabelled weight directions):
[[1 1 0 0 0 0 0 0 0 1 1 1 0 0 3 0 0 1 0 0 0 1 0 0]
 [0 4 2 0 2 0 0 1 5 0 0 2 1 1 2 2 0 1 0 2 1 1 0 0]
 [0 2 1 0 0 1 3 1 1 0 0 1 4 3 0 0 3 1 2 3 1 0 1 2]
 [1 0 0 2 3 0 1 0 1 1 2 2 1 0 3 2 0 1 1 1 1 1 2 0]
 [9 1 1 1 0 1 0 1 0 1 2 1 0 0 0 0 0 1 2 0 1 0 1 2]
 [0 1 0 0 0 4 0 4 0 0 2 0 1 0 0 1 0 1 0 0 0 0 3 1]
 [0 1 0 0 0 0 4 0 0 0 1 0 0 0 1 0 0 0 2 2 0 0 0 0]
 [0 3 0 0 3 1 1 6 4 1 1 5 1 0 0 0 3 4 1 0 2 0 0 0]
 [0 1 1 2 0 0 0 0 5 1 3 2 0 0 1 0 3 0 0 1 1 0 0 0]
 [1 0 2 1 0 1 0 0 0 0 0 0 0 1 0 0 1 1 1 1 1 0 0 1]
 [3 1 1 0 0 0 2 0 1 0 1 3 0 2 0 1 1 4 0 1 1 4 1 0]
 [0 1 0 2 1 1 0 0 0 1 1 1 0 1 1 2 2 1 2 0 2 1 2 1]
 [1 1 1 3 1 2 1 1 1 0 1 1 2 2 1 4 3 1 0 3 1 4 1 2]
 [0 1 0 2 3 0 0 1 0 0 0 0 2 2 0 0 2 2 0 0 1 2 1 0]
 [1 0 2 0 3 0 1 1 0 0 2 0 1 1 5 1 0 0 2 1 1 1 1 0]
 [0 2 3 2 2 0 0 1 1 0 0 4 2 6 0 1 1 1 1 0 0 1 2 0]
 [0 0 0 0 0 1 0 2 1 6 0 0 0 1 1 1 1 0 1 0 0 0 0 0]
 [0 3 1 1 1 2 0 1 0 2 1 1 0 0 0 2 3 2 1 2 0 0 1 1]
 [1 0 0 1 0 0 0 0 0 0 1 1 3 0 0 1 1 0 3 2 1 0 1 0]
 [0 1 2 1 1 2 1 2 1 1 1 1 2 2 0 1 0 0 3 0 0 1 0 2]
 [1 3 0 1 3 1 1 1 1 2 0 0 1 1 0 0 2 0 0 1 0 0 0 1]
 [0 0 0 1 0 0 4 0 1 3 0 0 2 3 0 0 1 1 1 0 1 3 0 0]
 [0 1 1 1 0 1 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 1 6 2]
 [0 0 1 2 1 0 0 1 0 0 1 0 0 0 1 0 0 0 0 1 0 0 0 4]]
clusters 28 matched center cos quantiles [0.09  0.296 0.505 0.691 0.841] graph eigenvalues [-0.257 -0.188 -0.134 -0.114 -0.085 -0.076 -0.058 -0.017  0.006  0.031  0.052  0.065  0.106  0.125  0.165  0.176  0.212  0.248  0.255  0.267  0.283  0.308  0.35   0.37   0.398
  0.428  0.534  1.   ]
cluster counts [ 7  9 12 12 12 13 14 14 15 15 16 17 17 17 19 20 21 21 21 22 22 22 23 26 27 27 27 37]

L0H3 RAW QK COMPLEX MODES
angle, magnitude: [[0.6   0.819]
 [0.658 0.616]
 [0.679 0.45 ]
 [0.762 0.888]
 [0.763 1.001]
 [0.901 0.921]
 [0.917 0.761]
 [1.083 0.953]
 [1.428 0.77 ]
 [1.451 0.338]
 [1.573 0.607]
 [2.056 0.287]
 [2.196 0.436]
 [2.912 0.127]
 [2.913 0.155]]
