OUTPUT of run 5 of at most 100: ``` MLP ROW-DIRECTION ASSOCIATION, NOT NEURON ACTIVATIONS rank 18 rows 516 association eigenvalues [-0.38 -0.331 -0.258 -0.228 -0.15 -0.123 -0.102 -0.049 0.021 0.048 0.129 0.172 0.249 0.29 0.323 0.352 0.509 0.586] rank 22 rows 523 association eigenvalues [-0.474 -0.409 -0.356 -0.279 -0.238 -0.174 -0.133 -0.075 -0.023 -0.009 0.025 0.059 0.084 0.148 0.173 0.313 0.327 0.359 0.406 0.44 0.525 0.62 ] rank 24 rows 524 association eigenvalues [-0.593 -0.481 -0.428 -0.365 -0.318 -0.204 -0.16 -0.105 -0.069 -0.02 0.002 0.037 0.045 0.145 0.163 0.262 0.299 0.317 0.351 0.365 0.458 0.476 0.529 0.67 ] rank 27 rows 525 association eigenvalues [-0.613 -0.56 -0.529 -0.449 -0.354 -0.314 -0.238 -0.218 -0.158 -0.123 -0.075 -0.056 0.013 0.059 0.083 0.154 0.204 0.244 0.28 0.321 0.355 0.386 0.431 0.49 0.511 0.562 0.688] rank 32 rows 527 association eigenvalues [-0.727 -0.662 -0.607 -0.567 -0.515 -0.452 -0.424 -0.368 -0.279 -0.234 -0.198 -0.18 -0.11 -0.091 0.025 0.055 0.081 0.126 0.157 0.205 0.224 0.278 0.316 0.349 0.423 0.439 0.472 0.52 0.553 0.585 0.656 0.738] INDEPENDENT CLUSTERINGS OF CURRENT/OV-PATH ROW DIRECTIONS clusters 18 matched center cos quantiles [0.061 0.233 0.436 0.673 0.754] graph eigenvalues [-0.208 -0.167 -0.086 -0.066 -0.008 -0.006 0.029 0.075 0.093 0.119 0.159 0.18 0.206 0.232 0.275 0.277 0.353 1. ] cluster counts [18 21 22 22 24 25 26 26 26 27 32 34 34 34 35 37 40 42] clusters 22 matched center cos quantiles [0.068 0.273 0.495 0.632 0.83 ] graph eigenvalues [-0.301 -0.157 -0.135 -0.098 -0.085 -0.024 0.002 0.052 0.068 0.086 0.096 0.128 0.17 0.199 0.223 0.235 0.273 0.287 0.319 0.392 0.422 1. ] cluster counts [14 14 16 16 20 21 21 21 22 22 22 22 23 24 26 27 27 29 30 31 34 43] clusters 24 matched center cos quantiles [0.027 0.281 0.562 0.628 0.815] graph eigenvalues [-0.274 -0.232 -0.178 -0.153 -0.129 -0.086 -0.07 -0.021 -0.001 0.026 0.043 0.096 0.11 0.121 0.156 0.193 0.206 0.257 0.274 0.285 0.351 0.384 0.413 1. ] cluster counts [10 11 12 12 14 15 16 18 19 20 21 21 23 24 25 25 25 26 27 27 30 30 36 38] 24-cluster association table (unlabelled weight directions): [[1 1 0 0 0 0 0 0 0 1 1 1 0 0 3 0 0 1 0 0 0 1 0 0] [0 4 2 0 2 0 0 1 5 0 0 2 1 1 2 2 0 1 0 2 1 1 0 0] [0 2 1 0 0 1 3 1 1 0 0 1 4 3 0 0 3 1 2 3 1 0 1 2] [1 0 0 2 3 0 1 0 1 1 2 2 1 0 3 2 0 1 1 1 1 1 2 0] [9 1 1 1 0 1 0 1 0 1 2 1 0 0 0 0 0 1 2 0 1 0 1 2] [0 1 0 0 0 4 0 4 0 0 2 0 1 0 0 1 0 1 0 0 0 0 3 1] [0 1 0 0 0 0 4 0 0 0 1 0 0 0 1 0 0 0 2 2 0 0 0 0] [0 3 0 0 3 1 1 6 4 1 1 5 1 0 0 0 3 4 1 0 2 0 0 0] [0 1 1 2 0 0 0 0 5 1 3 2 0 0 1 0 3 0 0 1 1 0 0 0] [1 0 2 1 0 1 0 0 0 0 0 0 0 1 0 0 1 1 1 1 1 0 0 1] [3 1 1 0 0 0 2 0 1 0 1 3 0 2 0 1 1 4 0 1 1 4 1 0] [0 1 0 2 1 1 0 0 0 1 1 1 0 1 1 2 2 1 2 0 2 1 2 1] [1 1 1 3 1 2 1 1 1 0 1 1 2 2 1 4 3 1 0 3 1 4 1 2] [0 1 0 2 3 0 0 1 0 0 0 0 2 2 0 0 2 2 0 0 1 2 1 0] [1 0 2 0 3 0 1 1 0 0 2 0 1 1 5 1 0 0 2 1 1 1 1 0] [0 2 3 2 2 0 0 1 1 0 0 4 2 6 0 1 1 1 1 0 0 1 2 0] [0 0 0 0 0 1 0 2 1 6 0 0 0 1 1 1 1 0 1 0 0 0 0 0] [0 3 1 1 1 2 0 1 0 2 1 1 0 0 0 2 3 2 1 2 0 0 1 1] [1 0 0 1 0 0 0 0 0 0 1 1 3 0 0 1 1 0 3 2 1 0 1 0] [0 1 2 1 1 2 1 2 1 1 1 1 2 2 0 1 0 0 3 0 0 1 0 2] [1 3 0 1 3 1 1 1 1 2 0 0 1 1 0 0 2 0 0 1 0 0 0 1] [0 0 0 1 0 0 4 0 1 3 0 0 2 3 0 0 1 1 1 0 1 3 0 0] [0 1 1 1 0 1 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 1 6 2] [0 0 1 2 1 0 0 1 0 0 1 0 0 0 1 0 0 0 0 1 0 0 0 4]] clusters 28 matched center cos quantiles [0.09 0.296 0.505 0.691 0.841] graph eigenvalues [-0.257 -0.188 -0.134 -0.114 -0.085 -0.076 -0.058 -0.017 0.006 0.031 0.052 0.065 0.106 0.125 0.165 0.176 0.212 0.248 0.255 0.267 0.283 0.308 0.35 0.37 0.398 0.428 0.534 1. ] cluster counts [ 7 9 12 12 12 13 14 14 15 15 16 17 17 17 19 20 21 21 21 22 22 22 23 26 27 27 27 37] L0H3 RAW QK COMPLEX MODES angle, magnitude: [[0.6 0.819] [0.658 0.616] [0.679 0.45 ] [0.762 0.888] [0.763 1.001] [0.901 0.921] [0.917 0.761] [1.083 0.953] [1.428 0.77 ] [1.451 0.338] [1.573 0.607] [2.056 0.287] [2.196 0.436] [2.912 0.127] [2.913 0.155]] ```