OUTPUT of run 5 of at most 100: ``` L0H5 effective OV first 40 singular values: [1.059 1.044 0.96 0.948 0.909 0.899 0.855 0.836 0.817 0.77 0.753 0.731 0.709 0.676 0.656 0.646 0.604 0.552 0.533 0.454 0.42 0.346 0.332 0.307 0.299 0.292 0.274 0.259 0.237 0.227 0.223 0.216 0.211 0.2 0.189 0.184 0.167 0.153 0.135 0.125] MLP0 active row count: 518 MLP0 active rows restricted to value-read subspace: singular values: [7.422 6.091 5.646 5.175 4.919 4.62 4.555 4.487 4.348 4.284 4.107 3.976 3.947 3.822 3.782 3.724 3.596 3.441 3.248 3.185 2.986 2.693 2.22 1.809 1.556 1.257 1.095] Fraction of each active MLP0 row's energy in that subspace, quantiles: [0.02 0.055 0.096 0.191 0.289 0.433 0.66 ] MLP0 active token-read row directions k 8 silhouette 0.157 mean cohesion 0.571 sizes [119 88 87 84 44 36 32 28] k 16 silhouette 0.236 mean cohesion 0.661 sizes [80 58 51 39 33 29 28 27 27 26 25 22 21 19 19 14] k 20 silhouette 0.269 mean cohesion 0.688 sizes [73 37 33 31 30 27 27 25 25 24 22 21 20 20 19 19 18 18 16 13] k 24 silhouette 0.273 mean cohesion 0.716 sizes [65 33 33 32 24 23 22 21 21 21 20 19 19 18 18 17 17 17 16 14 14 13 13 8] k 28 silhouette 0.283 mean cohesion 0.736 sizes [47 27 26 26 25 24 24 23 21 19 18 17 17 17 16 16 15 15 15 14 13 13 13 13 12 12 10 10] cohesion by descending cluster size: [0.79 0.566 0.873 0.693 0.696 0.724 0.689 0.741 0.647 0.646 0.724 0.724 0.762 0.803 0.623 0.708 0.826 0.768 0.702 0.752 0.804 0.727 0.813 0.765 0.717 0.838 0.687 0.785] largest inter-center cosines: [0.81 0.81 0.522 0.501 0.451 0.451 0.439 0.421 0.396 0.396 0.392 0.38 0.321 0.301 0.301 0.285 0.282 0.269 0.265 0.26 0.251 0.249 0.215 0.203 0.203 0.188 0.181 0.174] k 32 silhouette 0.289 mean cohesion 0.747 sizes [47 26 24 24 24 22 22 21 21 18 17 17 17 16 15 15 14 13 13 13 13 13 11 11 11 10 10 9 9 9 7 6] MLP3 write-column directions k 8 silhouette 0.073 mean cohesion 0.418 sizes [253 227 226 204 197 178 147 104] k 16 silhouette 0.071 mean cohesion 0.473 sizes [155 123 117 113 101 100 97 95 95 89 87 83 74 73 70 64] k 20 silhouette 0.068 mean cohesion 0.491 sizes [134 106 95 85 85 82 80 78 77 75 74 70 67 65 65 63 60 59 59 57] k 24 silhouette 0.061 mean cohesion 0.504 sizes [107 82 76 72 72 69 69 65 65 64 63 62 62 61 60 60 60 59 58 55 54 50 48 43] k 28 silhouette 0.063 mean cohesion 0.519 sizes [84 82 79 67 66 65 61 60 60 60 58 58 58 54 52 50 48 47 47 46 46 43 43 43 41 40 40 38] cohesion by descending cluster size: [0.69 0.523 0.473 0.519 0.507 0.495 0.49 0.508 0.669 0.481 0.528 0.526 0.523 0.506 0.482 0.465 0.536 0.611 0.537 0.479 0.5 0.544 0.516 0.477 0.474 0.519 0.475 0.483] largest inter-center cosines: [0.746 0.746 0.657 0.57 0.57 0.536 0.493 0.493 0.459 0.435 0.413 0.412 0.385 0.385 0.376 0.368 0.368 0.353 0.347 0.341 0.341 0.339 0.336 0.316 0.302 0.297 0.293 0.257] k 32 silhouette 0.055 mean cohesion 0.53 sizes [71 61 58 57 56 54 53 53 52 52 52 51 50 50 50 48 48 48 48 46 45 45 44 43 42 41 41 40 40 36 34 27] ```