OUTPUT of run 7 of at most 100: ``` L0H4 effective OV singular values: [13.877 9.644 2.507 0.968 0.594 0.554 0.483 0.433 0.345 0.295 0.28 0.228] Basis pair overlaps, normalized by smaller rank: ['uniform-head-write3', 'uniform-head-read3', 'H5-value-read27', 'H5-value-write27', 'L0-H1H5-QK-shared20'] [[1. 0.098 0.137 0.031 0.26 ] [0.098 1. 0.075 0.06 0.848] [0.137 0.075 1. 0.066 0.179] [0.031 0.06 0.066 1. 0.205] [0.26 0.848 0.179 0.205 1. ]] uniform-head-write3 : QK query-energy/key-energy; bias-vector energy L0H0 0.280 0.102 0.094 L0H1 0.079 0.054 0.126 L0H2 0.144 0.025 0.005 L0H3 0.319 0.049 0.061 L0H4 0.138 0.054 0.067 L0H5 0.031 0.039 0.119 L1H0 0.061 0.342 0.765 L1H1 0.107 0.627 0.905 L1H2 0.108 0.631 0.908 L1H3 0.137 0.678 0.931 L1H4 0.119 0.645 0.919 L1H5 0.084 0.525 0.825 L2H0 0.010 0.051 0.465 L2H1 0.005 0.005 0.040 L2H2 0.014 0.070 0.858 L2H3 0.022 0.095 0.804 L2H4 0.023 0.095 0.672 L2H5 0.006 0.041 0.270 L3H0 0.002 0.017 0.086 L3H1 0.003 0.009 0.078 L3H2 0.003 0.025 0.234 L3H3 0.005 0.010 0.052 L3H4 0.004 0.025 0.160 L3H5 0.003 0.005 0.074 uniform-head-read3 : QK query-energy/key-energy; bias-vector energy L0H0 0.755 0.223 0.298 L0H1 0.567 0.608 0.643 L0H2 0.680 0.511 0.633 L0H3 0.623 0.414 0.302 L0H4 0.030 0.086 0.216 L0H5 0.249 0.281 0.148 L1H0 0.009 0.039 0.101 L1H1 0.015 0.090 0.137 L1H2 0.018 0.072 0.111 L1H3 0.012 0.082 0.128 L1H4 0.022 0.084 0.135 L1H5 0.008 0.072 0.105 L2H0 0.008 0.014 0.074 L2H1 0.010 0.009 0.010 L2H2 0.009 0.018 0.127 L2H3 0.010 0.018 0.126 L2H4 0.008 0.022 0.114 L2H5 0.009 0.012 0.028 L3H0 0.008 0.008 0.013 L3H1 0.008 0.010 0.017 L3H2 0.007 0.010 0.061 L3H3 0.006 0.009 0.010 L3H4 0.007 0.011 0.017 L3H5 0.009 0.008 0.002 H5-value-read27 : QK query-energy/key-energy; bias-vector energy L0H0 0.059 0.391 0.423 L0H1 0.105 0.143 0.256 L0H2 0.131 0.293 0.199 L0H3 0.113 0.264 0.194 L0H4 0.085 0.101 0.101 L0H5 0.150 0.168 0.219 L1H0 0.074 0.175 0.264 L1H1 0.121 0.233 0.290 L1H2 0.084 0.199 0.273 L1H3 0.100 0.184 0.230 L1H4 0.070 0.200 0.253 L1H5 0.097 0.227 0.288 L2H0 0.076 0.084 0.141 L2H1 0.087 0.078 0.073 L2H2 0.102 0.114 0.194 L2H3 0.071 0.097 0.224 L2H4 0.073 0.091 0.176 L2H5 0.066 0.081 0.146 L3H0 0.085 0.075 0.132 L3H1 0.085 0.071 0.083 L3H2 0.075 0.078 0.100 L3H3 0.069 0.074 0.061 L3H4 0.070 0.076 0.109 L3H5 0.077 0.061 0.097 H5-value-write27 : QK query-energy/key-energy; bias-vector energy L0H0 0.054 0.056 0.039 L0H1 0.108 0.094 0.069 L0H2 0.052 0.050 0.063 L0H3 0.051 0.072 0.101 L0H4 0.059 0.069 0.071 L0H5 0.172 0.163 0.081 L1H0 0.162 0.109 0.033 L1H1 0.122 0.060 0.022 L1H2 0.134 0.052 0.019 L1H3 0.138 0.056 0.014 L1H4 0.149 0.059 0.014 L1H5 0.146 0.079 0.038 L2H0 0.091 0.094 0.052 L2H1 0.120 0.135 0.113 L2H2 0.159 0.118 0.012 L2H3 0.077 0.089 0.031 L2H4 0.091 0.098 0.124 L2H5 0.072 0.078 0.095 L3H0 0.079 0.083 0.067 L3H1 0.084 0.118 0.068 L3H2 0.071 0.077 0.071 L3H3 0.060 0.067 0.050 L3H4 0.062 0.064 0.047 L3H5 0.143 0.138 0.084 L0-H1H5-QK-shared20 : QK query-energy/key-energy; bias-vector energy L0H0 0.752 0.277 0.311 L0H1 0.946 0.953 0.766 L0H2 0.690 0.627 0.703 L0H3 0.625 0.510 0.301 L0H4 0.094 0.190 0.261 L0H5 0.900 0.916 0.790 L1H0 0.059 0.129 0.249 L1H1 0.056 0.222 0.330 L1H2 0.056 0.200 0.308 L1H3 0.057 0.219 0.331 L1H4 0.070 0.217 0.348 L1H5 0.055 0.191 0.295 L2H0 0.050 0.063 0.214 L2H1 0.047 0.050 0.039 L2H2 0.048 0.065 0.310 L2H3 0.052 0.073 0.313 L2H4 0.045 0.075 0.263 L2H5 0.051 0.058 0.089 L3H0 0.048 0.054 0.065 L3H1 0.047 0.053 0.089 L3H2 0.048 0.056 0.162 L3H3 0.049 0.055 0.064 L3H4 0.050 0.055 0.061 L3H5 0.050 0.051 0.063 Pairwise cosine of bias-derived key coefficients across all heads L0H0 [('L0H4', 0.213), ('L0H5', 0.199), ('L0H2', 0.196), ('L0H3', 0.066)] L0H1 [('L1H1', 0.387), ('L2H2', 0.354), ('L1H0', 0.353), ('L1H4', 0.347)] L0H2 [('L0H3', 0.353), ('L0H0', 0.196), ('L0H5', 0.178), ('L3H1', 0.104)] L0H3 [('L0H2', 0.353), ('L0H4', 0.088), ('L0H0', 0.066), ('L3H4', 0.056)] L0H4 [('L0H0', 0.213), ('L0H3', 0.088), ('L3H5', 0.05), ('L2H1', 0.021)] L0H5 [('L0H0', 0.199), ('L0H2', 0.178), ('L3H1', -0.013), ('L0H3', -0.017)] L1H0 [('L2H3', 0.826), ('L1H4', 0.81), ('L1H2', 0.808), ('L1H3', 0.801)] L1H1 [('L1H3', 0.924), ('L1H2', 0.923), ('L1H4', 0.921), ('L1H5', 0.897)] L1H2 [('L1H1', 0.923), ('L1H4', 0.9), ('L1H3', 0.899), ('L1H5', 0.868)] L1H3 [('L1H4', 0.926), ('L1H1', 0.924), ('L1H5', 0.899), ('L1H2', 0.899)] L1H4 [('L1H3', 0.926), ('L1H1', 0.921), ('L1H2', 0.9), ('L1H5', 0.883)] L1H5 [('L1H3', 0.899), ('L1H1', 0.897), ('L1H4', 0.883), ('L1H2', 0.868)] L2H0 [('L1H3', 0.67), ('L1H4', 0.641), ('L1H1', 0.623), ('L1H2', 0.619)] L2H1 [('L2H0', 0.298), ('L3H4', 0.276), ('L2H5', 0.272), ('L3H5', 0.206)] L2H2 [('L1H3', 0.885), ('L1H4', 0.88), ('L1H1', 0.867), ('L1H2', 0.864)] L2H3 [('L1H2', 0.864), ('L1H4', 0.833), ('L2H2', 0.831), ('L1H0', 0.826)] L2H4 [('L1H1', 0.816), ('L1H3', 0.812), ('L1H5', 0.8), ('L1H4', 0.781)] L2H5 [('L1H0', 0.527), ('L1H2', 0.519), ('L1H1', 0.495), ('L2H3', 0.495)] L3H0 [('L3H4', 0.364), ('L1H0', 0.303), ('L3H2', 0.297), ('L2H3', 0.274)] L3H1 [('L3H5', 0.296), ('L3H0', 0.211), ('L2H1', 0.193), ('L3H3', 0.166)] L3H2 [('L1H4', 0.461), ('L1H5', 0.456), ('L1H1', 0.455), ('L1H3', 0.454)] L3H3 [('L3H2', 0.253), ('L2H3', 0.244), ('L1H1', 0.229), ('L3H4', 0.227)] L3H4 [('L1H2', 0.435), ('L2H3', 0.423), ('L3H2', 0.399), ('L1H1', 0.396)] L3H5 [('L3H1', 0.296), ('L2H1', 0.206), ('L3H4', 0.075), ('L3H0', 0.06)] ```