COPY-TEMPLATE GROUPS
letters [['A', 'B', 'C', 'D'], ['a', 'b', 'c', 'd'], [' A', ' B', ' C', ' D'], [' a', ' b', ' c', ' d']]
digits [['0', '1', '2', '3', '4', '5', '6', '7', '8', '9']]
boolean [['yes', 'no'], ['Yes', 'No'], ['true', 'false'], ['True', 'False'], [' yes', ' no'], [' Yes', ' No'], [' true', ' false'], [' True', ' False']]
broad 4096 randomly selected space-prefixed lowercase vocabulary rows

Template cosine matrix, order: ['letters', 'digits', 'boolean', 'broad']
[[0.9999 0.0088 0.0076 0.0377]
 [0.0088 0.9999 0.0058 0.0354]
 [0.0076 0.0058 0.9999 0.0451]
 [0.0377 0.0354 0.0451 0.9999]]

NORM-FACTOR ANISOTROPY CHECK
0 post_attention_layernorm largest coordinates: [(400, 52.75), (24, 12.625), (639, 8.09375)] top3 squared-factor share: 0.8183
0 post_feedforward_layernorm largest coordinates: [(400, 153.0), (639, 28.75), (218, 22.375)] top3 squared-factor share: 0.8202
4 post_attention_layernorm largest coordinates: [(400, 222.0), (163, 210.0), (558, 54.0)] top3 squared-factor share: 0.8669
4 post_feedforward_layernorm largest coordinates: [(163, 609.0), (400, 299.0), (61, 32.25)] top3 squared-factor share: 0.9161
10 post_attention_layernorm largest coordinates: [(163, 483.0), (400, 204.0), (338, 152.0)] top3 squared-factor share: 0.1403
10 post_feedforward_layernorm largest coordinates: [(163, 593.0), (400, 383.0), (127, 230.0)] top3 squared-factor share: 0.154
17 post_attention_layernorm largest coordinates: [(558, 449.0), (400, 331.0), (163, 331.0)] top3 squared-factor share: 0.0266
17 post_feedforward_layernorm largest coordinates: [(558, 1649.0), (163, 1313.0), (400, 889.0)] top3 squared-factor share: 0.0577

ALL HEADS: SIGNED B-A COPY-TEMPLATE COUPLINGS, multiplied by 10^4
Positive = greater B linear identity coupling, NOT greater observed copying.
Columns: layer head | diagonal letters digits boolean broad | raw letters broad | relative matrix change
L00 H0 |   -0.020   +0.061   +0.076   +0.058 |   -0.029   +0.183 | 0.00909
L00 H1 |   +0.085   +0.168   -0.068   -0.324 |   -0.168   -0.905 | 0.01865
L00 H2 |   -0.050   +0.033   -0.034   +0.176 |   -0.299   -0.238 | 0.00931
L00 H3 |   -0.028   +0.072   -0.013   +0.048 |   +0.063   -0.081 | 0.00850
L01 H0 |   +0.062   +0.019   +0.054   +0.010 |   +0.211   +0.412 | 0.01295
L01 H1 |   +0.005   +0.083   +0.043   -0.049 |   +0.059   +0.204 | 0.01119
L01 H2 |   +0.018   -0.057   -0.033   -0.035 |   +0.316   -0.081 | 0.00967
L01 H3 |   +0.084   -0.033   +0.056   -0.008 |   +0.027   +0.486 | 0.01040
L02 H0 |   -0.071   -0.045   -0.013   -0.090 |   -0.121   -0.332 | 0.01507
L02 H1 |   +0.044   +0.026   -0.049   +0.012 |   +0.175   -0.014 | 0.01322
L02 H2 |   +0.051   -0.044   -0.040   +0.067 |   +0.361   +0.260 | 0.01185
L02 H3 |   -0.035   -0.056   +0.028   -0.051 |   -0.017   -0.073 | 0.01856
L03 H0 |   +0.082   +0.059   -0.041   +0.068 |   +0.249   +0.256 | 0.01582
L03 H1 |   +0.054   -0.123   -0.064   +0.021 |   -0.155   -0.121 | 0.01979
L03 H2 |   -0.064   -0.039   +0.020   -0.081 |   -0.146   -0.436 | 0.01882
L03 H3 |   -0.032   -0.040   -0.053   -0.086 |   +0.180   -0.158 | 0.02354
L04 H0 |   -0.001   +0.018   -0.021   +0.031 |   +0.003   +0.041 | 0.02275
L04 H1 |   +0.067   -0.001   -0.006   +0.030 |   +0.266   +0.221 | 0.03080
L04 H2 |   +0.032   +0.023   +0.011   -0.003 |   +0.081   +0.131 | 0.02190
L04 H3 |   -0.004   +0.004   +0.004   -0.001 |   -0.023   -0.024 | 0.01550
L05 H0 |   +0.008   +0.021   +0.003   +0.002 |   -0.009   +0.147 | 0.00676
L05 H1 |   +0.044   +0.037   +0.028   +0.029 |   +0.057   +0.278 | 0.01291
L05 H2 |   +0.038   +0.015   -0.000   +0.046 |   +0.219   +0.226 | 0.01405
L05 H3 |   +0.017   +0.017   +0.039   +0.048 |   -0.233   +0.313 | 0.01213
L06 H0 |   +0.042   -0.030   -0.007   -0.003 |   +0.087   -0.226 | 0.01733
L06 H1 |   +0.042   -0.013   -0.003   +0.004 |   +0.325   +0.067 | 0.01141
L06 H2 |   +0.061   -0.041   -0.034   +0.038 |   +0.222   -0.217 | 0.01749
L06 H3 |   +0.035   -0.034   +0.001   +0.002 |   +0.113   -0.098 | 0.01549
L07 H0 |   -0.007   +0.040   -0.009   +0.036 |   -0.015   +0.069 | 0.01356
L07 H1 |   +0.018   -0.007   +0.012   +0.004 |   +0.215   +0.021 | 0.00948
L07 H2 |   +0.016   +0.022   +0.033   +0.003 |   +0.043   -0.055 | 0.01042
L07 H3 |   +0.012   +0.037   +0.024   +0.052 |   -0.059   +0.106 | 0.01779
L08 H0 |   -0.036   -0.020   -0.002   +0.037 |   +0.064   +0.222 | 0.01229
L08 H1 |   -0.009   -0.034   -0.058   +0.043 |   +0.256   +0.464 | 0.01627
L08 H2 |   +0.005   -0.020   -0.076   -0.007 |   +0.222   -0.040 | 0.01840
L08 H3 |   +0.051   -0.060   +0.021   +0.040 |   +0.013   -0.014 | 0.01441
L09 H0 |   -0.022   +0.005   +0.105   +0.050 |   -0.054   +0.012 | 0.01425
L09 H1 |   -0.025   +0.019   +0.008   +0.036 |   +0.041   +0.016 | 0.01142
L09 H2 |   -0.043   -0.008   +0.013   +0.025 |   -0.261   +0.078 | 0.01518
L09 H3 |   -0.010   +0.065   +0.036   +0.039 |   -0.238   +0.107 | 0.01347
L10 H0 |   +0.001   -0.013   +0.012   +0.059 |   +0.078   +0.247 | 0.01054
L10 H1 |   +0.002   +0.010   -0.018   +0.046 |   +0.064   +0.222 | 0.01181
L10 H2 |   +0.022   -0.035   -0.035   +0.036 |   +0.122   +0.147 | 0.01504
L10 H3 |   +0.018   +0.008   -0.003   +0.020 |   +0.084   -0.075 | 0.00749
L11 H0 |   +0.016   +0.014   +0.014   +0.004 |   +0.115   +0.009 | 0.01240
L11 H1 |   +0.059   +0.146   -0.034   -0.008 |   +0.474   +0.131 | 0.02181
L11 H2 |   -0.011   +0.050   -0.005   -0.000 |   +0.082   +0.052 | 0.00967
L11 H3 |   -0.003   -0.035   -0.008   +0.003 |   +0.196   +0.016 | 0.00827
L12 H0 |   +0.027   +0.023   -0.025   -0.026 |   +0.104   -0.200 | 0.01376
L12 H1 |   -0.012   +0.004   -0.009   -0.017 |   +0.252   -0.059 | 0.01269
L12 H2 |   +0.016   +0.006   +0.005   +0.020 |   +0.226   +0.234 | 0.00962
L12 H3 |   -0.037   +0.045   -0.032   +0.012 |   +0.190   -0.094 | 0.01285
L13 H0 |   +0.003   +0.001   -0.001   -0.022 |   +0.101   -0.260 | 0.01153
L13 H1 |   -0.023   +0.014   +0.003   +0.013 |   +0.102   +0.026 | 0.01305
L13 H2 |   -0.050   -0.001   -0.054   +0.014 |   +0.120   -0.317 | 0.01360
L13 H3 |   -0.033   -0.061   -0.022   +0.024 |   +0.021   -0.009 | 0.00855
L14 H0 |   +0.021   -0.040   -0.000   +0.013 |   +0.091   +0.024 | 0.00838
L14 H1 |   -0.020   -0.016   +0.033   -0.024 |   -0.097   -0.148 | 0.00936
L14 H2 |   +0.040   +0.036   +0.012   -0.029 |   +0.213   -0.171 | 0.00985
L14 H3 |   -0.031   -0.017   -0.007   -0.050 |   +0.070   -0.055 | 0.00950
L15 H0 |   +0.002   +0.019   +0.044   -0.071 |   +0.096   -0.208 | 0.01314
L15 H1 |   -0.059   -0.099   -0.002   -0.070 |   +0.143   -0.114 | 0.01651
L15 H2 |   +0.000   -0.077   +0.055   -0.079 |   +0.216   -0.240 | 0.01892
L15 H3 |   +0.014   -0.034   +0.026   -0.068 |   +0.009   -0.267 | 0.01565
L16 H0 |   +0.039   +0.024   +0.004   -0.066 |   -0.017   +0.064 | 0.01353
L16 H1 |   -0.017   +0.054   -0.068   -0.035 |   -0.224   -0.021 | 0.01562
L16 H2 |   -0.044   +0.002   -0.053   -0.064 |   -0.040   -0.126 | 0.01255
L16 H3 |   +0.029   +0.346   -0.052   -0.093 |   +0.040   -0.194 | 0.01451
L17 H0 |   +0.030   -0.033   +0.031   -0.021 |   +0.123   -0.155 | 0.00717
L17 H1 |   -0.033   -0.096   -0.029   -0.224 |   -0.080   -0.457 | 0.01569
L17 H2 |   +0.083   +0.099   +0.037   -0.024 |   +0.220   +0.210 | 0.00984
L17 H3 |   -0.042   -0.052   +0.009   -0.030 |   -0.031   -0.178 | 0.00995

LARGEST ABSOLUTE LETTER-COPY DIFFERENCES: DECOMPOSITION AND CONTROLS
L00 H1: A=-0.002521 B=-0.002512; 1e4*delta=+0.085, output-part=+0.052, shared-value-part=+0.033, rescale-controlled=+0.069, raw=-0.168
L01 H3: A=+0.000871 B=+0.000880; 1e4*delta=+0.084, output-part=+0.101, shared-value-part=-0.017, rescale-controlled=+0.079, raw=+0.027
L17 H2: A=+0.000105 B=+0.000113; 1e4*delta=+0.083, output-part=+0.074, shared-value-part=+0.009, rescale-controlled=+0.083, raw=+0.220
L03 H0: A=-0.001044 B=-0.001036; 1e4*delta=+0.082, output-part=+0.062, shared-value-part=+0.020, rescale-controlled=+0.102, raw=+0.249
L02 H0: A=+0.001216 B=+0.001209; 1e4*delta=-0.071, output-part=-0.022, shared-value-part=-0.049, rescale-controlled=-0.070, raw=-0.121
L04 H1: A=+0.000186 B=+0.000193; 1e4*delta=+0.067, output-part=+0.071, shared-value-part=-0.004, rescale-controlled=+0.065, raw=+0.266
L03 H2: A=+0.001356 B=+0.001349; 1e4*delta=-0.064, output-part=-0.060, shared-value-part=-0.005, rescale-controlled=-0.076, raw=-0.146
L01 H0: A=-0.000338 B=-0.000332; 1e4*delta=+0.062, output-part=+0.039, shared-value-part=+0.023, rescale-controlled=+0.063, raw=+0.211
L06 H2: A=+0.001467 B=+0.001473; 1e4*delta=+0.061, output-part=+0.047, shared-value-part=+0.014, rescale-controlled=+0.055, raw=+0.222
L11 H1: A=+0.004064 B=+0.004070; 1e4*delta=+0.059, output-part=+0.060, shared-value-part=-0.001, rescale-controlled=+0.040, raw=+0.474
L15 H1: A=-0.003530 B=-0.003536; 1e4*delta=-0.059, output-part=-0.043, shared-value-part=-0.016, rescale-controlled=-0.056, raw=+0.143
L03 H1: A=+0.000627 B=+0.000633; 1e4*delta=+0.054, output-part=+0.060, shared-value-part=-0.006, rescale-controlled=+0.044, raw=-0.155
L02 H2: A=-0.000704 B=-0.000699; 1e4*delta=+0.051, output-part=+0.040, shared-value-part=+0.012, rescale-controlled=+0.055, raw=+0.361
L08 H3: A=+0.000248 B=+0.000253; 1e4*delta=+0.051, output-part=+0.036, shared-value-part=+0.015, rescale-controlled=+0.050, raw=+0.013

SIGN COUNTS ACROSS HEADS (DESCRIPTIVE; HEADS ARE NOT INDEPENDENT)
letters B>A: 42 of 72 median*1e4: 0.005 raw/diagonal sign agreement: 51
digits B>A: 39 of 72 median*1e4: 0.0039 raw/diagonal sign agreement: 47
boolean B>A: 33 of 72 median*1e4: -0.0015 raw/diagonal sign agreement: 39
broad B>A: 40 of 72 median*1e4: 0.0033 raw/diagonal sign agreement: 53
