NORM VECTOR QUANTILES: min, median, max; max A-B
0 input_layernorm.weight [ 6.375  10.9375 61.75  ] maxdiff 0.0
0 post_attention_layernorm.weight [-1.     -0.6953 51.75  ] maxdiff 0.00048828125
0 pre_feedforward_layernorm.weight [-1.     4.625 19.625] maxdiff 0.0
0 post_feedforward_layernorm.weight [ -0.9883  -0.1101 152.    ] maxdiff 0.0009765625
0 self_attn.q_norm.weight [-3.7812  1.0117  3.5625] maxdiff 0.00048828125
0 self_attn.k_norm.weight [-1.8281  0.9766  5.8438] maxdiff 0.00048828125
1 input_layernorm.weight [-0.1719 24.375  47.5   ] maxdiff 0.0
1 post_attention_layernorm.weight [ -1.0078   0.5195 103.    ] maxdiff 0.0006103515625
1 pre_feedforward_layernorm.weight [-1.   31.75 55.75] maxdiff 0.0
1 post_feedforward_layernorm.weight [ -1.       0.2446 195.    ] maxdiff 0.0009765625
1 self_attn.q_norm.weight [-1.1172  1.6328 14.4375] maxdiff 0.0
1 self_attn.k_norm.weight [-1.0234  1.4922  7.875 ] maxdiff 0.0
5 input_layernorm.weight [-0.6953 10.4375 48.25  ] maxdiff 0.00048828125
5 post_attention_layernorm.weight [ -1.0312   5.1875 512.    ] maxdiff 0.0009765625
5 pre_feedforward_layernorm.weight [-1.     11.1875 46.    ] maxdiff 0.00048828125
5 post_feedforward_layernorm.weight [ -1.0938   7.3125 740.    ] maxdiff 0.0
5 self_attn.q_norm.weight [-3.0625  1.1406  5.375 ] maxdiff 0.0009765625
5 self_attn.k_norm.weight [-3.6875  1.4297 22.625 ] maxdiff 0.0
11 input_layernorm.weight [-0.8438  1.7109 52.25  ] maxdiff 0.0009765625
11 post_attention_layernorm.weight [ -0.957  50.125 568.   ] maxdiff 0.0
11 pre_feedforward_layernorm.weight [-1.0547  1.8555 53.75  ] maxdiff 0.0009765625
11 post_feedforward_layernorm.weight [ -0.9805  97.     892.    ] maxdiff 0.0
11 self_attn.q_norm.weight [-1.0469  0.5391  6.0938] maxdiff 0.00048828125
11 self_attn.k_norm.weight [-1.      1.6953 29.5   ] maxdiff 0.0003662109375
17 input_layernorm.weight [  0.2852   2.5156 121.    ] maxdiff 0.0
17 post_attention_layernorm.weight [ -1.5078 140.5    448.    ] maxdiff 0.0001220703125
17 pre_feedforward_layernorm.weight [-1.0547 -0.2734 29.625 ] maxdiff 0.0009765625
17 post_feedforward_layernorm.weight [  -1.1328  336.     1648.    ] maxdiff 0.0
17 self_attn.q_norm.weight [-1.0391  0.4766 16.125 ] maxdiff 0.0009765625
17 self_attn.k_norm.weight [-3.5312  1.4727  5.8125] maxdiff 0.00048828125
final norm: [ -0.9141   8.375  300.    ] maxdiff 0.0
Within-checkpoint embedding/output identical: True
FAMILY ABCD n= 4 examples= ['A', 'B', 'C', 'D']
FAMILY space_ABCD n= 4 examples= [' A', ' B', ' C', ' D']
FAMILY digits n= 10 examples= ['0', '1', '2', '3', '4', '5', '6', '7', '8', '9']
FAMILY binary n= 8 examples= ['yes', 'no', 'true', 'false', 'Yes', 'No', 'True', 'False']
FAMILY space_binary n= 8 examples= [' yes', ' no', ' true', ' false', ' Yes', ' No', ' True', ' False']
FAMILY cities n= 12 examples= ['Paris', 'London', 'Rome', 'Berlin', 'Tokyo', 'Madrid', ' Paris', ' London', ' Rome', ' Berlin', ' Tokyo', ' Madrid']
FAMILY alphabet n= 26 examples= ['A', 'B', 'C', 'D', 'E', 'F', 'G', 'H', 'I', 'J', 'K', 'L', 'M', 'N', 'O', 'P']
FAMILY ordinary n= 20 examples= [' house', ' tree', ' book', ' water', ' road', ' music', ' table', ' window', ' paper', ' stone', ' hand', ' night', ' car', ' door', ' flower', ' chair']
FAMILY random_words n= 96 examples= [' numbering', ' chiq', ' gratuito', ' dolgo', ' comte', ' word', ' komment', ' corrective', ' furent', ' gelecek', ' flocked', ' hehe', ' canning', ' invading', ' highs', ' anne']

 RAW OV
Score: matched-token linear alignment, centered within each family.
This is NOT a logit, an attention-weighted output, or a causal effect.
18 largest absolute answer-family changes
layer head A_score B_score A-B control_A-B
 1 1 -0.001070205 -0.0009346852 -0.0001355197 -6.440608e-05
  family deltas: ABCD=-9.391e-05 space_ABCD=-4.366e-05 digits=-0.0005103 binary=-4.343e-06 space_binary=-0.0001126 cities=-4.834e-05 alphabet=-7.719e-06 ordinary=-8.379e-05 random_words=-4.502e-05
 2 0  0.06328021  0.06315275  0.0001274589 -2.440065e-07
  family deltas: ABCD=+0.00015 space_ABCD=+0.000245 digits=+8.986e-05 binary=+0.0001065 space_binary=+0.0001323 cities=+4.113e-05 alphabet=+0.0001463 ordinary=-2.945e-05 random_words=+2.896e-05
 9 1 -0.147465 -0.147343 -0.0001219213  3.190339e-05
  family deltas: ABCD=-0.0001132 space_ABCD=-9.075e-05 digits=-0.0001792 binary=-0.0001507 space_binary=-9.874e-05 cities=-9.896e-05 alphabet=-4.023e-06 ordinary=+6.793e-05 random_words=-4.128e-06
 5 2  0.03877403  0.03865687  0.0001171539 -2.259761e-05
  family deltas: ABCD=+0.0002494 space_ABCD=+0.0002344 digits=+0.0001325 binary=+1.253e-05 space_binary=+5.163e-05 cities=+2.242e-05 alphabet=-3.641e-05 ordinary=-5.452e-05 random_words=+9.321e-06
16 3  0.005528644  0.005421864  0.0001067803 -3.044633e-05
  family deltas: ABCD=+0.0001121 space_ABCD=+0.0001587 digits=-1.862e-05 binary=+0.0002118 space_binary=+0.000163 cities=+1.372e-05 alphabet=-1.406e-05 ordinary=-4.255e-05 random_words=-1.834e-05
15 3  0.1862619  0.1863683 -0.0001063856  5.596876e-05
  family deltas: ABCD=-0.0001473 space_ABCD=-0.0001911 digits=-0.0003743 binary=+5.142e-05 space_binary=+6.25e-05 cities=-3.952e-05 alphabet=-4.262e-05 ordinary=+0.0001073 random_words=+4.679e-06
16 0  0.01097422  0.01087551  9.870871e-05 -1.915265e-05
  family deltas: ABCD=+0.0001258 space_ABCD=+0.0002408 digits=-0.000147 binary=+0.0001989 space_binary=+0.0001356 cities=+3.832e-05 alphabet=+1.591e-05 ordinary=-2.046e-05 random_words=-1.785e-05
13 0  0.02262465  0.02252857  9.607555e-05 -2.562441e-05
  family deltas: ABCD=+4.035e-05 space_ABCD=+9.116e-05 digits=+0.0001854 binary=+0.0001416 space_binary=+6.563e-05 cities=+5.232e-05 alphabet=+2.825e-05 ordinary=-4.716e-05 random_words=-4.092e-06
 2 3 -0.007542448 -0.007636952  9.450422e-05  2.901629e-05
  family deltas: ABCD=+0.0002276 space_ABCD=+0.0001951 digits=+0.0001233 binary=+3.346e-06 space_binary=-7.244e-06 cities=+2.497e-05 alphabet=+2.846e-06 ordinary=+2.238e-05 random_words=+3.565e-05
 2 2 -0.005120796 -0.005213918  9.312104e-05 -2.129143e-05
  family deltas: ABCD=+0.0001751 space_ABCD=+0.0002408 digits=+0.0002061 binary=-2.068e-05 space_binary=+5.898e-05 cities=-0.0001016 alphabet=-3.459e-06 ordinary=-1.235e-05 random_words=-3.023e-05
15 1 -0.3231604 -0.3232422  8.182724e-05  5.744398e-05
  family deltas: ABCD=-2.667e-05 space_ABCD=+4.771e-05 digits=+0.0001414 binary=+9.51e-05 space_binary=+8.833e-05 cities=+0.0001451 alphabet=-2.077e-05 ordinary=+0.0001086 random_words=+6.318e-06
15 0  0.1005802  0.1006588 -7.862722e-05  3.236532e-05
  family deltas: ABCD=-0.0001832 space_ABCD=-0.0001021 digits=-0.0001583 binary=+2.638e-06 space_binary=+7.203e-05 cities=-0.0001027 alphabet=-2.395e-06 ordinary=+9.751e-05 random_words=-3.278e-05
 5 0  0.05575621  0.05568393  7.227746e-05  3.610179e-05
  family deltas: ABCD=+8.465e-05 space_ABCD=+7.944e-05 digits=-0.000163 binary=+3.886e-05 space_binary=+0.0002635 cities=+0.0001302 alphabet=+5.048e-05 ordinary=+1.884e-05 random_words=+5.337e-05
 4 1  0.02102716  0.02095764  6.951842e-05 -9.927899e-07
  family deltas: ABCD=+1.48e-05 space_ABCD=-4.737e-06 digits=+0.0001125 binary=+0.0002106 space_binary=+9.828e-05 cities=-1.43e-05 alphabet=+2.855e-05 ordinary=-2.277e-05 random_words=+2.079e-05
 7 2  0.0954414  0.09550669 -6.52882e-05 -4.138425e-05
  family deltas: ABCD=+6.527e-06 space_ABCD=-8.635e-06 digits=-2.415e-05 binary=-0.0001953 space_binary=-0.0001729 cities=+2.697e-06 alphabet=-6.042e-05 ordinary=-3.476e-05 random_words=-4.8e-05
 5 3 -0.03565993 -0.03572508  6.515036e-05  2.418458e-05
  family deltas: ABCD=+0.0001025 space_ABCD=+6.582e-05 digits=+0.0001803 binary=+2.357e-05 space_binary=+4.616e-06 cities=+1.417e-05 alphabet=+2.106e-05 ordinary=+2.824e-06 random_words=+4.555e-05
 4 2 -0.0003720784 -0.0004351883  6.310987e-05 -7.904659e-06
  family deltas: ABCD=+0.0001561 space_ABCD=+2.705e-05 digits=+0.0001286 binary=+5.854e-05 space_binary=-9.033e-06 cities=+1.746e-05 alphabet=+5.068e-05 ordinary=-1.666e-05 random_words=+8.483e-07
10 2  0.05457556  0.05463725 -6.16877e-05  3.867224e-05
  family deltas: ABCD=+3.202e-05 space_ABCD=+0.0001221 digits=-4.622e-05 binary=-0.0001957 space_binary=-0.0002202 cities=-6.216e-05 alphabet=-3.191e-05 ordinary=+4.119e-05 random_words=+3.615e-05
SUM ACROSS HEADS, per family (descriptive; heads are not equally active):
ABCD A 0.9618835747241974 B 0.9612617833772674 A-B 0.0006217913469299674
space_ABCD A 1.032895632321015 B 1.0323654873063788 A-B 0.0005301450146362185
digits A 1.0475348066538572 B 1.0478317060042173 A-B -0.0002968993503600359
binary A 1.4081761220586486 B 1.4061661835876293 A-B 0.002009938471019268
space_binary A 1.4437627669831272 B 1.4418299227545504 A-B 0.0019328442285768688
cities A 1.5473973569023656 B 1.5475972433341667 A-B -0.00019988643180113286
alphabet A 1.2099400326842442 B 1.2096039025345817 A-B 0.00033613014966249466
ordinary A 1.6277832256164402 B 1.627331763971597 A-B 0.0004514616448432207
random_words A 1.7003095311083598 B 1.699235851803678 A-B 0.0010736793046817183

 OV WITH LEARNED DIAGONAL GAINS
Score: matched-token linear alignment, centered within each family.
This is NOT a logit, an attention-weighted output, or a causal effect.
18 largest absolute answer-family changes
layer head A_score B_score A-B control_A-B
12 2  2082.008  2075.675  6.332764  1.698486
  family deltas: ABCD=+12.52 space_ABCD=+11.8 digits=+2.089 binary=-0.001221 space_binary=+2.841 cities=+8.745 alphabet=+0.9449 ordinary=+0.6553 random_words=+2.742
15 1 -8799.487 -8805.294  5.806641  1.943848
  family deltas: ABCD=-0.01318 space_ABCD=+3.895 digits=+27.3 binary=+0.5576 space_binary=-1.665 cities=+4.77 alphabet=+0.6035 ordinary=+4.247 random_words=-0.3594
15 2  4243.731  4238.557  5.173177  3.581848
  family deltas: ABCD=+2.838 space_ABCD=+4.725 digits=+7.133 binary=+9 space_binary=+7.639 cities=-0.2959 alphabet=-2.277 ordinary=+6.281 random_words=+0.8832
12 1  1759.356  1754.639  4.716949  2.105591
  family deltas: ABCD=+8.958 space_ABCD=+4.657 digits=-4.404 binary=+3.208 space_binary=+8.105 cities=+7.777 alphabet=-1.823 ordinary=+0.782 random_words=+3.429
17 2 -318.1864 -314.9907 -3.195678  1.592407
  family deltas: ABCD=-3.832 space_ABCD=+0.4981 digits=-10.5 binary=-0.2925 space_binary=+0.5781 cities=-5.628 alphabet=-1.21 ordinary=+1.413 random_words=+1.772
11 1  1098.091  1095.227  2.864085  0.4693604
  family deltas: ABCD=+4.133 space_ABCD=+4.898 digits=+2.887 binary=+1.837 space_binary=+1.885 cities=+1.545 alphabet=+0.5568 ordinary=+0.5222 random_words=+0.4165
13 0  374.049  371.6348  2.414154 -0.367157
  family deltas: ABCD=-1.897 space_ABCD=-1.72 digits=+3.991 binary=+3.454 space_binary=+4.576 cities=+6.081 alphabet=-0.8254 ordinary=-0.1895 random_words=-0.5449
12 0 -215.8939 -218.1874  2.293447  2.318176
  family deltas: ABCD=+3.449 space_ABCD=+1.551 digits=+3.057 binary=+0.6877 space_binary=+4.599 cities=+0.4171 alphabet=-3.913 ordinary=+2.383 random_words=+2.254
11 2  841.4871  839.6158  1.871323  0.2325439
  family deltas: ABCD=-0.5202 space_ABCD=+0.5059 digits=+8.643 binary=-0.3738 space_binary=-1.101 cities=+4.075 alphabet=-0.879 ordinary=+0.8066 random_words=-0.3416
13 1  286.8455  285.1286  1.716955  0.3565369
  family deltas: ABCD=-2.437 space_ABCD=+0.08958 digits=+5.49 binary=+4.816 space_binary=+4.486 cities=-2.143 alphabet=-1.635 ordinary=+0.3938 random_words=+0.3193
14 3  24.03563  22.4429  1.592733 -1.698856
  family deltas: ABCD=-7.463 space_ABCD=-11.57 digits=+11.38 binary=+5.915 space_binary=+5.662 cities=+5.636 alphabet=+1.392 ordinary=-3.923 random_words=+0.5254
15 0  4006.991  4005.487  1.503357 -0.7456055
  family deltas: ABCD=-3.669 space_ABCD=+4.261 digits=+14.05 binary=-0.1992 space_binary=+3.524 cities=-8.946 alphabet=+0.1791 ordinary=+0.8945 random_words=-2.386
17 1  3473.456  3472.237  1.219076  2.056152
  family deltas: ABCD=+2.95 space_ABCD=+8.208 digits=-5.446 binary=+0.6128 space_binary=+3.669 cities=-2.679 alphabet=-0.4351 ordinary=+2.71 random_words=+1.402
16 2  1490.582  1491.708 -1.126389 -1.18692
  family deltas: ABCD=-6.192 space_ABCD=-6.089 digits=+5.532 binary=+5.688 space_binary=+0.4299 cities=-6.128 alphabet=-0.3108 ordinary=-0.3334 random_words=-2.04
17 0  1109.569  1110.64 -1.070389  0.258667
  family deltas: ABCD=-5.537 space_ABCD=-3.491 digits=-3.201 binary=+3.022 space_binary=+1.95 cities=+0.8359 alphabet=+0.3259 ordinary=-0.647 random_words=+1.164
13 3 -698.9547 -700.0246  1.069853 -0.7565308
  family deltas: ABCD=-4.703 space_ABCD=-3.115 digits=-3.885 binary=+6.02 space_binary=+6.124 cities=+5.979 alphabet=-0.3351 ordinary=-1.528 random_words=+0.01538
11 0  59.71482  58.75248  0.9623439  0.4285736
  family deltas: ABCD=+1.339 space_ABCD=+1.615 digits=-0.7231 binary=+1.327 space_binary=+1.599 cities=+0.6174 alphabet=-0.5546 ordinary=+0.6469 random_words=+0.2102
14 0 -452.5803 -453.5095  0.9291331  1.523788
  family deltas: ABCD=+0.7413 space_ABCD=+2.837 digits=+2.083 binary=-1.171 space_binary=-0.3703 cities=+1.455 alphabet=-1.013 ordinary=+3.031 random_words=+0.01669
SUM ACROSS HEADS, per family (descriptive; heads are not equally active):
ABCD A 15366.119591236115 B 15359.058745861053 A-B 7.060845375061035
space_ABCD A 16520.76356768608 B 16491.858309149742 A-B 28.905258536338806
digits A 18049.266120180488 B 17984.369923368096 A-B 64.89619681239128
binary A 25328.70203590393 B 25278.488527417183 A-B 50.21350848674774
space_binary A 25964.307139098644 B 25913.681527674198 A-B 50.625611424446106
cities A 38570.05425605178 B 38568.194981426 A-B 1.8592746257781982
alphabet A 17311.35369157791 B 17329.204260095954 A-B -17.850568518042564
ordinary A 40533.6227671504 B 40511.855829536915 A-B 21.766937613487244
random_words A 35792.7587249279 B 35786.503806233406 A-B 6.254918694496155

RAW OV: ALL HEADS, answer-family and control changes
0 [(0, 2.04e-05, 1.72e-05), (1, 3.97e-05, 0.0001194), (2, 2.17e-05, 0.0001117), (3, 2.41e-05, 0.0001627)]
1 [(0, -6.8e-06, -4.88e-05), (1, -0.0001355, -6.44e-05), (2, -5.02e-05, -2.65e-05), (3, -5.26e-05, -3.57e-05)]
2 [(0, 0.0001275, -2e-07), (1, 3.46e-05, -3.6e-06), (2, 9.31e-05, -2.13e-05), (3, 9.45e-05, 2.9e-05)]
3 [(0, -1.6e-05, 8e-07), (1, 5.97e-05, 2.55e-05), (2, -7.4e-06, -3.2e-06), (3, -3.17e-05, 1.68e-05)]
4 [(0, 4.34e-05, 1.66e-05), (1, 6.95e-05, -1e-06), (2, 6.31e-05, -7.9e-06), (3, -1.89e-05, -2.31e-05)]
5 [(0, 7.23e-05, 3.61e-05), (1, 2.03e-05, -3.3e-06), (2, 0.0001172, -2.26e-05), (3, 6.52e-05, 2.42e-05)]
6 [(0, -4.1e-05, 2.68e-05), (1, 1.04e-05, 6.73e-05), (2, -1.73e-05, 2.38e-05), (3, 3.59e-05, 3.67e-05)]
7 [(0, 1.06e-05, 8.8e-06), (1, -3.8e-06, 1.08e-05), (2, -6.53e-05, -4.14e-05), (3, -4.52e-05, 9.9e-06)]
8 [(0, -5.27e-05, 1.01e-05), (1, 5.25e-05, -2.01e-05), (2, -1.32e-05, 8.9e-06), (3, 5.22e-05, 9.5e-06)]
9 [(0, -3.1e-06, -3.21e-05), (1, -0.0001219, 3.19e-05), (2, -4.69e-05, 4.8e-06), (3, 3.2e-06, 1.36e-05)]
10 [(0, 2.33e-05, 6e-05), (1, -1.87e-05, -1.58e-05), (2, -6.17e-05, 3.87e-05), (3, -3.5e-06, 4.6e-05)]
11 [(0, -3.43e-05, 2.77e-05), (1, 5e-05, 4
[output cut at 15,000 characters]