=== TOKEN GROUPS: EACH ITEM IS AN EMBEDDING ROW, NOT AN INPUT ===
labels n = 20 examples = [' a', ' c', ' d', ' b', ' e', ' A', ' C', ' B', ' D', ' E', 'e', 'a', 'd', 'c', 'b', 'A', 'C', 'E', 'D', 'B']
numbers n = 10 examples = ['1', '0', '2', '3', '5', '4', '9', '6', '8', '7']
binary n = 24 examples = [' no', ' true', 'no', ' No', ' false', 'true', 'No', 'True', 'yes', 'false', ' True', 'NO', ' Yes', ' False', 'False', ' NO', 'Yes', ' yes', 'TRUE', ' TRUE', ' FALSE', 'FALSE', 'YES', ' YES']
control n = 512 examples = ['rib', 'ground', 'bol', ' whe', ' love', 'ini', 'ison', 'html', 'rial', ' squ', ' install', 'unk', ' built', 'Drawing', ' career', ' doc', ' Face', ' neut', 'ipt', ' bil', ' Gen', ' definition', ' Mass', ' fue']

=== NORM-VECTOR CHECK ===
model.norm.weight quantiles = [ -0.9141   4.2188   8.375   55.775  300.    ]
model.layers.0.input_layernorm.weight quantiles = [ 6.375   8.5    10.9375 15.9375 61.75  ]
model.layers.0.post_attention_layernorm.weight quantiles = [-1.     -0.8984 -0.6953 -0.298  51.75  ]
model.layers.17.input_layernorm.weight quantiles = [  0.2852   0.6172   2.5156  27.375  121.    ]
model.layers.17.post_attention_layernorm.weight quantiles = [ -1.5078  24.7    140.5    234.     448.    ]

Two geometries:
raw: O_h @ V
diag: D_final @ D_post_attention @ O_h @ V @ D_input
For diag, D = diag(1 + stored norm weight).
No RMS denominators, nonlinearities, positions, or attention weights
are applied. Diag is a weight-product diagnostic, not a block output.

=== ALL HEADS ===
All deltas are B minus A. Positive = more same-token contrast alignment in B.
 L H | raw: labels numbers binary control | diag: labels numbers binary control | alignment raw/diag
 0 0 | +5.085e-04 -3.827e-04 +1.380e-04 +2.663e-05 | +1.600e-01 -1.166e-01 +1.782e-02 +9.305e-04 | +0.0030/+0.0015
 0 1 | +3.260e-06 -2.110e-04 -1.222e-04 -1.419e-04 | -2.854e-02 -4.347e-02 -9.137e-03 -2.056e-02 | -0.0043/-0.0027
 0 2 | -5.931e-05 -1.744e-04 -2.006e-05 -1.147e-04 | -5.241e-02 -2.782e-02 +2.280e-02 -2.392e-02 | -0.0032/-0.0013
 0 3 | -1.832e-04 -1.283e-04 -8.293e-05 -1.988e-04 | -2.743e-02 -1.110e-01 -1.734e-02 -2.965e-02 | -0.0038/-0.0038
 1 0 | -5.158e-05 +1.399e-04 +4.382e-05 +1.515e-05 | -1.763e-02 +2.624e-01 -1.489e-01 +1.631e-02 | +0.0017/+0.0003
 1 1 | +6.457e-05 +5.345e-04 +1.430e-04 +3.270e-05 | +1.685e-02 -5.109e-01 +3.491e-01 +8.778e-02 | +0.0087/-0.0004
 1 2 | +3.324e-05 +3.614e-04 +9.038e-05 +4.985e-05 | +1.226e-01 +1.938e-01 +1.361e-01 +4.936e-03 | +0.0063/+0.0011
 1 3 | -3.284e-05 +3.579e-04 +9.286e-05 +1.131e-05 | -5.649e-02 +1.043e-01 +1.456e-03 +5.951e-02 | +0.0056/+0.0001
 2 0 | -2.234e-04 -1.144e-04 -1.036e-04 -2.162e-06 | -1.246e-01 -2.354e-01 +4.046e-02 -1.100e-02 | -0.0047/-0.0015
 2 1 | -5.762e-05 -3.977e-04 -1.179e-04 -1.402e-05 | -1.905e-01 -3.925e-01 -3.225e-01 -3.827e-02 | -0.0062/-0.0046
 2 2 | +3.625e-05 -2.955e-04 +6.985e-05 +3.200e-05 | -9.712e-02 -3.401e-01 -1.909e-02 -3.208e-02 | -0.0022/-0.0023
 2 3 | -9.066e-05 -1.686e-04 +2.164e-05 -1.440e-05 | -1.012e-01 -2.010e-02 -1.932e-01 -7.504e-02 | -0.0031/-0.0019
 3 0 | +2.612e-05 +1.446e-04 +4.930e-05 +4.571e-06 | +4.033e-02 -3.268e-02 +2.178e-01 -1.438e-03 | +0.0028/+0.0006
 3 1 | +2.671e-05 -1.012e-04 -1.161e-04 -3.551e-05 | +2.470e-01 -1.858e-02 +2.541e-01 -9.929e-02 | -0.0026/+0.0016
 3 2 | +3.592e-06 +9.932e-05 +7.915e-07 -1.477e-05 | -1.157e-01 +2.501e-01 +8.953e-02 +4.512e-02 | +0.0014/+0.0007
 3 3 | -9.374e-06 +4.009e-05 -1.010e-04 +3.735e-06 | -3.264e-02 -5.513e-02 +1.269e-01 +1.103e-02 | -0.0010/+0.0001
 4 0 | -3.460e-05 -4.589e-06 -1.170e-05 +4.302e-06 | -5.640e-02 +6.693e-01 +2.754e-01 +3.009e-02 | -0.0007/+0.0028
 4 1 | -5.795e-05 -1.051e-04 -1.284e-04 +8.578e-06 | -2.525e-02 +4.325e-01 -4.966e-02 +1.915e-02 | -0.0037/+0.0010
 4 2 | +2.319e-05 -1.753e-04 -1.432e-05 +9.644e-06 | +2.068e-01 -4.018e-02 +1.583e-01 +2.706e-03 | -0.0021/+0.0009
 4 3 | +1.174e-04 -6.899e-05 +2.087e-05 +8.217e-07 | +1.904e-01 +3.057e-01 +1.691e-01 -1.148e-01 | +0.0008/+0.0017
 5 0 | -9.584e-05 +1.978e-04 -1.141e-04 -1.476e-05 | -5.965e-01 +8.794e-01 -6.799e-02 +8.844e-02 | -0.0001/+0.0003
 5 1 | -7.532e-05 -1.589e-04 +2.816e-05 +2.962e-05 | -3.773e-01 -5.285e-01 -5.491e-01 +1.174e-02 | -0.0021/-0.0026
 5 2 | -5.382e-05 -1.362e-04 -2.584e-05 +5.424e-05 | -3.271e-01 +7.852e-02 -4.458e-01 -8.435e-02 | -0.0023/-0.0015
 5 3 | -1.199e-04 -1.894e-04 -7.591e-05 +1.401e-05 | -3.612e-01 -1.628e-01 -6.249e-01 -6.396e-02 | -0.0041/-0.0024
 6 0 | -6.113e-05 +6.181e-05 +8.051e-05 -3.119e-05 | -6.087e-02 +3.093e-01 +3.478e-01 -1.870e-01 | +0.0009/+0.0018
 6 1 | -9.747e-05 +9.042e-05 +1.703e-05 -2.277e-05 | +2.766e-02 +4.876e-01 +5.275e-02 -1.725e-01 | +0.0001/+0.0017
 6 2 | -6.617e-05 +1.577e-04 +2.852e-05 -1.995e-05 | -2.252e-01 +4.750e-01 +1.864e-01 -1.470e-01 | +0.0014/+0.0014
 6 3 | +3.853e-05 -3.718e-05 +4.374e-05 -1.882e-05 | -4.244e-02 -9.812e-02 +8.621e-02 -9.280e-02 | +0.0005/-0.0002
 7 0 | +9.261e-06 +5.846e-05 +2.114e-05 -7.464e-06 | -2.029e-01 +2.008e-01 +2.214e-01 -3.018e-02 | +0.0011/+0.0005
 7 1 | -8.895e-05 +5.553e-05 -6.374e-05 -2.865e-05 | -4.135e-01 +7.513e-01 +1.823e-02 -4.279e-03 | -0.0009/+0.0006
 7 2 | -1.070e-05 +2.329e-05 +1.414e-04 +2.291e-05 | -1.814e-01 -1.404e-01 +4.493e-01 +8.013e-02 | +0.0020/+0.0003
 7 3 | -1.304e-05 +3.877e-06 +8.273e-05 -1.877e-06 | -9.297e-02 +4.669e-02 +3.340e-02 -1.463e-02 | +0.0010/-0.0000
 8 0 | +2.066e-05 +6.176e-05 +3.464e-05 +2.247e-05 | +7.010e-02 +1.955e+00 -4.819e-02 +1.535e-01 | +0.0012/+0.0036
 8 1 | +3.705e-05 +1.977e-05 -7.065e-05 +5.812e-06 | -8.126e-02 +9.363e-01 +1.435e-01 -8.652e-02 | -0.0002/+0.0021
 8 2 | +1.458e-05 +7.200e-05 +5.185e-05 +1.183e-05 | -4.756e-02 +7.502e-01 +3.289e-01 +4.434e-02 | +0.0018/+0.0022
 8 3 | +3.271e-05 -2.319e-05 +2.421e-06 -2.429e-06 | -2.200e-01 +9.625e-01 -2.102e-01 -1.176e-01 | +0.0001/+0.0011
 9 0 | +7.906e-05 +1.478e-05 +1.694e-05 +1.440e-05 | -9.563e-02 +7.987e-01 +2.286e-01 +9.214e-02 | +0.0011/+0.0017
 9 1 | +5.311e-06 +1.864e-04 +8.521e-05 -1.471e-06 | -6.076e-03 +7.820e-01 +7.805e-01 -1.934e-01 | +0.0026/+0.0025
 9 2 | +3.212e-05 +7.119e-05 -3.529e-05 +1.462e-06 | -1.807e-01 +5.384e-01 +1.265e-01 +8.873e-03 | +0.0008/+0.0009
 9 3 | -8.950e-06 -2.193e-05 -1.028e-05 -5.813e-06 | -2.078e-01 -2.327e-01 +3.114e-01 -2.526e-02 | -0.0005/-0.0003
10 0 | -6.624e-05 +1.078e-04 -8.822e-05 -4.437e-05 | -9.958e-01 +2.159e+00 +6.378e-01 -1.998e-01 | -0.0004/+0.0013
10 1 | +1.129e-04 -4.291e-05 -2.459e-05 -1.864e-05 | -2.737e-01 -2.762e-01 -1.589e-01 -2.487e-01 | +0.0005/-0.0006
10 2 | -1.510e-05 +4.007e-05 +1.505e-04 -2.337e-05 | -1.341e+00 +5.806e-01 +4.083e-01 -1.789e-01 | +0.0015/-0.0003
10 3 | +8.388e-05 +1.182e-04 -4.943e-05 -2.174e-05 | -2.503e-01 -1.033e+00 -5.902e-01 -1.196e-01 | +0.0013/-0.0014
11 0 | -3.074e-05 +9.612e-07 -1.152e-05 -3.662e-05 | -2.840e-01 +3.029e-01 -1.178e+00 +2.923e-02 | -0.0004/-0.0009
11 1 | +1.264e-05 -5.475e-06 -1.047e-04 -3.599e-06 | -2.086e+00 -2.070e+00 -1.758e+00 -2.601e-01 | -0.0010/-0.0047
11 2 | +2.092e-05 -1.038e-04 +1.550e-05 -4.138e-05 | +3.902e-01 -7.437e+00 +9.323e-01 -3.076e-01 | -0.0006/-0.0028
11 3 | +1.965e-04 +1.190e-04 -6.794e-05 +3.289e-05 | +4.616e-01 +5.268e+00 -2.145e+00 +4.849e-02 | +0.0023/+0.0018
12 0 | +7.603e-05 -7.576e-05 -1.053e-04 -3.116e-05 | -3.893e+00 -1.535e+00 -2.377e+00 -7.683e-01 | -0.0010/-0.0017
12 1 | +1.187e-05 +1.437e-04 -1.392e-04 -2.765e-05 | -9.164e-01 +9.634e+00 -5.317e+00 -1.688e+00 | +0.0002/+0.0006
12 2 | +2.426e-06 -2.717e-05 -1.005e-04 -3.684e-05 | -2.188e+00 +5.380e-01 -2.547e+00 -1.025e+00 | -0.0012/-0.0008
12 3 | +1.688e-05 +2.055e-04 -1.661e-04 -3.389e-05 | -1.266e+00 +1.055e+01 -1.260e+00 -9.032e-01 | +0.0005/+0.0017
13 0 | +2.010e-06 -2.264e-04 -9.005e-05 -2.782e-05 | -1.431e-01 -4.060e+00 -3.663e+00 +4.344e-01 | -0.0035/-0.0028
13 1 | +8.854e-05 -2.628e-04 -6.260e-05 -2.895e-05 | -1.596e+00 -6.450e+00 -3.888e+00 -1.387e-01 | -0.0027/-0.0046
13 2 | +3.051e-06 -1.311e-04 +1.015e-05 -5.161e-06 | -1.591e+00 +2.455e+00 -5.384e-01 +6.030e-02 | -0.0014/+0.0001
13 3 | +4.582e-05 +5.363e-05 -7.144e-05 -1.116e-05 | +1.744e+00 +4.814e+00 -6.198e+00 -3.317e-01 | +0.0003/+0.0001
14 0 | -5.941e-05 +1.570e-04 -5.178e-06 -3.261e-05 | -3.410e+00 -9.342e-01 +1.461e+00 -3.556e-02 | +0.0011/-0.0007
14 1 | +2.762e-05 +6.103e-05 +1.383e-04 -1.440e-05 | -6.465e+00 +8.588e-01 +3.060e+00 -2.122e+00 | +0.0025/-0.0005
14 2 | +3.917e-05 -2.228e-04 -8.540e-06 -2.519e-05 | -3.608e+00 -1.163e+01 +4.333e+00 -1.227e+00 | -0.0019/-0.0018
14 3 | -4.254e-06 -1.750e-04 -1.466e-04 -2.881e-05 | +1.760e+00 -1.311e+01 -4.630e+00 -2.055e+00 | -0.0032/-0.0032
15 0 | +1.752e-04 +1.180e-04 -4.634e-05 +2.210e-05 | +4.374e+00 -1.471e+01 -2.904e+00 +4.183e-01 | +0.0029/-0.0022
15 1 | +1.882e-05 -1.310e-04 -7.615e-05 +2.221e-06 | -1.850e+00 -3.060e+01 -6.589e-01 +3.448e-01 | -0.0015/-0.0039
15 2 | -2.831e-06 -2.025e-04 -9.592e-05 +3.203e-06 | +4.271e-01 -6.249e+00 -1.018e+01 -1.300e+00 | -0.0031/-0.0022
15 3 | +1.025e-04 +2.426e-04 -8.304e-05 +6.751e-06 | +6.278e+00 +2.143e+00 -9.395e+00 +3.308e-01 | +0.0029/-0.0001
16 0 | -5.338e-05 +1.057e-04 -1.357e-04 -1.489e-05 | -3.384e+00 +7.182e+00 -5.596e+00 -1.372e+00 | -0.0010/-0.0004
16 1 | -2.877e-05 -2.110e-04 -4.857e-05 -7.665e-06 | -1.463e+00 -2.299e+01 +2.162e+00 +3.232e-01 | -0.0035/-0.0049
16 2 | -5.511e-06 -7.508e-05 -1.008e-04 -9.270e-06 | +1.640e+00 -4.755e+00 -1.757e+00 -9.887e-02 | -0.0021/-0.0010
16 3 | -3.706e-05 -7.683e-05 -1.076e-04 +3.314e-06 | +7.305e-01 -8.750e+00 +2.175e+00 +7.243e-01 | -0.0027/-0.0013
17 0 | -2.961e-06 -3.004e-04 -1.069e-04 +1.472e-05 | +4.449e+00 +2.222e+00 -1.319e+00 -4.775e-01 | -0.0050/+0.0018
17 1 | -8.941e-05 +4.103e-05 -9.144e-05 -2.437e-05 | -2.153e-02 +2.487e+00 -2.208e+00 -9.906e-01 | -0.0016/+0.0001
17 2 | -5.081e-05 +8.491e-05 -1.728e-04 -8.637e-06 | +3.322e+00 +1.042e+01 +2.899e-02 -9.400e-03 | -0.0018/+0.0048
17 3 | +6.962e-05 -5.406e-04 -5.950e-05 +1.611e-05 | +3.816e+00 +2.458e+00 -5.681e-01 +1.063e+00 | -0.0069/+0.0022

=== STRONGEST SIGNED ANSWER-CONTRAST ALIGNMENTS ===
raw A-favouring
  L17H3 align=-0.00691 delta_F=0.113; labels: A=-0.01494, B=-0.01487; numbers: A=-0.02885, B=-0.02939; binary: A=-0.02211, B=-0.02217; control: A=-0.01252, B=-0.01251
  L2H1 align=-0.00621 delta_F=0.136; labels: A=-0.0808, B=-0.08085; numbers: A=-0.07867, B=-0.07906; binary: A=-0.07656, B=-0.07667; control: A=-0.07698, B=-0.07699
  L17H0 align=-0.00502 delta_F=0.1203; labels: A=+0.003263, B=+0.00326; numbers: A=-0.0172, B=-0.0175; binary: A=+0.03037, B=+0.03027; control: A=+0.06043, B=+0.06044
  L2H0 align=-0.00471 delta_F=0.138; labels: A=+0.03297, B=+0.03274; numbers: A=+0.06051, B=+0.0604; binary: A=+0.05009, B=+0.04999; control: A=+0.05928, B=+0.05928
  L0H1 align=-0.00432 delta_F=0.1126; labels: A=-0.0935, B=-0.0935; numbers: A=-0.1207, B=-0.1209; binary: A=-0.07677, B=-0.07689; control: A=-0.08107, B=-0.08122
raw B-favouring
  L1H1 align=+0.00870 delta_F=0.1256; labels: A=-0.01907, B=-0.019; numbers: A=-0.009431, B=-0.008897; binary: A=-0.0105, B=-0.01036; control: A=+0.009714, B=+0.009746
  L1H2 align=+0.00633 delta_F=0.1129; labels: A=-0.003449, B=-0.003416; numbers: A=-0.006616, B=-0.006254; binary: A=+0.0124, B=+0.01249; control: A=+0.02177, B=+0.02182
  L1H3 align=+0.00559 delta_F=0.11; labels: A=-0.01629, B=-0.01633; numbers: A=-0.02863, B=-0.02827; binary: A=-0.02491, B=-0.02482; control: A=-0.002737, B=-0.002725
  L0H0 align=+0.00297 delta_F=0.131; labels: A=+0.003037, B=+0.003546; numbers: A=+0.02219, B=+0.02181; binary: A=+0.06034, B=+0.06048; control: A=+0.0542, B=+0.05423
  L15H0 align=+0.00294 delta_F=0.1238; labels: A=+0.04726, B=+0.04744; numbers: A=+0.0811, B=+0.08122; binary: A=+0.1404, B=+0.1404; control: A=+0.1857, B=+0.1858
diag A-favouring
  L16H1 align=-0.00495 delta_F=6637; labels: A=-164.1, B=-165.5; numbers: A=+241.6, B=+218.6; binary: A=+860.2, B=+862.4; control: A=+1458, B=+1458
  L11H1 align=-0.00468 delta_F=1861; labels: A=+883, B=+880.9; numbers: A=+1384, B=+1381; binary: A=+1098, B=+1096; control: A=+1217, B=+1217
  L13H1 align=-0.00464 delta_F=3785; labels: A=+274.8, B=+273.2; numbers: A=+419.7, B=+413.3; binary: A=+458.7, B=+454.9; control: A=+832, B=+831.9
  L2H1 align=-0.00459 delta_F=290.2; labels: A=-20.8, B=-20.99; numbers: A=-23.82, B=-24.22; binary: A=-25.24, B=-25.56; control: A=-38.87, B=-38.91
  L15H1 align=-0.00390 delta_F=1.25e+04; labels: A=-5833, B=-5834; numbers: A=-1.057e+04, B=-1.061e+04; binary: A=-7255, B=-7256; control: A=-1.035e+04, B=-1.035e+04
diag B-favouring
  L17H2 align=+0.00482 delta_F=4207; labels: A=+44.79, B=+48.11; numbers: A=+124.3, B=+134.8; binary: A=-109.2, B=-109.2; control: A=-1036, B=-1036
  L8H0 align=+0.00355 delta_F=819.9; labels: A=-465.8, B=-465.7; numbers: A=-510.1, B=-508.2; binary: A=-505.6, B=-505.7; control: A=-526.7, B=-526.5
  L4H0 align=+0.00278 delta_F=470.4; labels: A=-2.442, B=-2.498; numbers: A=+29.69, B=+30.36; binary: A=-10.72, B=-10.44; control: A=+11.96, B=+11.99
  L9H1 align=+0.00254 delta_F=901.7; labels: A=-523.9, B=-523.9; numbers: A=-742.4, B=-741.6; binary: A=-703.2, B=-702.4; control: A=-930.9, B=-931.1
  L8H2 align=+0.00221 delta_F=686.8; labels: A=+250.4, B=+250.4; numbers: A=+200.9, B=+201.7; binary: A=+246.3, B=+246.7; control: A=+272.3, B=+272.4

=== CROSS-GEOMETRY AND GROUP CONSISTENCY ===
Raw/diag alignment correlation: 0.3780584558295667
Matching raw/diag signs: 48 / 72
raw
  labels: sum_delta=+0.000280163, median_delta=+2.73832e-06, positive_heads=38/72
  numbers: sum_delta=-0.00135354, median_delta=-1.81373e-06, positive_heads=36/72
  binary: sum_delta=-0.0019615, median_delta=-3.05653e-05, positive_heads=27/72
  control: sum_delta=-0.000772288, median_delta=-6.63836e-06, positive_heads=29/72
diag
  labels: sum_delta=-11.1974, median_delta=-0.0943003, positive_heads=21/72
  numbers: sum_delta=-63.4454, median_delta=+0.0914198, positive_heads=38/72
  binary: sum_delta=-53.1685, median_delta=-0.0038408, positive_heads=36/72
  control: sum_delta=-12.9893, median_delta=-0.0299127, positive_heads=27/72
These aggregate sums do not represent a composed network computation.
