Definitions:
QK_proj = Q_h.T @ K; this omits rotary displacement and all normalization.
QK_gain = Din @ Q_h.T @ Dq @ Dk @ K @ Din.
OV_proj = O_h @ V.
OV_gain = Dout @ O_h @ V @ Din.
Din,Dout,Dq,Dk contain 1 + the respective stored Gemma norm weights.
QK_gain describes the zero-rotary-displacement numerator coefficient only.
Input-dependent RMS denominators and attention weights are NOT evaluated.
OV_gain also omits the post-attention RMS denominator.
Relative deltas measure algebraic change, not behavioral importance.

=== ALL HEADS: RELATIVE COMPOSED-MATRIX DIFFERENCES ===
layer head   QK_proj    OV_proj    QK_gain    OV_gain    idcos_A    idcos_B
    0    0   0.005334   0.007786   0.011163   0.011054   0.103552   0.103565
    0    1   0.007700   0.011547   0.010115   0.024868  -0.183389  -0.183401
    0    2   0.005378   0.010585   0.007537   0.014102  -0.003221  -0.003218
    0    3   0.007539   0.007854   0.011331   0.012532   0.106029   0.106021
    1    0   0.008215   0.013182   0.010883   0.011180   0.098098   0.098099
    1    1   0.008870   0.012308   0.010171   0.010711   0.041075   0.041075
    1    2   0.006892   0.011747   0.013119   0.008478   0.089314   0.089308
    1    3   0.008594   0.011524   0.010397   0.010852   0.008582   0.008573
    2    0   0.010115   0.010374   0.011642   0.016601   0.130267   0.130281
    2    1   0.009878   0.009934   0.009086   0.016385  -0.145308  -0.145292
    2    2   0.010521   0.008974   0.012688   0.011406  -0.040990  -0.040959
    2    3   0.009711   0.012631   0.013747   0.020097  -0.026253  -0.026232
    3    0   0.010749   0.011673   0.009135   0.015997  -0.153239  -0.153239
    3    1   0.013065   0.013583   0.018856   0.018226   0.066119   0.066142
    3    2   0.011435   0.012898   0.012321   0.015433   0.265394   0.265381
    3    3   0.008663   0.018757   0.006348   0.021373  -0.055418  -0.055387
    4    0   0.012379   0.015969   0.013420   0.023085   0.042516   0.042489
    4    1   0.014350   0.017471   0.020184   0.026470   0.076625   0.076630
    4    2   0.012041   0.014212   0.015449   0.023507  -0.005284  -0.005260
    4    3   0.012739   0.010463   0.013534   0.017466  -0.023408  -0.023425
    5    0   0.011406   0.009443   0.023163   0.008695   0.098368   0.098361
    5    1   0.011218   0.011171   0.017569   0.014213   0.039507   0.039471
    5    2   0.010213   0.012323   0.018046   0.015055   0.105120   0.105111
    5    3   0.010785   0.013757   0.023867   0.014285  -0.101361  -0.101359
    6    0   0.008513   0.011222   0.013487   0.017092   0.114604   0.114575
    6    1   0.008504   0.009595   0.015426   0.013170  -0.139894  -0.139875
    6    2   0.008670   0.012318   0.022172   0.016797   0.193654   0.193683
    6    3   0.009557   0.010982   0.016742   0.015124   0.111141   0.111135
    7    0   0.008747   0.012371   0.013641   0.013314   0.334761   0.334724
    7    1   0.009256   0.008696   0.017391   0.010577  -0.443072  -0.443041
    7    2   0.008073   0.010506   0.013952   0.009982   0.231886   0.231931
    7    3   0.008256   0.013764   0.020255   0.016864   0.209415   0.209431
    8    0   0.011879   0.011056   0.012132   0.011668  -0.243233  -0.243237
    8    1   0.011946   0.012685   0.011841   0.016749   0.118443   0.118453
    8    2   0.014726   0.013952   0.017191   0.019939   0.169079   0.169064
    8    3   0.012088   0.010997   0.012952   0.014956   0.029776   0.029808
    9    0   0.010863   0.011667   0.018032   0.014690   0.063454   0.063478
    9    1   0.010813   0.008552   0.015155   0.011323  -0.231006  -0.230976
    9    2   0.010046   0.011135   0.018092   0.014265   0.241180   0.241190
    9    3   0.008948   0.011013   0.012117   0.012531   0.116382   0.116400
   10    0   0.011374   0.010328   0.020639   0.010465   0.205728   0.205731
   10    1   0.010315   0.010305   0.030993   0.011835  -0.007619  -0.007585
   10    2   0.009215   0.012276   0.009798   0.014278   0.136986   0.136989
   10    3   0.010521   0.008008   0.016017   0.007391  -0.030969  -0.030956
   11    0   0.013583   0.011565   0.046820   0.011991   0.047496   0.047525
   11    1   0.014327   0.012889   0.041715   0.021512   0.406580   0.406591
   11    2   0.008860   0.009253   0.017931   0.010287   0.095445   0.095483
   11    3   0.011252   0.008213   0.026073   0.008360  -0.167338  -0.167339
   12    0   0.008877   0.011678   0.025957   0.013917  -0.065029  -0.065020
   12    1   0.008224   0.011095   0.021437   0.012802   0.013384   0.013382
   12    2   0.008662   0.009177   0.031575   0.009355   0.135142   0.135139
   12    3   0.008429   0.012724   0.027408   0.012362   0.071061   0.071048
   13    0   0.010373   0.011777   0.017174   0.011204   0.052580   0.052581
   13    1   0.012406   0.013124   0.023564   0.013774   0.097334   0.097350
   13    2   0.011856   0.011928   0.022201   0.013848   0.228340   0.228330
   13    3   0.009153   0.010959   0.014310   0.008849  -0.013938  -0.013928
   14    0   0.006739   0.008132   0.016154   0.008237  -0.026107  -0.026094
   14    1   0.007077   0.009077   0.023200   0.008997   0.271117   0.271135
   14    2   0.006933   0.010889   0.018169   0.010064   0.080268   0.080260
   14    3   0.007617   0.009153   0.020237   0.008988   0.041773   0.041758
   15    0   0.011093   0.010662   0.022944   0.012906   0.339429   0.339407
   15    1   0.012488   0.011927   0.014912   0.017297  -0.457098  -0.457070
   15    2   0.011702   0.013904   0.020235   0.020115   0.286934   0.286942
   15    3   0.010221   0.011618   0.012848   0.016053   0.380113   0.380116
   16    0   0.012158   0.015143   0.015620   0.013862   0.036615   0.036590
   16    1   0.013253   0.016821   0.017163   0.016017   0.131850   0.131819
   16    2   0.012717   0.012648   0.016345   0.012559   0.227631   0.227612
   16    3   0.010322   0.016986   0.011880   0.015462   0.014289   0.014266
   17    0   0.009117   0.008122   0.017140   0.007230   0.103428   0.103384
   17    1   0.010300   0.011828   0.025192   0.014950   0.461102   0.461106
   17    2   0.009810   0.010355   0.009928   0.009757   0.001531   0.001504
   17    3   0.008335   0.009636   0.014887   0.010278  -0.027964  -0.027990

=== TOP 10 BY EACH GAIN-FOLDED RELATIVE DIFFERENCE ===

 qk_gain
  L11 H0: relative=0.04682, delta_norm=37.9782, norm_A=811.165, norm_B=811.143
  L11 H1: relative=0.0417151, delta_norm=49.0323, norm_A=1175.43, norm_B=1175.39
  L12 H2: relative=0.0315751, delta_norm=393.253, norm_A=12443.3, norm_B=12465.8
  L10 H1: relative=0.0309925, delta_norm=295.631, norm_A=9539.07, norm_B=9538.51
  L12 H3: relative=0.0274083, delta_norm=363.679, norm_A=13267.6, norm_B=13270.2
  L11 H3: relative=0.0260726, delta_norm=32.4221, norm_A=1242.98, norm_B=1244.08
  L12 H0: relative=0.0259568, delta_norm=329.207, norm_A=12684.1, norm_B=12681.6
  L17 H1: relative=0.0251923, delta_norm=420.477, norm_A=16703.1, norm_B=16678.3
  L05 H3: relative=0.0238668, delta_norm=371.858, norm_A=15576.9, norm_B=15584.2
  L13 H1: relative=0.0235637, delta_norm=218.036, norm_A=9250.5, norm_B=9255.63

 ov_gain
  L04 H1: relative=0.0264703, delta_norm=73.18, norm_A=2764.7, norm_B=2764.5
  L00 H1: relative=0.0248683, delta_norm=4.20184, norm_A=168.73, norm_B=169.198
  L04 H2: relative=0.0235072, delta_norm=103.778, norm_A=4407.95, norm_B=4421.53
  L04 H0: relative=0.0230845, delta_norm=87.0089, norm_A=3770.11, norm_B=3768.18
  L11 H1: relative=0.0215124, delta_norm=241.61, norm_A=11228.3, norm_B=11234
  L03 H3: relative=0.0213732, delta_norm=40.2123, norm_A=1882.73, norm_B=1880.14
  L15 H2: relative=0.0201153, delta_norm=1460.55, norm_A=72612.1, norm_B=72605.1
  L02 H3: relative=0.0200968, delta_norm=21.4079, norm_A=1064.87, norm_B=1065.61
  L08 H2: relative=0.0199385, delta_norm=80.9128, norm_A=4059.66, norm_B=4056.57
  L03 H1: relative=0.0182264, delta_norm=40.7877, norm_A=2238.81, norm_B=2236.87

=== PROJECTION-ONLY VS GAIN-FOLDED RANK AGREEMENT ===
qk rank correlation = 0.23278 ; top-10 overlap = 3
ov rank correlation = 0.67432 ; top-10 overlap = 6

Identity alignment is a residual-space matrix diagnostic only.
It cannot establish that a head attends to a user's guess, or copies its tokens.
Elapsed seconds: 0.56
