QUERY-KEY WEIGHT-PRODUCT DIFFERENCES, A-B
No hidden-state or q/k RMS denominators are included.
Probe = (response-minus-question)^T deltaQK (guess-minus-evidence).
A positive value is only a lexical routing proxy, not actual attention.
L5H2 raw[d0,d6,d9]=[0.0001 0.0002 0.0002] gained[d0,d6,d9]=[0.0439 0.0131 0.0587]
L5H3 raw[d0,d6,d9]=[0.0002 0.0001 0.0006] gained[d0,d6,d9]=[0.2053 0.2646 0.3215]
L9H0 raw[d0,d6,d9]=[-0.0002  0.0001  0.0002] gained[d0,d6,d9]=[ 0.0237 -0.0819  0.043 ]
L9H1 raw[d0,d6,d9]=[-0.0002 -0.     -0.0001] gained[d0,d6,d9]=[0.0152 0.0265 0.104 ]
L9H2 raw[d0,d6,d9]=[-0.0001 -0.0003 -0.0003] gained[d0,d6,d9]=[-0.2028 -0.4279 -0.4948]
L9H3 raw[d0,d6,d9]=[-0.0005 -0.0003 -0.0002] gained[d0,d6,d9]=[-0.3764 -0.2339 -0.1641]
L10H2 raw[d0,d6,d9]=[0.0002 0.0001 0.0003] gained[d0,d6,d9]=[-0.097  -0.2217 -0.1451]
L11H2 raw[d0,d6,d9]=[0.0002 0.0001 0.0002] gained[d0,d6,d9]=[-0.0188 -0.0206 -0.0188]
L12H1 raw[d0,d6,d9]=[ 0.0003  0.0005 -0.0008] gained[d0,d6,d9]=[-1.0265 -1.1961 -1.2966]
L12H2 raw[d0,d6,d9]=[0.0004 0.0006 0.0005] gained[d0,d6,d9]=[0.3901 0.3423 0.2443]
L16H3 raw[d0,d6,d9]=[-0.0001 -0.0001 -0.0003] gained[d0,d6,d9]=[-1.3016 -0.7963 -1.078 ]
L17H2 raw[d0,d6,d9]=[ 0.0004  0.0001 -0.    ] gained[d0,d6,d9]=[0.5044 0.5462 0.5333]

DOMINANT BILINEAR ROUTING CHANGES, WITH GAINS, DISTANCE 9
Paired SVD signs are arbitrary: flipping both preserves the map.

L5H2: top1_energy=0.286, query_change_norm=338.45, key_change_norm=123.21, term_cosine=0.055, total_norm=366.53
query direction +: [('alc', 0.18), ('cemos', 0.158), (' Coyote', 0.152), (' ico', 0.152)] -: [('Jane', -0.156), (' biology', -0.146), (' Jeanne', -0.144), (' bride', -0.139)]
key direction +: [(' IBA', 0.155), ('Ast', 0.15), (' Plante', 0.148), (' Ast', 0.14)] -: [(' Julie', -0.157), (' Joh', -0.153), (' Meier', -0.151), ('Joh', -0.15)]

L5H3: top1_energy=0.171, query_change_norm=344.88, key_change_norm=130.26, term_cosine=0.070, total_norm=377.12
query direction +: [(' KAR', 0.177), (' Karlsruhe', 0.161), ('Rom', 0.151), (' woman', 0.149)] -: [('cei', -0.167), ('fog', -0.157), (' Laff', -0.154), ('splice', -0.147)]
key direction +: [(' Rach', 0.144), (' AFF', 0.144), (' Plata', 0.143), (' CAA', 0.14)] -: [(' Jalis', -0.162), (' Barber', -0.158), (' Jenner', -0.147), (' barber', -0.139)]

L9H0: top1_energy=0.176, query_change_norm=172.48, key_change_norm=185.29, term_cosine=0.058, total_norm=260.33
query direction +: [('PROFILE', 0.156), (' Brewery', 0.155), (' Opera', 0.15), (' Salom', 0.147)] -: [(' seis', -0.149), (' scrambled', -0.148), ('minen', -0.148), (' kines', -0.145)]
key direction +: [(' authorization', 0.153), (' USAID', 0.153), (' dysph', 0.152), (' localization', 0.151)] -: [('xy', -0.162), (' killer', -0.162), ('mph', -0.152), (' ACP', -0.148)]

L9H1: top1_energy=0.219, query_change_norm=154.99, key_change_norm=158.38, term_cosine=0.059, total_norm=228.06
query direction +: [(' REPORTER', 0.165), (' WIP', 0.162), ('eworld', 0.157), (' biofilms', 0.156)] -: [(' six', -0.209), (' eight', -0.187), (' four', -0.184), (' five', -0.181)]
key direction +: [(' Herv', 0.151), ('ilidad', 0.146), (' volcan', 0.145), ('LOT', 0.139)] -: [(' Holz', -0.175), ('Adams', -0.173), (' Mackey', -0.166), ('Mp', -0.165)]

L9H2: top1_energy=0.173, query_change_norm=165.61, key_change_norm=199.41, term_cosine=0.053, total_norm=265.87
query direction +: [(' Swezey', 0.17), ('OPERATION', 0.167), (' biofilms', 0.158), ('SERVICIO', 0.153)] -: [(' Pb', -0.166), (' PB', -0.165), (' BAC', -0.157), (' Plat', -0.156)]
key direction +: [(' urination', 0.161), (' Urology', 0.151), (' females', 0.151), (' suffrage', 0.144)] -: [('vm', -0.173), ('Ram', -0.166), (' Ml', -0.164), (' Sherwood', -0.159)]

L9H3: top1_energy=0.164, query_change_norm=170.29, key_change_norm=157.07, term_cosine=0.038, total_norm=235.99
query direction +: [('rau', 0.168), (' EBR', 0.149), ('ROff', 0.147), (' Journ', 0.145)] -: [(' kines', -0.159), (' four', -0.155), ('IDE', -0.151), ('Dart', -0.149)]
key direction +: [(' negotiations', 0.166), (' females', 0.159), (' widows', 0.155), (' gyne', 0.154)] -: [(' Smyth', -0.195), (' Patterson', -0.164), (' disciplina', -0.164), (' medir', -0.162)]

L10H2: top1_energy=0.216, query_change_norm=225.68, key_change_norm=237.1, term_cosine=0.071, total_norm=338.82
query direction +: [(' TREAT', 0.174), ('RESS', 0.17), (' adata', 0.166), ('Berat', 0.153)] -: [(' wheelchair', -0.166), (' morte', -0.157), (' causative', -0.155), ('cin', -0.154)]
key direction +: [(' Quelle', 0.186), ('Bless', 0.167), ('PROM', 0.165), (' Vote', 0.162)] -: [(' feu', -0.164), ('weighted', -0.16), (' tim', -0.156), (' phone', -0.155)]

L11H2: top1_energy=0.196, query_change_norm=18.028, key_change_norm=21.509, term_cosine=-0.006, total_norm=27.98
query direction +: [('vq', 0.186), ('eight', 0.183), (' eight', 0.176), (' neun', 0.172)] -: [(' INDI', -0.162), (' imong', -0.153), (' frmt', -0.153), ('orni', -0.15)]
key direction +: [(' Provence', 0.201), ('Endpoint', 0.184), (' articul', 0.175), ('VERTEX', 0.166)] -: [(' trzech', -0.163), ('efficients', -0.163), (' accounted', -0.151), (' cinq', -0.149)]

L12H1: top1_energy=0.392, query_change_norm=305.62, key_change_norm=203.55, term_cosine=0.073, total_norm=379.42
query direction +: [(' Headline', 0.175), (' fertiliser', 0.165), (' Turf', 0.162), (' Crop', 0.161)] -: [('games', -0.172), ('arcade', -0.168), (' juegos', -0.157), (' gaming', -0.156)]
key direction +: [(' sieben', 0.207), ('eight', 0.203), (' sechs', 0.195), (' zehn', 0.194)] -: [(' territo', -0.185), (' defray', -0.166), (' submer', -0.163), (' reinvest', -0.16)]

L12H2: top1_energy=0.279, query_change_norm=350.62, key_change_norm=183.35, term_cosine=0.048, total_norm=403.32
query direction +: [(' nuove', 0.179), (' scler', 0.171), (' distancia', 0.159), ('peso', 0.157)] -: [(' Artis', -0.18), (' proprietor', -0.177), (' Rayleigh', -0.162), ('SelectedItem', -0.152)]
key direction +: [(' disponible', 0.173), ('abc', 0.168), (' articulated', 0.158), (' fascinating', 0.151)] -: [('starttime', -0.174), (' nonexpansive', -0.165), (' Gerade', -0.163), ('ananti', -0.158)]

L16H3: top1_energy=0.168, query_change_norm=605.34, key_change_norm=455.09, term_cosine=0.063, total_norm=779.78
query direction +: [(' HAI', 0.209), (' Cote', 0.204), (' Vessel', 0.2), (' Picard', 0.184)] -: [(' und', -0.173), (' lois', -0.171), (' mengapa', -0.171), ('ajaran', -0.169)]
key direction +: [(' vier', 0.179), (' wygod', 0.176), (' sekret', 0.17), (' erziel', 0.167)] -: [(' Casting', -0.167), (' Vessel', -0.162), ('obacter', -0.159), (' shipyard', -0.158)]

L17H2: top1_energy=0.203, query_change_norm=208.02, key_change_norm=106.71, term_cosine=0.109, total_norm=243.93
query direction +: [(' pen', 0.213), (' strong', 0.194), (' amph', 0.191), (' Mono', 0.188)] -: [(' Myerson', -0.189), ('Farmer', -0.179), (' Arboretum', -0.178), (' Wiltshire', -0.174)]
key direction +: [('Vermont', 0.204), (' McClellan', 0.186), (' Westchester', 0.183), (' Tompkins', 0.18)] -: [(' plays', -0.199), (' play', -0.193), (' games', -0.177), (' game', -0.177)]

HEAD PARAMETER CHANGE PARTITION
K and V are shared across the four heads in each layer.
5 2 relative changes Q,K,V,O [0.0067 0.0064 0.0064 0.0084]
5 3 relative changes Q,K,V,O [0.0068 0.0064 0.0064 0.009 ]
9 0 relative changes Q,K,V,O [0.007  0.0068 0.0062 0.0074]
9 1 relative changes Q,K,V,O [0.0073 0.0068 0.0062 0.0055]
9 2 relative changes Q,K,V,O [0.0063 0.0068 0.0062 0.0083]
9 3 relative changes Q,K,V,O [0.007  0.0068 0.0062 0.0088]
10 2 relative changes Q,K,V,O [0.0069 0.0071 0.0062 0.0074]
11 2 relative changes Q,K,V,O [0.0073 0.0066 0.0063 0.006 ]
12 1 relative changes Q,K,V,O [0.0073 0.0075 0.0056 0.0079]
12 2 relative changes Q,K,V,O [0.0076 0.0075 0.0056 0.0065]
16 3 relative changes Q,K,V,O [0.0065 0.0068 0.0064 0.0117]
17 2 relative changes Q,K,V,O [0.0074 0.0062 0.0056 0.0072]
