OUTPUT of run 5 of at most 60:
```
QK numerator coefficient at displacement r: Xq.T @ R(r) @ Xk.
No positional sequence, hidden state, softmax, or RMS evaluation is used.
Denominator descriptors are (Q Din).T@(Q Din) and (K Din).T@(K Din).
Their relative changes are not actual changes in normalization on a prompt.

=== TOP 15 HEADS BY MEDIAN ROTARY QK RELATIVE DIFFERENCE ===
 L  H    minimum    median   maximum  Qden_rel  Kden_rel  Qshare  Kshare
11  0   0.025974  0.037805  0.046820  0.004515  0.007676   0.312   0.688
11  1   0.024735  0.034096  0.041715  0.004641  0.007676   0.202   0.798
12  2   0.026668  0.029401  0.031575  0.005371  0.004975   0.803   0.197
12  3   0.024077  0.025671  0.027408  0.005657  0.004975   0.801   0.199
11  3   0.020473  0.024892  0.026073  0.005973  0.007676   0.401   0.599
12  0   0.021953  0.024269  0.025957  0.008908  0.004975   0.726   0.274
 5  3   0.020547  0.022920  0.023867  0.004638  0.002711   0.839   0.161
 5  0   0.019852  0.022627  0.023163  0.003793  0.002711   0.817   0.183
10  1   0.016326  0.022184  0.030993  0.002902  0.003891   0.635   0.365
17  1   0.019357  0.021027  0.025192  0.003741  0.002688   0.626   0.374
12  1   0.019567  0.020510  0.021437  0.005583  0.004975   0.673   0.327
14  1   0.014461  0.018374  0.023200  0.003065  0.003188   0.735   0.265
10  0   0.012261  0.018266  0.020639  0.004201  0.003891   0.561   0.439
15  0   0.015613  0.018133  0.022944  0.004024  0.004188   0.454   0.546
15  2   0.016735  0.018059  0.020235  0.004923  0.004188   0.541   0.459

=== TOP 12 OV HEADS: SOURCE OF COMPOSED DIFFERENCE ===
 L  H   OV_rel  Oside_share Vside_share cosine_between_terms
 4  1  0.026470      0.8588      0.1412              0.12441
 0  1  0.024868      0.9267      0.0733              0.07196
 4  2  0.023507      0.8334      0.1666              0.27127
 4  0  0.023085      0.9076      0.0924              0.05853
11  1  0.021512      0.9019      0.0981              0.12113
 3  3  0.021373      0.7505      0.2495              0.12884
15  2  0.020115      0.5278      0.4722              0.19730
 2  3  0.020097      0.8290      0.1710              0.14591
 8  2  0.019939      0.8499      0.1501              0.10595
 3  1  0.018226      0.6946      0.3054              0.21634
 4  3  0.017466      0.7420      0.2580              0.37231
15  1  0.017297      0.3567      0.6433              0.03848

=== ROTARY PROFILE OF PREVIOUS LEADING QK CANDIDATES ===
L10 H1: 0:0.03099, 1:0.02787, 8:0.02387, 32:0.02050, 128:0.01743, 511:0.01633
L11 H0: 0:0.04682, 1:0.04624, 8:0.04393, 32:0.03845, 128:0.03716, 511:0.02952, 2048:0.02720, 8192:0.02597
L11 H1: 0:0.04172, 1:0.04141, 8:0.03676, 32:0.03444, 128:0.03375, 511:0.02986, 2048:0.02473, 8192:0.02550
L11 H3: 0:0.02607, 1:0.02604, 8:0.02557, 32:0.02520, 128:0.02458, 511:0.02393, 2048:0.02061, 8192:0.02047
L12 H2: 0:0.03158, 1:0.03137, 8:0.03036, 32:0.02845, 128:0.02718, 511:0.02667
L12 H3: 0:0.02741, 1:0.02727, 8:0.02652, 32:0.02482, 128:0.02442, 511:0.02408
L17 H1: 0:0.02519, 1:0.02492, 8:0.02269, 32:0.02147, 128:0.01936, 511:0.01991, 2048:0.01943, 8192:0.02059

Shares are signed algebraic contributions and sum to 1 for each decomposition.
Qside includes its learned gain/input scaling; Kside is shared by four heads.
Oside includes post-attention gain; Vside includes shared V and input gain.
Maximum exact-product decomposition relative error: 3.134802076391056e-14
Elapsed seconds: 3.31

```