OUTPUT of run 8 of at most 60:
```
Exact per-unit parameter objects: gate vector g_i and P_i=d_i*u_i.T.
For folded weights, the post-FF learned diagonal is included in d_i.
The actual post-FF RMS denominator is not included or evaluated.
No GELU, gate value, hidden state, or input is evaluated.

=== WHOLE-LAYER COMPARISON OF DISTINCT PARAMETER OBJECTS ===
layer P_rel_raw P_rel_fold gate_rel_raw gate_rel_fold P_interaction_fold output_share_fold
    0  0.012343   0.022467     0.006283      0.006299           1.000165           0.93768
    1  0.017993   0.028186     0.006377      0.006450           1.001211           0.95012
    2  0.014939   0.016588     0.006407      0.006424           1.001338           0.87216
    3  0.016990   0.021804     0.006402      0.007629           1.000932           0.93132
    4  0.019327   0.029859     0.006496      0.006233           1.000521           0.96066
    5  0.011660   0.014509     0.006463      0.006415           1.001162           0.84605
    6  0.015393   0.014009     0.006576      0.006512           0.999939           0.85025
    7  0.014027   0.012787     0.006415      0.006270           1.000587           0.79599
    8  0.017374   0.016236     0.006396      0.006322           1.000526           0.89216
    9  0.013183   0.012973     0.006333      0.006296           1.000875           0.78074
   10  0.017012   0.017401     0.006379      0.006206           1.000668           0.88231
   11  0.013146   0.012084     0.006446      0.006324           1.000730           0.76959
   12  0.012754   0.012454     0.006626      0.006328           1.000587           0.73489
   13  0.017888   0.016724     0.006756      0.006622           1.000596           0.84699
   14  0.019716   0.019007     0.006895      0.006866           1.000801           0.87697
   15  0.017069   0.016763     0.006870      0.006791           1.000786           0.84441
   16  0.015554   0.015454     0.006781      0.006857           1.001232           0.82175
   17  0.015334   0.015413     0.006665      0.006910           1.000979           0.81971

=== PREVIOUS CANDIDATES: RANKS WITHIN THEIR LAYER ===
 L unit P_rank_raw P_rank_fold gate_rank_raw gate_rank_fold P_rel_fold gate_rel_fold
 0 1352          9           1           415            454   0.035993      0.004211
 0 1405        148           2          1938           1849   0.004266      0.004717
 0 1262        354           4          1691           1568   0.053911      0.003198
 1 1598         17           1            25             26   0.097475      0.007499
 4 1527       1408          40             8             13   0.105404      0.003447
 4  200        554          12          1035            898   0.081663      0.003149
 4   84       1316           1            48             40   0.007152      0.014718
 4  388        648           6          1187            695   0.077047      0.003939
 4  736          9           2           603            589   0.052307      0.005887
10 1363        186          11          1043           1725   0.026377      0.000848
10 1564         62           2           235            809   0.014171      0.001275
10 1529       1577         131          1650           1991   0.032633      0.000818
10 1869       1897         817          1828           2031   0.024710      0.000846
14  641       1956         712           416           1801   0.025967      0.000993
17 1026       2037         168             1              1   0.013242      0.005488
17 1916       1950        1201          1933           1434   0.014902      0.001919
17 1650        544          67           395            359   0.007409      0.005391

=== TOP 12 P-MATRIX CHANGES, NORMALIZED TO THEIR LAYER BASELINE ===
L04 unit   84: P_score=7.474825e-06, layer_P_delta_share=0.83842%
L04 unit  736: P_score=7.113018e-06, layer_P_delta_share=0.79784%
L00 unit 1352: P_score=6.030745e-06, layer_P_delta_share=1.19480%
L04 unit 1129: P_score=5.600337e-06, layer_P_delta_share=0.62817%
L04 unit 1713: P_score=4.379148e-06, layer_P_delta_share=0.49119%
L04 unit 1958: P_score=4.362301e-06, layer_P_delta_share=0.48930%
L04 unit  388: P_score=4.355992e-06, layer_P_delta_share=0.48859%
L01 unit 1598: P_score=4.230178e-06, layer_P_delta_share=0.53245%
L04 unit 1503: P_score=4.16713e-06, layer_P_delta_share=0.46741%
L00 unit 1405: P_score=4.162872e-06, layer_P_delta_share=0.82474%
L01 unit  463: P_score=4.102542e-06, layer_P_delta_share=0.51638%
L04 unit  158: P_score=3.639764e-06, layer_P_delta_share=0.40826%

=== TOP 12 GATE-VECTOR CHANGES, NORMALIZED TO THEIR LAYER BASELINE ===
L16 unit 1633: gate_score=9.837437e-08, layer_gate_delta_share=0.20923%
L03 unit  421: gate_score=8.973504e-08, layer_gate_delta_share=0.15419%
L10 unit   38: gate_score=8.844884e-08, layer_gate_delta_share=0.22967%
L16 unit  829: gate_score=8.39814e-08, layer_gate_delta_share=0.17862%
L03 unit 2024: gate_score=8.334457e-08, layer_gate_delta_share=0.14321%
L03 unit  457: gate_score=8.277469e-08, layer_gate_delta_share=0.14223%
L03 unit 1218: gate_score=8.232813e-08, layer_gate_delta_share=0.14146%
L13 unit 1885: gate_score=8.036474e-08, layer_gate_delta_share=0.18328%
L03 unit 1835: gate_score=8.005266e-08, layer_gate_delta_share=0.13755%
L03 unit  254: gate_score=8.000036e-08, layer_gate_delta_share=0.13746%
L13 unit 1128: gate_score=7.930904e-08, layer_gate_delta_share=0.18088%
L16 unit  503: gate_score=7.845281e-08, layer_gate_delta_share=0.16686%

Maximum relative algebraic decomposition discrepancy: 3.8868293723822867e-10
No gate activation frequency, sign, or downstream token effect is identified.
Elapsed seconds: 1.9

```