MLP unit coefficient:
  T_i = d_i tensor (g_i tensor u_i + u_i tensor g_i)/2
This is a weight-interaction descriptor, not the nonlinear unit's output.
Folded version incorporates pre-FF and post-FF learned norm gains only.
Root-sum unit scores omit interference BETWEEN different units.
Spectra below concern B-A projection matrices, not activations.

=== PER-LAYER MLP WEIGHT-INTERACTION COMPARISON ===
layer  raw_rel  folded_rel  top1_delta_share  top10_delta_share  top5_units
    0  0.013097    0.021095          2.86499%          10.46752% [1352, 1405, 1262, 1881, 128]
    1  0.018927    0.028882          0.73418%           4.13074% [1598, 463, 242, 1725, 1572]
    2  0.016171    0.017699          0.59988%           3.64384% [1049, 1831, 1375, 806, 671]
    3  0.018020    0.023542          1.08514%           6.84178% [1414, 146, 986, 1671, 82]
    4  0.020617    0.026725          2.09767%          10.20327% [1527, 200, 84, 388, 736]
    5  0.013613    0.015487          3.41309%           7.72576% [584, 285, 571, 919, 1249]
    6  0.017455    0.008192          1.27143%           5.94169% [690, 1824, 1720, 430, 1358]
    7  0.016225    0.009097          3.82249%           8.78674% [1455, 1300, 1032, 1057, 1644]
    8  0.019347    0.018877          2.48641%           8.61482% [188, 487, 1868, 687, 511]
    9  0.015509    0.015352          0.48378%           3.63022% [1782, 808, 111, 783, 448]
   10  0.019014    0.019367          6.23510%          19.06491% [1363, 1564, 1529, 1869, 900]
   11  0.014920    0.013634          0.95590%           5.60291% [1815, 716, 1576, 494, 433]
   12  0.015359    0.014359          0.70607%           3.91708% [1528, 831, 259, 1520, 1924]
   13  0.019521    0.018046          1.44107%           4.77476% [16, 1517, 859, 67, 369]
   14  0.021576    0.020757          2.47767%           5.27422% [641, 685, 663, 392, 380]
   15  0.019238    0.018695          0.92939%           3.58774% [1369, 1226, 651, 105, 2037]
   16  0.017878    0.017465          1.94401%           4.94837% [893, 1591, 730, 287, 324]
   17  0.018350    0.018248          0.73186%           3.94952% [1916, 1026, 1312, 1637, 60]

=== TOP 25 UNITS BY LAYER-NORMALIZED FOLDED DESCRIPTOR CHANGE ===
L10 unit 1363: score=0.00483598, layer_delta_share=6.23510%, unit_rel_raw=0.0152227, unit_rel_folded=0.0263961
L10 unit 1564: score=0.00439427, layer_delta_share=5.14811%, unit_rel_raw=0.0161582, unit_rel_folded=0.0141963
L04 unit 1527: score=0.00387061, layer_delta_share=2.09767%, unit_rel_raw=0.0254848, unit_rel_folded=0.105259
L00 unit 1352: score=0.00357065, layer_delta_share=2.86499%, unit_rel_raw=0.0119367, unit_rel_folded=0.0362063
L14 unit  641: score=0.00326728, layer_delta_share=2.47767%, unit_rel_raw=0.0249491, unit_rel_folded=0.0256293
L10 unit 1529: score=0.00325296, layer_delta_share=2.82119%, unit_rel_raw=0.0187508, unit_rel_folded=0.032631
L04 unit  200: score=0.00319131, layer_delta_share=1.42599%, unit_rel_raw=0.0185776, unit_rel_folded=0.0818501
L04 unit   84: score=0.0031815, layer_delta_share=1.41724%, unit_rel_raw=0.0269159, unit_rel_folded=0.0165651
L08 unit  188: score=0.00297657, layer_delta_share=2.48641%, unit_rel_raw=0.0269658, unit_rel_folded=0.00801682
L00 unit 1405: score=0.00292495, layer_delta_share=1.92250%, unit_rel_raw=0.0183373, unit_rel_folded=0.00598871
L04 unit  388: score=0.00290912, layer_delta_share=1.18496%, unit_rel_raw=0.0203111, unit_rel_folded=0.0772871
L05 unit  584: score=0.00286116, layer_delta_share=3.41309%, unit_rel_raw=0.0201874, unit_rel_folded=0.00657188
L04 unit  736: score=0.00256481, layer_delta_share=0.92106%, unit_rel_raw=0.020496, unit_rel_folded=0.0525325
L00 unit 1262: score=0.00253829, layer_delta_share=1.44781%, unit_rel_raw=0.0129971, unit_rel_folded=0.0539837
L01 unit 1598: score=0.00247475, layer_delta_share=0.73418%, unit_rel_raw=0.0195392, unit_rel_folded=0.097713
L03 unit 1414: score=0.00245232, layer_delta_share=1.08514%, unit_rel_raw=0.0291943, unit_rel_folded=0.0135716
L16 unit  893: score=0.00243515, layer_delta_share=1.94401%, unit_rel_raw=0.016315, unit_rel_folded=0.0156377
L03 unit  146: score=0.00239251, layer_delta_share=1.03285%, unit_rel_raw=0.016427, unit_rel_folded=0.0203309
L08 unit  487: score=0.00222196, layer_delta_share=1.38551%, unit_rel_raw=0.0124514, unit_rel_folded=0.0277895
L04 unit 1779: score=0.00217374, layer_delta_share=0.66160%, unit_rel_raw=0.0207166, unit_rel_folded=0.0700972
L13 unit   16: score=0.00216627, layer_delta_share=1.44107%, unit_rel_raw=0.0190691, unit_rel_folded=0.0134758
L10 unit 1869: score=0.00214946, layer_delta_share=1.23178%, unit_rel_raw=0.0173737, unit_rel_folded=0.0244679
L04 unit 1815: score=0.00211949, layer_delta_share=0.62899%, unit_rel_raw=0.0173887, unit_rel_folded=0.0854111
L04 unit  995: score=0.00211167, layer_delta_share=0.62435%, unit_rel_raw=0.0227769, unit_rel_folded=0.0538958
L04 unit  519: score=0.00210961, layer_delta_share=0.62313%, unit_rel_raw=0.0218432, unit_rel_folded=0.0703743

=== PROJECTION DELTA SPECTRA ===
layer projection top1_energy top8_energy participation_rank
    0       down    4.86584%   26.18264%              65.10
    0       gate    9.77095%   35.50303%              41.22
    0         up    9.49988%   35.03520%              42.14
    1       down    4.33445%   26.24542%              67.90
    1       gate    6.67589%   31.62371%              52.69
    1         up    6.70222%   31.45879%              53.50
    2       down    7.29447%   26.46606%              60.56
    2       gate    8.27515%   32.24566%              49.33
    2         up    8.34972%   31.34120%              50.90
    3       down    5.43913%   27.55081%              62.58
    3       gate    7.22549%   29.44740%              56.94
    3         up    6.85603%   27.96168%              61.01
    4       down    6.54103%   28.16401%              60.56
    4       gate    8.88218%   32.04903%              49.19
    4         up    7.79146%   30.38564%              54.78
    5       down    5.90089%   26.43001%              67.95
    5       gate    7.58131%   28.00783%              61.59
    5         up    6.06443%   27.41167%              67.15
    6       down    7.79870%   28.44588%              57.24
    6       gate    8.65367%   29.28562%              54.57
    6         up    7.07387%   28.16158%              60.52
    7       down    7.79664%   29.70152%              55.87
    7       gate   10.38267%   33.65620%              42.92
    7         up    9.08231%   31.97535%              48.11
    8       down    8.81688%   31.57461%              48.24
    8       gate   10.55535%   33.41066%              42.06
    8         up    9.29571%   32.36373%              46.54
    9       down    8.93258%   31.91190%              48.12
    9       gate   12.11132%   34.66528%              37.41
    9         up   11.20804%   34.18336%              40.53
   10       down    9.42371%   34.25887%              42.98
   10       gate   12.98114%   36.16377%              34.43
   10         up   11.80453%   35.34941%              38.21
   11       down   10.49484%   34.05227%              41.90
   11       gate   12.52408%   32.95418%              38.65
   11         up   11.31802%   32.09177%              43.13
   12       down    8.21966%   28.92879%              55.05
   12       gate   13.06665%   37.44813%              33.16
   12         up   11.98446%   36.34035%              36.18
   13       down    6.62129%   28.16131%              61.47
   13       gate   14.16539%   40.41833%              29.09
   13         up   13.84441%   40.42047%              29.59
   14       down    6.09829%   26.88708%              64.14
   14       gate   13.70381%   37.31174%              32.16
   14         up   12.90999%   36.64568%              34.22
   15       down    5.78099%   32.20587%              52.75
   15       gate   10.93544%   31.85375%              44.59
   15         up   10.67247%   31.78655%              45.57
   16       down    8.63318%   40.84684%              35.02
   16       gate    9.52180%   29.41183%              51.59
   16         up    8.62213%   28.49762%              55.81
   17       down   14.28927%   48.21721%              23.00
   17       gate    7.60646%   27.44413%              60.20
   17         up    7.57425%   27.35759%              60.28

Top-25 raw/folded unit overlap: 3
Elapsed seconds: 2.29
