Belief axis: think/believe/guess/opinion minus evidence/fact/proof/data.
Agreement axis: agree/agreed/yes/absolutely minus disagree/incorrect/no/wrong.

MLP STATIC SURVEY
DU and DG below are WEIGHT PRODUCTS ONLY. Neither is the gated MLP function.
L  down_delta_top_energy  DU_answer_delta  DG_answer_delta  DU_belief_agree_delta  DG_belief_agree_delta
 0 0.04870 +0.000152688 -2.07918e-05 -0.000348216 +0.000203065
 1 0.04360 -0.000142109 -0.000130165 -0.000140356 -0.000347263
 2 0.04999 +0.000348285 -5.46221e-05 +0.000835567 +0.000240789
 3 0.05783 +0.000162341 +4.26002e-06 -2.03766e-05 -2.95256e-05
 4 0.05721 -0.000100121 +0.000126888 -0.000321142 +2.40064e-05
 5 0.06671 -0.000263543 +0.000106632 -0.000569365 -0.0011327
 6 0.08253 -0.000359901 -0.000113418 -0.000591954 -3.85473e-05
 7 0.08236 -9.76052e-05 -2.71652e-05 +0.000736648 +0.000263466
 8 0.09059 -0.000160809 -6.92761e-05 -0.00112896 -0.000974488
 9 0.10248 -5.25741e-05 +0.00017232 -0.000275123 +0.000379787
10 0.11654 +3.79026e-06 +0.000122635 -0.000276876 -0.000927021
11 0.09322 -0.000230502 -0.000334551 -0.000223076 +0.000824496
12 0.07356 -0.000181409 -0.000125836 -0.000336345 +0.000102621
13 0.06259 +0.00014827 -4.26568e-05 +0.000247447 -0.000203098
14 0.04837 +1.62461e-05 +0.00041861 +0.000271472 -6.92961e-06
15 0.05541 +0.000180767 -0.000718444 +0.000394585 +0.000581261
16 0.08881 +0.00126501 +0.00104578 -0.000245761 -0.000221
17 0.12397 +0.000563009 -0.00151489 +0.000297108 -0.000549801

LATE-LAYER LEADING DOWN-DIFFERENCE MODES; SVD SIGNS ARE ARBITRARY
L10: energy fractions [0.1165, 0.0629, 0.047]; units [(757, 0.0526), (160, 0.0515), (1439, 0.0509), (1451, -0.05)]
 output poles: ([' conflitto', ' Konfl', ' conflit', ' hatal'], [' peptides', ' identities', ' lawns', ' callback'])
 up-read poles: ([' skit', ' glorified', ' lulus', ' juara'], [' Southampton', ' Tung', ' galley', ' Embar']) gate-read poles: ([' reff', ' savun', ' aumentando', ' evolucion'], [' fiber', ' Fiber', ' illegitimate', ' stabilizer'])
L11: energy fractions [0.0932, 0.0587, 0.0449]; units [(2045, -0.0471), (1589, -0.0466), (1867, -0.0462), (748, 0.0461)]
 output poles: ([' Projekt', ' Capsule', ' Patrol', ' Projeto'], [' aub', ' Kenyon', ' accommodated', ' guarante'])
 up-read poles: ([' KMS', ' gusts', ' capac', ' noon'], [' panahon', ' ezzel', ' preferentially', ' subpopulations']) gate-read poles: ([' OSError', ' chocolates', ' rectum', ' belongings'], [' Olympic', ' Regeln', ' horseshoe', ' DOA'])
L12: energy fractions [0.0736, 0.0408, 0.0364]; units [(1425, -0.0507), (1147, -0.0496), (1761, -0.0494), (1851, -0.0491)]
 output poles: ([' des', ' sul', ' Dyn', ' Col'], [' resurrected', ' indicted', ' Easier', ' REGISTER'])
 up-read poles: ([' Marek', ' Marcin', ' magyar', ' cylinders'], [' BUILDING', ' prostitutes', ' rejoicing', ' beled']) gate-read poles: ([' madr', ' Polite', ' respectful', ' Neighbors'], [' traverses', ' apporte', ' xray', ' Auschwitz'])
L13: energy fractions [0.0626, 0.0379, 0.0332]; units [(1517, -0.0586), (1947, 0.0548), (362, -0.0547), (825, -0.0535)]
 output poles: ([' Shun', ' SCR', ' Chun', ' SPL'], [' satisfiable', ' validar', ' cannabin', ' openc'])
 up-read poles: ([' esc', ' satur', ' wohl', ' corresponds'], [' addon', ' miniatures', ' hearsay', ' viewport']) gate-read poles: ([' ric', ' RELATED', ' banged', ' stub'], [' Reservation', ' Influence', ' owes', ' owe'])
L14: energy fractions [0.0484, 0.0351, 0.0342]; units [(640, 0.0645), (74, -0.0628), (1817, -0.0612), (1749, 0.0611)]
 output poles: ([' Derek', ' Hex', ' Reis', ' Clifford'], [' bitOp', ' beforePath', ' BufferedReader', ' inanimate'])
 up-read poles: ([' wra', ' mat', ' cal', ' res'], [' Renderer', ' Analyzer', ' proteomics', ' Angst']) gate-read poles: ([' sufferers', ' IBS', ' asthma', ' endometriosis'], [' nomina', ' modificare', ' premi', ' Calls'])
L15: energy fractions [0.0554, 0.0421, 0.0382]; units [(692, 0.0809), (655, 0.0785), (234, 0.0725), (1507, -0.0679)]
 output poles: ([' exact', ' name', ' sub', ' ground'], [' Lola', ' Filosof', ' Mabel', ' Paket'])
 up-read poles: ([' sinus', ' stod', ' diffic', ' concer'], [' Fauna', ' floribus', ' ASSERT', ' envio']) gate-read poles: ([' septiembre', ' outubro', ' sinistra', ' heb'], [' sati', ' undefined', ' congru', ' longitudinal'])
L16: energy fractions [0.0888, 0.0563, 0.0467]; units [(171, 0.0847), (1439, 0.0747), (587, -0.0724), (920, 0.0702)]
 output poles: ([' Seventy', ' Nine', ' Eighty', ' eighty'], [' One', ' one', ' satu', ' first'])
 up-read poles: ([' migrations', ' Prevalence', ' cardiology', ' migrate'], [' contro', ' perp', ' blad', ' kent']) gate-read poles: ([' Erie', ' Clinic', ' Sic', ' clinics'], [' gills', ' sigui', ' superscript', ' tartalmaz'])
L17: energy fractions [0.124, 0.0664, 0.0571]; units [(1366, -0.0911), (1217, 0.0789), (824, -0.0782), (1245, -0.0778)]
 output poles: ([' RtlOverlay', ' ThemeOverlay', ' threx', ' pushedAt'], [' One', ' one', ' the', ' and'])
 up-read poles: ([' disfruta', ' menentukan', ' respecto', ' coun'], [' lemon', ' Inch', ' SIM', ' Sham']) gate-read poles: ([' dot', ' actual', ' Public', ' public'], [' Spielen', ' favoriser', ' brazil', ' imprescind'])

TOP SIX MLPs BY ABSOLUTE UNITWISE CHANGE IN RAW ANSWER-CONTRAST WEIGHT PRODUCTS
Ranking is a screening heuristic and depends on the omitted gates.
L17: sum_absolute_change=0.0349167; units=[824, 1180, 883, 1192, 234]
  raw net copy DU/DG +0.000563009 -0.00151489 net belief-agreement DU/DG +0.000297108 -0.000549801
  scaled net copy DU/DG +13.6834 +3.7622 net belief-agreement DU/DG +15.523 -9.70506
   unit 824: copy_DU=+0.000211357, copy_DG=-0.000701232, belief_DU=+7.69203e-07, belief_DG=+2.75781e-06
   unit 1180: copy_DU=+0.000291535, copy_DG=-0.000345547, belief_DU=-8.36167e-07, belief_DG=+1.37349e-05
   unit 883: copy_DU=+9.7326e-05, copy_DG=-0.000337221, belief_DU=-7.23128e-07, belief_DG=-3.19659e-06
L16: sum_absolute_change=0.0316228; units=[1446, 1875, 96, 689, 931]
  raw net copy DU/DG +0.00126501 +0.00104578 net belief-agreement DU/DG -0.000245761 -0.000221
  scaled net copy DU/DG -1.02161 -1.57872 net belief-agreement DU/DG -5.18464 -1.91387
   unit 1446: copy_DU=-0.000177243, copy_DG=+0.000402523, belief_DU=+3.62197e-07, belief_DG=-1.6708e-05
   unit 1875: copy_DU=+0.000145976, copy_DG=+0.000354413, belief_DU=+7.20203e-07, belief_DG=-8.60151e-06
   unit 96: copy_DU=+0.000143107, copy_DG=+0.000185392, belief_DU=+4.83713e-06, belief_DG=+2.37695e-06
L15: sum_absolute_change=0.021703; units=[925, 1337, 240, 1409, 1630]
  raw net copy DU/DG +0.000180767 -0.000718444 net belief-agreement DU/DG +0.000394585 +0.000581261
  scaled net copy DU/DG -2.31448 -3.55375 net belief-agreement DU/DG -0.0289311 +5.54485
   unit 925: copy_DU=+4.92069e-05, copy_DG=-3.1933e-05, belief_DU=+1.00795e-05, belief_DG=+2.22781e-05
   unit 1337: copy_DU=+1.72043e-05, copy_DG=-5.7213e-05, belief_DU=-1.77567e-05, belief_DG=-2.40409e-05
   unit 240: copy_DU=+4.39817e-05, copy_DG=-1.45441e-05, belief_DU=+1.12923e-08, belief_DG=-2.36114e-06
L14: sum_absolute_change=0.0162056; units=[1372, 1558, 1016, 1009, 1702]
  raw net copy DU/DG +1.62461e-05 +0.00041861 net belief-agreement DU/DG +0.000271472 -6.92961e-06
  scaled net copy DU/DG +3.11559 -1.78 net belief-agreement DU/DG -1.44968 -2.67724
   unit 1372: copy_DU=+4.57056e-05, copy_DG=-5.94403e-05, belief_DU=-2.85166e-06, belief_DG=-1.31463e-06
   unit 1558: copy_DU=-7.78132e-06, copy_DG=-2.99221e-05, belief_DU=-1.75787e-08, belief_DG=+1.28834e-06
   unit 1016: copy_DU=+2.99989e-05, copy_DG=-4.72756e-06, belief_DU=+7.5087e-06, belief_DG=+4.43654e-06
L13: sum_absolute_change=0.0122547; units=[299, 491, 116, 1082, 308]
  raw net copy DU/DG +0.00014827 -4.26568e-05 net belief-agreement DU/DG +0.000247447 -0.000203098
  scaled net copy DU/DG +3.80518 +0.319784 net belief-agreement DU/DG -5.24458 -0.357475
   unit 299: copy_DU=-2.97498e-05, copy_DG=+4.13577e-05, belief_DU=-9.0804e-08, belief_DG=+1.73284e-07
   unit 491: copy_DU=+1.33398e-05, copy_DG=-4.52455e-05, belief_DU=-2.42534e-06, belief_DG=+1.25391e-06
   unit 116: copy_DU=-5.85796e-06, copy_DG=-3.59499e-05, belief_DU=-2.96818e-06, belief_DG=-1.34549e-05
L0: sum_absolute_change=0.0117076; units=[918, 1700, 1623, 1041, 1707]
  raw net copy DU/DG +0.000152688 -2.07918e-05 net belief-agreement DU/DG -0.000348216 +0.000203065
  scaled net copy DU/DG +0.057343 +0.0227383 net belief-agreement DU/DG -0.163355 -0.309711
   unit 918: copy_DU=-3.61674e-05, copy_DG=-5.52451e-05, belief_DU=-2.14486e-06, belief_DG=+4.56921e-06
   unit 1700: copy_DU=+2.39756e-05, copy_DG=+2.28916e-05, belief_DU=+1.1106e-06, belief_DG=-1.36079e-05
   unit 1623: copy_DU=+1.65636e-05, copy_DG=+2.5755e-05, belief_DU=-1.20125e-06, belief_DG=-1.31946e-06

No GELU, activation gates, model hidden states, or model outputs were computed.
