A attention shape (18, 4, 26, 26) max stored row-sum error 0.00036215782165527344
B attention shape (18, 4, 26, 26) max stored row-sum error 0.00033867359161376953

=== MEAN FINAL-QUERY ATTENTION CHANGE BY LAYER ===
L1 is sum of absolute changes over all key positions, averaged over texts/heads.
L00 mean_L1=0.140021 max_head_mean_L1=0.273269 mean_guess_delta=-0.000202
L01 mean_L1=0.609603 max_head_mean_L1=1.129802 mean_guess_delta=-0.000132
L02 mean_L1=0.452482 max_head_mean_L1=0.818101 mean_guess_delta=-0.000654
L03 mean_L1=0.488339 max_head_mean_L1=0.996170 mean_guess_delta=-0.000003
L04 mean_L1=0.286921 max_head_mean_L1=0.389652 mean_guess_delta=+0.001504
L05 mean_L1=0.915933 max_head_mean_L1=1.363271 mean_guess_delta=+0.085791
L06 mean_L1=0.818348 max_head_mean_L1=0.878439 mean_guess_delta=+0.020689
L07 mean_L1=0.903650 max_head_mean_L1=1.628599 mean_guess_delta=+0.014178
L08 mean_L1=0.582770 max_head_mean_L1=0.698605 mean_guess_delta=+0.003821
L09 mean_L1=1.358544 max_head_mean_L1=1.664774 mean_guess_delta=+0.274079
L10 mean_L1=1.097262 max_head_mean_L1=1.816791 mean_guess_delta=+0.316570
L11 mean_L1=1.101273 max_head_mean_L1=1.343592 mean_guess_delta=+0.292987
L12 mean_L1=1.034354 max_head_mean_L1=1.346839 mean_guess_delta=+0.264189
L13 mean_L1=0.271503 max_head_mean_L1=0.417398 mean_guess_delta=+0.026670
L14 mean_L1=0.317684 max_head_mean_L1=0.674709 mean_guess_delta=+0.001803
L15 mean_L1=0.501938 max_head_mean_L1=0.945785 mean_guess_delta=+0.004664
L16 mean_L1=0.350647 max_head_mean_L1=0.598924 mean_guess_delta=+0.007807
L17 mean_L1=0.441206 max_head_mean_L1=0.729935 mean_guess_delta=+0.035683

=== TOP GUESS-MASS DIFFERENCES AT assistant_newline ===
L6 H2 A=0.007024 B=0.043082 d=+0.036057 wrong_d=+0.039999 right_d=+0.032116 B>A=12/12
L9 H0 A=0.005196 B=0.036106 d=+0.030911 wrong_d=+0.032263 right_d=+0.029558 B>A=12/12
L6 H1 A=0.006732 B=0.027651 d=+0.020919 wrong_d=+0.023740 right_d=+0.018099 B>A=12/12
L5 H3 A=0.000414 B=0.011268 d=+0.010854 wrong_d=+0.012504 right_d=+0.009204 B>A=12/12
L9 H1 A=0.004252 B=0.015039 d=+0.010786 wrong_d=+0.011226 right_d=+0.010347 B>A=12/12
L10 H3 A=0.008105 B=0.018735 d=+0.010631 wrong_d=+0.011870 right_d=+0.009391 B>A=12/12
L12 H2 A=0.001948 B=0.012253 d=+0.010305 wrong_d=+0.010750 right_d=+0.009860 B>A=12/12
L6 H3 A=0.001087 B=0.010749 d=+0.009662 wrong_d=+0.011808 right_d=+0.007517 B>A=12/12
L6 H0 A=0.002212 B=0.011135 d=+0.008923 wrong_d=+0.011214 right_d=+0.006631 B>A=12/12
L10 H2 A=0.008216 B=0.016484 d=+0.008268 wrong_d=+0.010097 right_d=+0.006439 B>A=10/12

=== TOP GUESS-MASS DIFFERENCES AT is ===
L10 H2 A=0.028435 B=0.804199 d=+0.775764 wrong_d=+0.783517 right_d=+0.768012 B>A=12/12
L11 H2 A=0.061588 B=0.636373 d=+0.574785 wrong_d=+0.592234 right_d=+0.557335 B>A=12/12
L9 H2 A=0.015422 B=0.508270 d=+0.492849 wrong_d=+0.499335 right_d=+0.486362 B>A=12/12
L10 H0 A=0.004379 B=0.447360 d=+0.442980 wrong_d=+0.448166 right_d=+0.437795 B>A=12/12
L12 H1 A=0.004296 B=0.418452 d=+0.414155 wrong_d=+0.437448 right_d=+0.390863 B>A=12/12
L9 H1 A=0.046757 B=0.440058 d=+0.393302 wrong_d=+0.407463 right_d=+0.379140 B>A=12/12
L5 H3 A=0.122115 B=0.506841 d=+0.384726 wrong_d=+0.379088 right_d=+0.390364 B>A=12/12
L9 H0 A=0.030889 B=0.397634 d=+0.366745 wrong_d=+0.392517 right_d=+0.340973 B>A=12/12
L11 H3 A=0.021208 B=0.322692 d=+0.301484 wrong_d=+0.299624 right_d=+0.303343 B>A=12/12
L12 H2 A=0.000495 B=0.264638 d=+0.264144 wrong_d=+0.255543 right_d=+0.272744 B>A=12/12

=== HEADS WITH MOST BASELINE GUESS ATTENTION AT FINAL QUERY ===
L5 H1 mean=0.487414 B-A=-0.041303
L10 H2 mean=0.416317 B-A=+0.775764
L11 H2 mean=0.348981 B-A=+0.574785
L5 H3 mean=0.314478 B-A=+0.384726
L9 H2 mean=0.261846 B-A=+0.492849
L9 H1 mean=0.243408 B-A=+0.393302
L10 H0 mean=0.225869 B-A=+0.442980
L9 H0 mean=0.214261 B-A=+0.366745

=== REGION CHANGES FOR CANDIDATE HEADS, FINAL QUERY ===
Order: ['guess', 'guess_plus_period', 'guess_sentence', 'question', 'user_end', 'guess_previous']
L5 H1 A [0.5081 0.5081 0.7864 0.2015 0.     0.2773] B-A [-0.0413 -0.041  -0.0107 -0.1937  0.0001 -0.0064]
L5 H3 A [0.1221 0.1255 0.225  0.3671 0.0018 0.0711] B-A [ 0.3847  0.3893  0.6792 -0.3595 -0.0012  0.1822]
L6 H0 A [0.0085 0.024  0.091  0.4353 0.0032 0.0177] B-A [ 0.023   0.0411  0.444  -0.3583 -0.0006  0.0703]
L6 H1 A [0.0115 0.034  0.0882 0.2987 0.0102 0.0086] B-A [ 0.0357  0.0455  0.4049 -0.2358 -0.005   0.0348]
L6 H2 A [0.0032 0.0167 0.0305 0.0953 0.006  0.0009] B-A [ 0.0194  0.0292  0.2195 -0.0773 -0.0014  0.0072]
L6 H3 A [0.0107 0.025  0.0894 0.2215 0.0056 0.0033] B-A [ 0.0229  0.0445  0.3907 -0.1864 -0.0003  0.0265]
L9 H0 A [0.0309 0.0388 0.0476 0.7385 0.0004 0.0038] B-A [ 0.3667  0.5204  0.6685 -0.7047  0.0002  0.057 ]
L9 H1 A [0.0468 0.0605 0.1069 0.3565 0.0011 0.0258] B-A [ 0.3933  0.5467  0.7138 -0.3435 -0.0009  0.0815]
L9 H2 A [0.0154 0.0172 0.0234 0.8123 0.0003 0.0021] B-A [ 0.4928  0.6327  0.8506 -0.7869  0.001   0.0188]
L10 H0 A [0.0044 0.0056 0.0102 0.7838 0.     0.0015] B-A [ 0.443   0.4547  0.6396 -0.6791  0.      0.0182]
L10 H2 A [0.0284 0.0288 0.0342 0.832  0.     0.0041] B-A [ 0.7758  0.8276  0.9505 -0.8189 -0.      0.056 ]
L10 H3 A [0.0158 0.0202 0.0353 0.3747 0.0006 0.0046] B-A [ 0.1902  0.2125  0.2448 -0.3308  0.0001  0.002 ]
L11 H2 A [0.0616 0.0666 0.108  0.2443 0.0015 0.0213] B-A [ 0.5748  0.6028  0.6627 -0.1631 -0.0005  0.0314]
L11 H3 A [0.0212 0.0237 0.0427 0.1297 0.0015 0.0089] B-A [ 0.3015  0.3781  0.4776 -0.0786  0.0056  0.022 ]
L12 H1 A [0.0043 0.0046 0.0123 0.2038 0.     0.0059] B-A [ 0.4142  0.4196  0.6146 -0.095   0.0003  0.0578]
L12 H2 A [0.0005 0.0008 0.0021 0.5027 0.0002 0.0007] B-A [ 0.2641  0.2714  0.3348 -0.3863  0.0043  0.0162]

=== PER-PROMPT FINAL-QUERY GUESS ATTENTION ===
Heads: [(10, 2), (11, 2), (9, 2), (10, 0), (12, 1), (9, 1), (5, 3), (9, 0)]
0 France/London
 A: ['0.05161', '0.07990', '0.01086', '0.00383', '0.01051', '0.05249', '0.06250', '0.06354']
 B: ['0.60645', '0.70215', '0.43872', '0.16296', '0.57959', '0.41797', '0.45703', '0.46533']
1 France/Paris
 A: ['0.11401', '0.13367', '0.02689', '0.00267', '0.01959', '0.10345', '0.05688', '0.09344']
 B: ['0.68848', '0.73535', '0.49902', '0.12744', '0.59668', '0.39917', '0.45996', '0.40186']
2 2+3/4
 A: ['0.03177', '0.13660', '0.04254', '0.01099', '0.00099', '0.06281', '0.00291', '0.01164']
 B: ['0.76758', '0.58203', '0.41382', '0.19031', '0.27539', '0.41626', '0.19092', '0.45679']
3 2+3/5
 A: ['0.02763', '0.12817', '0.03845', '0.01033', '0.00110', '0.05536', '0.00141', '0.00967']
 B: ['0.70801', '0.54004', '0.40161', '0.15259', '0.23010', '0.38306', '0.12842', '0.43481']
4 freeze/100
 A: ['0.08258', '0.05858', '0.01018', '0.00505', '0.00440', '0.08264', '0.01681', '0.05579']
 B: ['0.82715', '0.59790', '0.50964', '0.30875', '0.48163', '0.48016', '0.15875', '0.62732']
5 freeze/0
 A: ['0.01642', '0.03439', '0.00517', '0.00260', '0.00435', '0.03525', '0.03946', '0.02907']
 B: ['0.67383', '0.52441', '0.39893', '0.22754', '0.33716', '0.27075', '0.26318', '0.46509']
6 prime/guessA-wrong
 A: ['0.00342', '0.03207', '0.00989', '0.00206', '0.00281', '0.02419', '0.21692', '0.01471']
 B: ['0.90039', '0.66211', '0.56738', '0.73682', '0.53857', '0.48975', '0.76709', '0.31714']
7 prime/guessB-right
 A: ['0.00334', '0.02875', '0.00883', '0.00361', '0.00187', '0.02831', '0.21936', '0.01819']
 B: ['0.91650', '0.57373', '0.55908', '0.71777', '0.49072', '0.50635', '0.72266', '0.32080']
8 swapped/guessB-wrong
 A: ['0.00375', '0.02931', '0.00880', '0.00370', '0.00210', '0.02826', '0.20569', '0.01878']
 B: ['0.92432', '0.55566', '0.56006', '0.70508', '0.49023', '0.51660', '0.71582', '0.33105']
9 swapped/guessA-right
 A: ['0.00414', '0.03226', '0.01057', '0.00226', '0.00307', '0.02504', '0.20483', '0.01562']
 B: ['0.91602', '0.64404', '0.57568', '0.73877', '0.53174', '0.49658', '0.76172', '0.32104']
10 Sun/false
 A: ['0.00077', '0.02200', '0.00510', '0.00209', '0.00020', '0.02866', '0.24609', '0.02304']
 B: ['0.84912', '0.81201', '0.59375', '0.61279', '0.28027', '0.40308', '0.73584', '0.34497']
11 Sun/true
 A: ['0.00178', '0.02336', '0.00779', '0.00337', '0.00057', '0.03464', '0.19250', '0.01717']
 B: ['0.87256', '0.70703', '0.58154', '0.68750', '0.18933', '0.50098', '0.72070', '0.28540']
12 fictionLondon/selfParis
 A: ['0.09656', '0.10211', '0.03644', '0.00293', '0.01688', '0.10742', '0.04877', '0.09351']
 B: ['0.77100', '0.77686', '0.61084', '0.13220', '0.50195', '0.48853', '0.48071', '0.45703']
13 fictionParis/selfLondon
 A: ['0.04865', '0.06421', '0.01689', '0.00497', '0.01131', '0.05957', '0.04242', '0.07434']
 B: ['0.66309', '0.75586', '0.54492', '0.15076', '0.45459', '0.46436', '0.42554', '0.51855']
14 correct-request/London
 A: ['0.07379', '0.08679', '0.02658', '0.01229', '0.01654', '0.06403', '0.02420', '0.16406']
 B: ['0.64258', '0.48511', '0.30591', '0.03619', '0.74268', '0.56396', '0.12225', '0.58838']
15 correct-request/Paris
 A: ['0.14185', '0.14868', '0.04703', '0.00594', '0.03650', '0.10925', '0.01830', '0.17737']
 B: ['0.68408', '0.60107', '0.25098', '0.02446', '0.75586', '0.56836', '0.09302', '0.47900']

=== OPTION-ORDER AND ATTRIBUTION CONTROLS ===
L10 H2 MC wrong d [0.897  0.9206] MC right d [0.9132 0.9119] fiction/self d [0.6744 0.6144] explicit-correct d [0.5688 0.5422]
L11 H2 MC wrong d [0.63   0.5264] MC right d [0.545  0.6118] fiction/self d [0.6747 0.6916] explicit-correct d [0.3983 0.4524]
L9 H2 MC wrong d [0.5575 0.5513] MC right d [0.5503 0.5651] fiction/self d [0.5744 0.528 ] explicit-correct d [0.2793 0.2039]
L10 H0 MC wrong d [0.7348 0.7014] MC right d [0.7142 0.7365] fiction/self d [0.1293 0.1458] explicit-correct d [0.0239 0.0185]
L12 H1 MC wrong d [0.5358 0.4881] MC right d [0.4889 0.5287] fiction/self d [0.4851 0.4433] explicit-correct d [0.7261 0.7194]
L9 H1 MC wrong d [0.4656 0.4883] MC right d [0.478  0.4715] fiction/self d [0.3811 0.4048] explicit-correct d [0.4999 0.4591]
L5 H3 MC wrong d [0.5502 0.5101] MC right d [0.5033 0.5569] fiction/self d [0.4319 0.3831] explicit-correct d [0.0981 0.0747]
L9 H0 MC wrong d [0.3024 0.3123] MC right d [0.3026 0.3054] fiction/self d [0.3635 0.4442] explicit-correct d [0.4243 0.3016]

=== MOST-ATTENDED KEY POSITIONS ON WRONG-GUESS PROBES ===
L10 H2 text0 A:[(7, 0.68994), (9, 0.1192), (0, 0.06482), (16, 0.05161), (8, 0.04074)] B:[(16, 0.60645), (13, 0.10333), (17, 0.09882), (15, 0.08337), (12, 0.04501)]
L10 H2 text2 A:[(10, 0.6001), (8, 0.19458), (0, 0.06696), (7, 0.04535), (18, 0.03177)] B:[(18, 0.76758), (17, 0.07782), (14, 0.05258), (19, 0.04187), (16, 0.03287)]
L10 H2 text6 A:[(7, 0.37866), (13, 0.16016), (0, 0.15991), (20, 0.13489), (19, 0.04242)] B:[(27, 0.90039), (28, 0.07123), (20, 0.00858), (26, 0.00463), (16, 0.00388)]
L10 H2 text10 A:[(12, 0.36523), (9, 0.18567), (0, 0.17188), (5, 0.06842), (10, 0.06079)] B:[(19, 0.84912), (20, 0.0481), (18, 0.03848), (15, 0.02361), (16, 0.02217)]
L11 H2 text0 A:[(0, 0.50098), (9, 0.16077), (16, 0.0799), (7, 0.07379), (15, 0.03879)] B:[(16, 0.70215), (0, 0.14929), (13, 0.04028), (17, 0.03735), (15, 0.01643)]
L11 H2 text2 A:[(0, 0.60059), (18, 0.1366), (17, 0.05408), (7, 0.04074), (16, 0.03198)] B:[(18, 0.58203), (17, 0.16467), (0, 0.12036), (14, 0.05063), (19, 0.03357)]
L11 H2 text6 A:[(0, 0.64844), (7, 0.06677), (13, 0.04269), (27, 0.03207), (10, 0.02734)] B:[(27, 0.66211), (0, 0.1499), (13, 0.04883), (28, 0.03601), (7, 0.01939)]
L11 H2 text10 A:[(0, 0.67236), (12, 0.10376), (9, 0.04169), (4, 0.03244), (11, 0.02875)] B:[(19, 0.81201), (0, 0.09442), (20, 0.02831), (16, 0.01761), (6, 0.00862)]
L9 H2 text0 A:[(7, 0.77539), (8, 0.06531), (0, 0.05255), (9, 0.04575), (10, 0.01935)] B:[(16, 0.43872), (17, 0.11682), (12, 0.11237), (14, 0.10413), (7, 0.06433)]
L9 H2 text2 A:[(8, 0.32959), (0, 0.21423), (10, 0.10852), (11, 0.10565), (7, 0.07336)] B:[(18, 0.41382), (19, 0.16589), (15, 0.10907), (13, 0.10315), (0, 0.05753)]
L9 H2 text6 A:[(7, 0.4541), (0, 0.1488), (5, 0.12451), (13, 0.05515), (8, 0.03571)] B:[(27, 0.56738), (28, 0.17676), (25, 0.08435), (23, 0.05472), (0, 0.03162)]
L9 H2 text10 A:[(12, 0.3772), (9, 0.1803), (0, 0.10309), (10, 0.07947), (13, 0.06854)] B:[(19, 0.59375), (20, 0.12042), (17, 0.08777), (15, 0.061), (27, 0.03839)]
L10 H0 text0 A:[(7, 0.88525), (9, 0.03152), (25, 0.02727), (0, 0.01944), (10, 0.01782)] B:[(7, 0.26538), (14, 0.19312), (16, 0.16296), (24, 0.14844), (25, 0.1048)]
L10 H0 text2 A:[(0, 0.36475), (27, 0.1416), (11, 0.14075), (10, 0.12634), (8, 0.08154)] B:[(26, 0.23572), (15, 0.20178), (18, 0.19031), (27, 0.18762), (0, 0.04263)]
L10 H0 text6 A:[(5, 0.40259), (7, 0.31763), (36, 0.08423), (0, 0.07007), (13, 0.02724)] B:[(27, 0.73682), (35, 0.05151), (5, 0.05035), (25, 0.04776), (23, 0.02916)]
L10 H0 text10 A:[(12, 0.48584), (28, 0.1283), (9, 0.08917), (0, 0.06848), (6, 0.05908)] B:[(19, 0.61279), (27, 0.11237), (17, 0.08594), (28, 0.0647), (15, 0.04083)]
