OUTPUT of run 8 of at most 100: ``` Directional composition: key trace(M B), query trace(M B.T), each divided by ||M||||B||. A substantially key-specific positive match is more suggestive of an induction circuit. L1H0 [('L0H5', -0.0034, -0.0471, 0.0437), ('L0H4', 0.0207, -0.0068, 0.0276), ('L0H1', -0.0001, -0.0222, 0.0221)] L1H1 [('L0H4', 0.0191, -0.0246, 0.0437), ('L0H3', 0.0055, -0.0119, 0.0174), ('L0H5', 0.0154, 0.0072, 0.0082)] L1H2 [('L0H4', 0.0326, -0.0233, 0.056), ('L0H5', -0.0027, -0.0332, 0.0305), ('L0H3', 0.0092, -0.0086, 0.0178)] L1H3 [('L0H4', 0.0421, -0.0282, 0.0703), ('L0H3', 0.0063, -0.0094, 0.0157), ('L0H5', 0.0124, 0.0092, 0.0032)] L1H4 [('L0H4', 0.0439, -0.0262, 0.0701), ('L0H5', 0.0094, -0.0234, 0.0328), ('L0H3', 0.0114, -0.0045, 0.0159)] L1H5 [('L0H5', 0.0128, -0.0122, 0.025), ('L0H4', -0.0036, -0.0203, 0.0167), ('L0H3', -0.0004, -0.0077, 0.0073)] L2H0 [('L0H4', 0.0099, -0.0047, 0.0146), ('L1H2', -0.0003, -0.0129, 0.0127), ('L0H3', 0.0078, 0.0008, 0.007)] L2H1 [('L0H5', 0.0776, -0.0398, 0.1174), ('L1H2', 0.0482, -0.0636, 0.1118), ('L1H4', 0.0476, -0.0495, 0.0971)] L2H2 [('L0H4', 0.02, -0.0077, 0.0276), ('L0H0', 0.0114, 0.0063, 0.005), ('L0H3', 0.0015, -0.0021, 0.0035)] L2H3 [('L0H4', 0.0396, -0.009, 0.0486), ('L0H0', 0.0177, 0.0052, 0.0126), ('L0H3', 0.0066, -0.0018, 0.0084)] L2H4 [('L0H4', 0.0246, -0.0048, 0.0294), ('L0H3', 0.0101, -0.0014, 0.0115), ('L0H5', 0.0018, -0.0006, 0.0024)] L2H5 [('L1H2', 0.0095, -0.012, 0.0215), ('L0H4', 0.0188, -0.0023, 0.0211), ('L1H5', 0.0068, -0.0092, 0.016)] L3H0 [('L2H4', 0.0044, -0.0182, 0.0225), ('L0H5', 0.019, 0.0037, 0.0153), ('L0H4', 0.0098, -0.0003, 0.0101)] L3H1 [('L2H2', 0.1104, -0.0164, 0.1268), ('L0H5', 0.061, -0.0198, 0.0808), ('L1H2', 0.038, -0.0323, 0.0703)] L3H2 [('L0H4', 0.013, -0.0025, 0.0155), ('L0H0', 0.0062, 0.0017, 0.0045), ('L0H3', -0.0008, -0.0014, 0.0006)] L3H3 [('L2H5', 0.0045, -0.0134, 0.0179), ('L2H3', 0.0103, -0.0069, 0.0172), ('L2H4', 0.0148, 0.0019, 0.0129)] L3H4 [('L0H5', 0.0101, -0.0033, 0.0134), ('L0H4', 0.0119, 0.0004, 0.0115), ('L1H1', 0.0069, -0.0039, 0.0108)] L3H5 [('L2H2', 0.1836, -0.0354, 0.2189), ('L2H3', 0.055, -0.0604, 0.1154), ('L1H3', 0.0683, -0.0422, 0.1104)] L0 QK energy in a value-defined candidate character subspace: subspace dimension 16 0 query/key/both [0.0224 0.2603 0.0044] 1 query/key/both [0.0286 0.0327 0.0015] 2 query/key/both [0.0605 0.1709 0.0173] 3 query/key/both [0.0436 0.1638 0.0092] 4 query/key/both [0.0547 0.0596 0.0032] 5 query/key/both [0.0308 0.0319 0.0011] subspace dimension 24 0 query/key/both [0.03 0.3361 0.0076] 1 query/key/both [0.0649 0.0706 0.0128] 2 query/key/both [0.0876 0.2359 0.0348] 3 query/key/both [0.0651 0.2143 0.0168] 4 query/key/both [0.0781 0.091 0.0077] 5 query/key/both [0.0536 0.057 0.0038] subspace dimension 32 0 query/key/both [0.0502 0.3927 0.0154] 1 query/key/both [0.1885 0.2035 0.0842] 2 query/key/both [0.1574 0.3177 0.0624] 3 query/key/both [0.1216 0.3235 0.0365] 4 query/key/both [0.113 0.1314 0.0162] 5 query/key/both [0.1712 0.1751 0.0323] L1 attention query-bias key directions: pairwise cosine. [[1. 0.798 0.808 0.801 0.81 0.757] [0.798 1. 0.923 0.924 0.921 0.897] [0.808 0.923 1. 0.899 0.9 0.868] [0.801 0.924 0.899 1. 0.926 0.899] [0.81 0.921 0.9 0.926 1. 0.883] [0.757 0.897 0.868 0.899 0.883 1. ]] ```