OUTPUT of run 1 of at most 100:
```

LAYER 0
ln1_w norm=6.884 mean=0.29650 std=0.18837 min=0.0352 max=0.9785
ln1_b norm=0.610 mean=0.00039 std=0.03113 min=-0.0954 max=0.0906
ln2_w norm=18.323 mean=0.87176 std=0.33816 min=0.0420 max=1.7750
ln2_b norm=1.380 mean=0.01340 std=0.06913 min=-0.6236 max=0.4636
W_q norm=17.669 mean=0.00005 std=0.04601 min=-0.4639 max=0.4214
W_k norm=18.516 mean=0.00001 std=0.04822 min=-0.5163 max=0.5037
W_v norm=14.937 mean=0.00002 std=0.03890 min=-0.3922 max=0.3895
W_o norm=16.550 mean=-0.00012 std=0.04310 min=-1.1239 max=1.0823
W_fc norm=55.376 mean=0.00075 std=0.07210 min=-0.8384 max=1.1226
W_proj norm=50.007 mean=-0.00000 std=0.06511 min=-0.6883 max=1.4636
head: Qnorm Knorm Vnorm Onorm | QK sv(top6), top1_energy, symmetry, trace/norm | OV sv(top4), trace/norm
L0H0 [7.14  7.395 5.916 6.127] | [0.248 0.102 0.047 0.043 0.037 0.036] E1=0.714 sym=0.140 tr=-0.357 | [0.958 0.898 0.818 0.642] tr=-0.067
L0H1 [4.486 4.927 4.323 4.825] | [0.15  0.042 0.021 0.012 0.01  0.007] E1=0.892 sym=0.161 tr=-0.620 | [3.38  2.023 0.345 0.18 ] tr=0.231
L0H2 [4.065 4.362 4.017 4.36 ] | [0.102 0.018 0.016 0.012 0.008 0.007] E1=0.908 sym=0.289 tr=-0.814 | [2.643 1.363 0.4   0.176] tr=0.229
L0H3 [14.141 14.661  8.259  9.445] | [0.244 0.223 0.201 0.182 0.179 0.157] E1=0.122 sym=-0.067 tr=1.923 | [1.127 0.955 0.95  0.89 ] tr=-0.570
L0H4 [4.205 4.614 3.689 3.657] | [0.08  0.022 0.019 0.013 0.011 0.008] E1=0.808 sym=0.050 tr=-0.519 | [1.454 0.724 0.213 0.141] tr=0.102
L0H5 [2.632 2.936 8.453 9.565] | [0.032 0.004 0.003 0.003 0.002 0.002] E1=0.901 sym=0.024 tr=-0.254 | [16.282  8.786  2.835  1.117] tr=0.111

LAYER 1
ln1_w norm=10.065 mean=0.50583 std=0.08918 min=0.1970 max=1.0846
ln1_b norm=3.037 mean=0.01103 std=0.15458 min=-1.5676 max=1.3651
ln2_w norm=22.433 mean=1.13147 std=0.17415 min=0.0019 max=1.5196
ln2_b norm=2.815 mean=0.00647 std=0.14352 min=-0.3892 max=0.4170
W_q norm=38.929 mean=-0.00027 std=0.10138 min=-0.4410 max=0.4642
W_k norm=34.893 mean=0.00005 std=0.09087 min=-1.0865 max=1.2757
W_v norm=28.744 mean=0.00003 std=0.07486 min=-0.3539 max=0.3314
W_o norm=28.479 mean=0.00002 std=0.07416 min=-0.4175 max=0.4550
W_fc norm=80.379 mean=0.00139 std=0.10465 min=-0.6542 max=0.6450
W_proj norm=77.384 mean=-0.00008 std=0.10076 min=-0.5072 max=2.6601
head: Qnorm Knorm Vnorm Onorm | QK sv(top6), top1_energy, symmetry, trace/norm | OV sv(top4), trace/norm
L1H0 [16.628 14.95  11.763 11.711] | [1.185 0.729 0.557 0.534 0.472 0.432] E1=0.358 sym=0.042 tr=-0.883 | [3.189 2.991 2.858 2.707] tr=-1.346
L1H1 [16.019 14.34  11.237 11.401] | [1.155 0.715 0.583 0.465 0.398 0.368] E1=0.391 sym=0.018 tr=-0.845 | [3.148 3.021 2.872 2.793] tr=-1.351
L1H2 [15.576 14.136 11.739 11.38 ] | [1.176 0.62  0.485 0.436 0.385 0.355] E1=0.435 sym=0.037 tr=-1.059 | [3.55  3.305 3.182 2.996] tr=-1.467
L1H3 [15.745 13.949 11.801 11.885] | [1.188 0.678 0.532 0.388 0.366 0.329] E1=0.440 sym=0.006 tr=-0.844 | [3.408 3.269 3.119 3.022] tr=-1.481
L1H4 [15.205 13.642 12.731 12.113] | [1.059 0.505 0.477 0.351 0.334 0.31 ] E1=0.422 sym=0.047 tr=-1.234 | [4.132 3.769 3.609 3.358] tr=-1.429
L1H5 [16.146 14.418 11.065 11.244] | [1.147 0.719 0.556 0.499 0.433 0.379] E1=0.377 sym=0.017 tr=-0.874 | [3.085 2.949 2.892 2.805] tr=-1.369

LAYER 2
ln1_w norm=13.410 mean=0.68087 std=0.06874 min=0.3175 max=1.0927
ln1_b norm=3.077 mean=0.01305 std=0.15645 min=-1.6589 max=1.3318
ln2_w norm=25.777 mean=1.31041 std=0.11485 min=0.0120 max=1.5078
ln2_b norm=3.413 mean=0.01229 std=0.17372 min=-0.5170 max=0.4489
W_q norm=38.902 mean=0.00008 std=0.10131 min=-0.4865 max=0.4916
W_k norm=36.750 mean=0.00001 std=0.09570 min=-1.2235 max=1.1936
W_v norm=33.183 mean=-0.00003 std=0.08641 min=-0.4009 max=0.3919
W_o norm=32.435 mean=-0.00000 std=0.08446 min=-0.5312 max=0.5185
W_fc norm=79.828 mean=0.00039 std=0.10394 min=-0.5244 max=0.5953
W_proj norm=78.048 mean=-0.00007 std=0.10163 min=-0.5107 max=0.8014
head: Qnorm Knorm Vnorm Onorm | QK sv(top6), top1_energy, symmetry, trace/norm | OV sv(top4), trace/norm
L2H0 [14.489 13.572 13.047 12.69 ] | [0.694 0.555 0.35  0.328 0.307 0.3  ] E1=0.180 sym=-0.040 tr=-0.954 | [5.29  4.505 4.391 3.716] tr=-1.027
L2H1 [16.803 15.934 13.859 13.478] | [0.578 0.514 0.509 0.466 0.458 0.444] E1=0.072 sym=-0.021 tr=-0.100 | [4.136 3.837 3.792 3.685] tr=-1.995
L2H2 [15.082 14.471 14.057 13.611] | [0.518 0.412 0.4   0.374 0.355 0.333] E1=0.091 sym=-0.003 tr=-0.754 | [5.045 4.937 4.562 4.369] tr=-1.604
L2H3 [14.704 13.851 14.29  13.833] | [0.503 0.385 0.364 0.334 0.333 0.312] E1=0.096 sym=-0.008 tr=-0.367 | [4.833 4.752 4.089 4.05 ] tr=-1.590
L2H4 [16.878 15.77  12.388 12.522] | [0.815 0.63  0.506 0.471 0.448 0.423] E1=0.135 sym=-0.032 tr=-0.443 | [3.533 3.373 3.229 3.158] tr=-2.103
L2H5 [17.106 16.203 13.548 13.262] | [0.615 0.564 0.54  0.513 0.498 0.478] E1=0.074 sym=-0.024 tr=-0.118 | [3.735 3.601 3.518 3.421] tr=-2.058

LAYER 3
ln1_w norm=13.922 mean=0.70875 std=0.04941 min=0.4078 max=0.8155
ln1_b norm=2.032 mean=0.02963 std=0.09939 min=-0.7639 max=0.8241
ln2_w norm=24.886 mean=1.26681 std=0.08945 min=0.2328 max=1.4532
ln2_b norm=2.780 mean=0.01280 std=0.14128 min=-0.5402 max=0.3932
W_q norm=33.239 mean=-0.00008 std=0.08656 min=-0.3908 max=0.4595
W_k norm=32.463 mean=-0.00003 std=0.08454 min=-0.9139 max=0.9735
W_v norm=39.422 mean=0.00004 std=0.10266 min=-0.5080 max=0.5939
W_o norm=40.133 mean=0.00001 std=0.10451 min=-1.5167 max=1.5269
W_fc norm=78.259 mean=0.00025 std=0.10190 min=-0.4902 max=0.5500
W_proj norm=85.119 mean=0.00028 std=0.11083 min=-1.0584 max=1.4766
head: Qnorm Knorm Vnorm Onorm | QK sv(top6), top1_energy, symmetry, trace/norm | OV sv(top4), trace/norm
L3H0 [15.992 15.604 14.464 14.539] | [0.436 0.414 0.39  0.38  0.373 0.36 ] E1=0.046 sym=0.006 tr=1.073 | [5.785 5.657 5.063 4.643] tr=-2.223
L3H1 [12.344 11.933 15.745 16.085] | [0.346 0.31  0.285 0.253 0.244 0.227] E1=0.081 sym=-0.002 tr=0.353 | [8.23  7.821 6.562 6.475] tr=-1.586
L3H2 [13.501 13.195 15.205 15.365] | [0.385 0.304 0.294 0.277 0.266 0.259] E1=0.072 sym=-0.010 tr=0.242 | [7.46  6.112 5.569 5.336] tr=-1.593
L3H3 [15.138 15.015 17.944 18.53 ] | [0.322 0.311 0.307 0.304 0.298 0.295] E1=0.031 sym=0.209 tr=3.200 | [10.81   9.984  9.821  9.427] tr=-1.210
L3H4 [ 8.612  8.319 17.848 18.3  ] | [0.236 0.203 0.171 0.151 0.133 0.127] E1=0.143 sym=0.001 tr=0.001 | [21.271 17.68  16.977 15.047] tr=-0.794
L3H5 [14.529 14.115 15.008 15.041] | [0.455 0.321 0.315 0.299 0.289 0.288] E1=0.074 sym=0.009 tr=0.863 | [6.302 5.977 5.474 5.086] tr=-1.534

```