=== CONFIGURATION ===
A: {
  "_sliding_window_pattern": 6,
  "architectures": [
    "Gemma3ForCausalLM"
  ],
  "attention_bias": false,
  "attention_dropout": 0.0,
  "attn_logit_softcapping": null,
  "bos_token_id": 2,
  "dtype": "float32",
  "eos_token_id": 1,
  "final_logit_softcapping": null,
  "head_dim": 256,
  "hidden_activation": "gelu_pytorch_tanh",
  "hidden_size": 640,
  "initializer_range": 0.02,
  "intermediate_size": 2048,
  "layer_types": [
    "sliding_attention",
    "sliding_attention",
    "sliding_attention",
    "sliding_attention",
    "sliding_attention",
    "full_attention",
    "sliding_attention",
    "sliding_attention",
    "sliding_attention",
    "sliding_attention",
    "sliding_attention",
    "full_attention",
    "sliding_attention",
    "sliding_attention",
    "sliding_attention",
    "sliding_attention",
    "sliding_attention",
    "full_attention"
  ],
  "max_position_embeddings": 32768,
  "model_type": "gemma3_text",
  "num_attention_heads": 4,
  "num_hidden_layers": 18,
  "num_key_value_heads": 1,
  "pad_token_id": 0,
  "query_pre_attn_scalar": 256,
  "rms_norm_eps": 1e-06,
  "rope_parameters": {
    "full_attention": {
      "rope_theta": 1000000.0,
      "rope_type": "default"
    },
    "sliding_attention": {
      "rope_theta": 10000.0,
      "rope_type": "default"
    }
  },
  "sliding_window": 512,
  "tie_word_embeddings": true,
  "transformers_version": "5.20.2",
  "use_bidirectional_attention": false,
  "use_cache": true,
  "vocab_size": 262144
}
B configuration identical: True

=== TENSOR INVENTORY ===
Tensor counts: 235 235
Only in A: []
Only in B: []
Dtypes A: {'BF16': 235}
Dtypes B: {'BF16': 235}
Shape mismatches: []

Tensor families and shapes:
  model.layers.*.input_layernorm.weight: count=18, shapes=[(640,)]
  model.layers.*.mlp.down_proj.weight: count=18, shapes=[(640, 2048)]
  model.layers.*.mlp.gate_proj.weight: count=18, shapes=[(2048, 640)]
  model.layers.*.mlp.up_proj.weight: count=18, shapes=[(2048, 640)]
  model.layers.*.post_attention_layernorm.weight: count=18, shapes=[(640,)]
  model.layers.*.post_feedforward_layernorm.weight: count=18, shapes=[(640,)]
  model.layers.*.pre_feedforward_layernorm.weight: count=18, shapes=[(640,)]
  model.layers.*.self_attn.k_norm.weight: count=18, shapes=[(256,)]
  model.layers.*.self_attn.k_proj.weight: count=18, shapes=[(256, 640)]
  model.layers.*.self_attn.o_proj.weight: count=18, shapes=[(640, 1024)]
  model.layers.*.self_attn.q_norm.weight: count=18, shapes=[(256,)]
  model.layers.*.self_attn.q_proj.weight: count=18, shapes=[(1024, 640)]
  model.layers.*.self_attn.v_proj.weight: count=18, shapes=[(256, 640)]
  model.norm.weight: count=1, shapes=[(640,)]

=== EXACT ELEMENTWISE AND FROBENIUS COMPARISONS ===
Relative difference = ||B-A|| / sqrt((||A||^2 + ||B||^2)/2).
These are structural differences, NOT behavioral importance scores.

TOTAL: n=100,326,016 changed=79.28341% norm_A=22667.1 norm_B=22667.1 delta_norm=2.47356 relative_delta=0.000109126
Exactly identical tensors: 33 of 235

By layer (-1 denotes tensors outside decoder layers):
  layer -1: n=       640 changed=0.00000% norm_A=1355.75 norm_B=1355.75 delta_norm=0 relative_delta=0
  layer  0: n= 5,573,632 changed=76.75672% norm_A=419.482 norm_B=419.482 delta_norm=0.564606 relative_delta=0.00134596
  layer  1: n= 5,573,632 changed=79.01184% norm_A=1062.31 norm_B=1062.31 delta_norm=0.56879 relative_delta=0.000535428
  layer  2: n= 5,573,632 changed=77.95568% norm_A=1083.36 norm_B=1083.36 delta_norm=0.570384 relative_delta=0.000526498
  layer  3: n= 5,573,632 changed=79.67498% norm_A=1440.11 norm_B=1440.11 delta_norm=0.562423 relative_delta=0.000390541
  layer  4: n= 5,573,632 changed=80.71161% norm_A=1533.35 norm_B=1533.35 delta_norm=0.577649 relative_delta=0.000376724
  layer  5: n= 5,573,632 changed=78.75168% norm_A=1257 norm_B=1257 delta_norm=0.577494 relative_delta=0.000459421
  layer  6: n= 5,573,632 changed=79.43336% norm_A=1241.46 norm_B=1241.46 delta_norm=0.576992 relative_delta=0.000464769
  layer  7: n= 5,573,632 changed=78.75933% norm_A=1200.26 norm_B=1200.26 delta_norm=0.572171 relative_delta=0.000476707
  layer  8: n= 5,573,632 changed=79.75980% norm_A=1385.03 norm_B=1385.03 delta_norm=0.56923 relative_delta=0.000410987
  layer  9: n= 5,573,632 changed=78.63596% norm_A=1460.66 norm_B=1460.66 delta_norm=0.577223 relative_delta=0.00039518
  layer 10: n= 5,573,632 changed=79.30201% norm_A=2451.37 norm_B=2451.37 delta_norm=0.580494 relative_delta=0.000236804
  layer 11: n= 5,573,632 changed=78.88415% norm_A=5975.8 norm_B=5975.8 delta_norm=0.575973 relative_delta=9.63843e-05
  layer 12: n= 5,573,632 changed=79.49793% norm_A=7331.07 norm_B=7331.07 delta_norm=0.595671 relative_delta=8.12529e-05
  layer 13: n= 5,573,632 changed=80.37845% norm_A=6871.15 norm_B=6871.15 delta_norm=0.60546 relative_delta=8.81163e-05
  layer 14: n= 5,573,632 changed=80.17967% norm_A=7863.24 norm_B=7863.24 delta_norm=0.607012 relative_delta=7.71962e-05
  layer 15: n= 5,573,632 changed=79.80602% norm_A=9694.16 norm_B=9694.16 delta_norm=0.622983 relative_delta=6.42637e-05
  layer 16: n= 5,573,632 changed=79.95067% norm_A=9574.55 norm_B=9574.55 delta_norm=0.604505 relative_delta=6.31366e-05
  layer 17: n= 5,573,632 changed=79.66055% norm_A=10309.5 norm_B=10309.5 delta_norm=0.581168 relative_delta=5.63721e-05

By tensor family:
  model.layers.*.input_layernorm.weight: n=    11,520 changed=0.97222% norm_A=3032.96 norm_B=3032.96 delta_norm=0.00514645 relative_delta=1.69684e-06
  model.layers.*.mlp.down_proj.weight: n=23,592,960 changed=88.12795% norm_A=79.5519 norm_B=79.5517 delta_norm=1.12934 relative_delta=0.0141962
  model.layers.*.mlp.gate_proj.weight: n=23,592,960 changed=76.10053% norm_A=189.807 norm_B=189.807 delta_norm=1.24005 relative_delta=0.00653323
  model.layers.*.mlp.up_proj.weight: n=23,592,960 changed=74.17595% norm_A=189.654 norm_B=189.654 delta_norm=1.22116 relative_delta=0.00643891
  model.layers.*.post_attention_layernorm.weight: n=    11,520 changed=1.05035% norm_A=12788.7 norm_B=12788.7 delta_norm=0.00443938 relative_delta=3.47134e-07
  model.layers.*.post_feedforward_layernorm.weight: n=    11,520 changed=1.49306% norm_A=18353.1 norm_B=18353.1 delta_norm=0.00619997 relative_delta=3.37815e-07
  model.layers.*.pre_feedforward_layernorm.weight: n=    11,520 changed=2.74306% norm_A=1491.21 norm_B=1491.21 delta_norm=0.00780773 relative_delta=5.23585e-06
  model.layers.*.self_attn.k_norm.weight: n=     4,608 changed=2.92969% norm_A=152.314 norm_B=152.314 delta_norm=0.00520106 relative_delta=3.41469e-05
  model.layers.*.self_attn.k_proj.weight: n= 2,949,120 changed=77.22436% norm_A=67.2137 norm_B=67.2138 delta_norm=0.440788 relative_delta=0.006558
  model.layers.*.self_attn.o_proj.weight: n=11,796,480 changed=80.47945% norm_A=104.038 norm_B=104.038 delta_norm=0.808479 relative_delta=0.00777099
  model.layers.*.self_attn.q_norm.weight: n=     4,608 changed=3.97135% norm_A=93.1716 norm_B=93.1716 delta_norm=0.00606156 relative_delta=6.5058e-05
  model.layers.*.self_attn.q_proj.weight: n=11,796,480 changed=79.30542% norm_A=133.018 norm_B=133.019 delta_norm=0.889702 relative_delta=0.00668856
  model.layers.*.self_attn.v_proj.weight: n= 2,949,120 changed=73.50508% norm_A=67.6579 norm_B=67.6582 delta_norm=0.417658 relative_delta=0.00617308
  model.norm.weight: n=       640 changed=0.00000% norm_A=1355.75 norm_B=1355.75 delta_norm=0 relative_delta=0

Top 20 tensors by absolute delta norm:
  model.layers.14.mlp.gate_proj.weight: delta=0.308019, relative=0.00689472, changed=77.16652%
  model.layers.14.mlp.up_proj.weight: delta=0.307886, relative=0.00690102, changed=75.38673%
  model.layers.15.mlp.up_proj.weight: delta=0.307469, relative=0.00688186, changed=75.33333%
  model.layers.15.mlp.gate_proj.weight: delta=0.30703, relative=0.00686954, changed=76.97922%
  model.layers.16.mlp.gate_proj.weight: delta=0.302339, relative=0.00678077, changed=76.64680%
  model.layers.13.mlp.gate_proj.weight: delta=0.30173, relative=0.00675575, changed=76.57860%
  model.layers.13.mlp.up_proj.weight: delta=0.301156, relative=0.00675501, changed=75.01671%
  model.layers.16.mlp.up_proj.weight: delta=0.300853, relative=0.00672122, changed=74.85725%
  model.layers.12.mlp.gate_proj.weight: delta=0.296663, relative=0.00662556, changed=77.13524%
  model.layers.17.mlp.up_proj.weight: delta=0.295456, relative=0.00657991, changed=74.70764%
  model.layers.17.mlp.gate_proj.weight: delta=0.294153, relative=0.00666485, changed=76.80191%
  model.layers.6.mlp.gate_proj.weight: delta=0.294034, relative=0.00657579, changed=76.60027%
  model.layers.15.mlp.down_proj.weight: delta=0.291926, relative=0.015908, changed=88.97827%
  model.layers.12.mlp.up_proj.weight: delta=0.291712, relative=0.00652563, changed=75.14427%
  model.layers.4.mlp.gate_proj.weight: delta=0.291014, relative=0.00649553, changed=76.17859%
  model.layers.5.mlp.gate_proj.weight: delta=0.289676, relative=0.00646346, changed=76.34026%
  model.layers.11.mlp.gate_proj.weight: delta=0.288633, relative=0.00644628, changed=76.46973%
  model.layers.14.mlp.down_proj.weight: delta=0.288605, relative=0.018741, changed=90.66559%
  model.layers.7.mlp.gate_proj.weight: delta=0.287343, relative=0.00641485, changed=76.30806%
  model.layers.8.mlp.gate_proj.weight: delta=0.287302, relative=0.0063959, changed=76.85326%

Top 20 tensors by relative delta norm:
  model.layers.4.mlp.down_proj.weight: relative=0.0188927, delta=0.263012, changed=91.90575%
  model.layers.14.mlp.down_proj.weight: relative=0.018741, delta=0.288605, changed=90.66559%
  model.layers.8.mlp.down_proj.weight: relative=0.0171211, delta=0.254042, changed=89.84245%
  model.layers.1.mlp.down_proj.weight: relative=0.0170993, delta=0.266182, changed=89.89822%
  model.layers.13.mlp.down_proj.weight: relative=0.0168742, delta=0.27971, changed=89.63661%
  model.layers.10.mlp.down_proj.weight: relative=0.0165194, delta=0.257345, changed=89.85176%
  model.layers.3.mlp.down_proj.weight: relative=0.0164501, delta=0.261297, changed=89.92661%
  model.layers.15.mlp.down_proj.weight: relative=0.015908, delta=0.291926, changed=88.97827%
  model.layers.6.mlp.down_proj.weight: relative=0.0149442, delta=0.255666, changed=88.52470%
  model.layers.17.mlp.down_proj.weight: relative=0.0144757, delta=0.264389, changed=88.11096%
  model.layers.16.mlp.down_proj.weight: relative=0.0143463, delta=0.28325, changed=87.83989%
  model.layers.2.mlp.down_proj.weight: relative=0.0140619, delta=0.260818, changed=87.99530%
  model.layers.7.mlp.down_proj.weight: relative=0.0133444, delta=0.255363, changed=87.10114%
  model.layers.11.mlp.down_proj.weight: relative=0.0121551, delta=0.249632, changed=85.89592%
  model.layers.9.mlp.down_proj.weight: relative=0.0121532, delta=0.256792, changed=85.89088%
  model.layers.12.mlp.down_proj.weight: relative=0.0119406, delta=0.27038, changed=85.82344%
  model.layers.3.self_attn.o_proj.weight: relative=0.0110028, delta=0.176902, changed=85.02289%
  model.layers.16.self_attn.o_proj.weight: relative=0.0109819, delta=0.191689, changed=84.56497%
  model.layers.0.mlp.down_proj.weight: relative=0.0109329, delta=0.269196, changed=84.54353%
  model.layers.4.self_attn.o_proj.weight: relative=0.0109289, delta=0.187839, changed=86.23718%

Non-layer tensors:
  model.norm.weight: shape=(640,), relative=0, delta=0
