Grug 67B A2B — Campaign 2 DARE-TIES-02

Research artifact. This model has not been properly tested or evaluated and is not necessarily secure. Use at your own risk in production settings.

This is the dare-ties-02 checkpoint from the second Snowball/Grug model-merging campaign. It transfers specialist updates into the Base checkpoint while preserving 93.96% of Base scalar weights bit-for-bit. The measured changed fraction is 6.037362616948686%, within the campaign's 25% cap.

Fixed-policy benchmark Score (%)
NUPA, fixed 200-task subset 0.00
BFCL-Parity/Pi 45.53
Sum 45.53

NUPA scored all 200 tasks; BFCL scored all 123 trials. The NUPA zero received the required ten-trace review. These are development benchmark results, not held-out evidence. Non-target capability retention was not evaluated for this checkpoint.

The merge applies DARE-TIES within the fixed R25 routed-expert support (1,705 expert blocks). DARE keep density is 0.20, TIES trimming density is 0.20, the NUPA/BFCL delta coefficients are 0.50/0.50, the scale is 1.00, and the random seed is 0. Outside the selected support, weights are copied from Base unchanged. Tokenizer, chat template, model configuration, tensor names, dtypes and shard layout are unchanged from Base.

Parent checkpoints are pinned as follows:

Merge provenance and file hashes contain the exact support, merge parameters and SHA256 hashes of all 48 source files. All 48 source files are published unchanged; this model card, the license and merge provenance are publication additions. The inherited .cache_metadata.json and .marinskyrl-model-manifest.json describe Base's original cache identity and remain unchanged for source fidelity; use merge-provenance.json to verify this merged checkpoint's files.

Licensed under OpenMDW 1.1.

We release our tools to the public with the intent that they are used safely, ethically, and responsibly. They are meant to contribute to the public's understanding of science, and aid in its advancement. By using this Marin model, you agree to comply with all applicable law.

Downloads last month
93
Safetensors
Model size
67B params
Tensor type
F32
·
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for open-athena/Grug-67B-A2B-Merge-Campaign2-DARE-TIES-02-2026.10.10