06RESEARCH PAPERPreprint
A Reproducible Within-Family SLERP Merge of Llama-3.1-8B-Instruct and DeepSeek-R1-Distill-Llama-8B
發表日期
摘要
ABSTRACTZenodo 原文We document a reproducible weight-level merge of two same-family checkpoints (Llama-3.1-8B-Instruct and DeepSeek-R1-Distill-Llama-8B) using Spherical Linear Interpolation (SLERP) at t=0.5. The merge is performed via the open-source mergekit toolkit on a 188 GB CPU server in approximately three minutes. The resulting 8B-parameter model loads cleanly through the Hugging Face transformers library and generates coherent English on five out-of-distribution prompts spanning explanation, arithmetic, poetry, factual recall, and algebra. We then quantitatively benchmark the merged model against both base checkpoints on a 10-prompt held-out GSM8K subset. The merged artifact achieves 60% accuracy matching Llama-3.1-8B-Instruct baseline (zero merge tax in this configuration) while acquiring the reasoning-marker style of the DeepSeek-R1-Distill donor (4.30 markers per generation vs 2.45 for Llama). We document a caveat: DeepSeek-R1-Distill itself scored only 10% under our 200-token budget, reflecting incompatibility between the budget and R1-family reasoning chain length, not the model's underlying capability. We pair this result with a companion negative finding on activation-level function vector injection between the same two checkpoints: weight-level SLERP produces a usable composed model that inherits stylistic features from the donor without accuracy loss, while naive single-layer activation steering does not transfer the donor's reasoning capability. This contrast motivates a layered framework in which different composition mechanisms address different sub-problems.
全文 PDF
FULL TEXT1 個檔- 下載 PDFpaper-slerp-positive.pdf・154 KB・本站
PDF 與 Zenodo 上的檔案相同(大小與 md5 已核對)。
論文資料
DETAILSZenodo 紀錄 20404139- 作者
- Chen, Ho Yiing
- 發表日期
- 資源類型
- Preprint
- DOI
- 10.5281/zenodo.20404139
- Zenodo
- zenodo.org/records/20404139
- 授權
- Creative Commons Attribution 4.0 International
作者 Chen, Ho Yiing 是織田紀香的本名(陳禾穎)英文拼寫。標題、摘要、關鍵字與授權照 Zenodo 原文。
關鍵字
KEYWORDS12 個- LLM composition
- model merging
- SLERP
- Spherical Linear Interpolation
- mergekit
- Llama-3
- DeepSeek-R1
- GSM8K
- reproducibility
- Frankenstein framework
- weight-level merging
- within-family composition