NORIKA ODA

06RESEARCH PAPERPreprint

A Reproducible Within-Family SLERP Merge of Llama-3.1-8B-Instruct and DeepSeek-R1-Distill-Llama-8B

Chen, Ho Yiing

發表日期

DOI 10.5281/zenodo.20404139 Zenodo 紀錄頁 PDF(154 KB)

01

摘要

ABSTRACTZenodo 原文
We document a reproducible weight-level merge of two same-family checkpoints (Llama-3.1-8B-Instruct and DeepSeek-R1-Distill-Llama-8B) using Spherical Linear Interpolation (SLERP) at t=0.5. The merge is performed via the open-source mergekit toolkit on a 188 GB CPU server in approximately three minutes. The resulting 8B-parameter model loads cleanly through the Hugging Face transformers library and generates coherent English on five out-of-distribution prompts spanning explanation, arithmetic, poetry, factual recall, and algebra. We then quantitatively benchmark the merged model against both base checkpoints on a 10-prompt held-out GSM8K subset. The merged artifact achieves 60% accuracy matching Llama-3.1-8B-Instruct baseline (zero merge tax in this configuration) while acquiring the reasoning-marker style of the DeepSeek-R1-Distill donor (4.30 markers per generation vs 2.45 for Llama). We document a caveat: DeepSeek-R1-Distill itself scored only 10% under our 200-token budget, reflecting incompatibility between the budget and R1-family reasoning chain length, not the model's underlying capability. We pair this result with a companion negative finding on activation-level function vector injection between the same two checkpoints: weight-level SLERP produces a usable composed model that inherits stylistic features from the donor without accuracy loss, while naive single-layer activation steering does not transfer the donor's reasoning capability. This contrast motivates a layered framework in which different composition mechanisms address different sub-problems.
02

全文 PDF

FULL TEXT1 個檔
  • 下載 PDFpaper-slerp-positive.pdf・154 KB・本站

PDF 與 Zenodo 上的檔案相同(大小與 md5 已核對)。

03

論文資料

DETAILSZenodo 紀錄 20404139
作者
Chen, Ho Yiing
發表日期
資源類型
Preprint
DOI
10.5281/zenodo.20404139
Zenodo
zenodo.org/records/20404139
授權
Creative Commons Attribution 4.0 International

作者 Chen, Ho Yiing 是織田紀香的本名(陳禾穎)英文拼寫。標題、摘要、關鍵字與授權照 Zenodo 原文。

04

關鍵字

KEYWORDS12 個
  • LLM composition
  • model merging
  • SLERP
  • Spherical Linear Interpolation
  • mergekit
  • Llama-3
  • DeepSeek-R1
  • GSM8K
  • reproducibility
  • Frankenstein framework
  • weight-level merging
  • within-family composition
05

其他研究論文

MORE