NORIKA ODA

06RESEARCH PAPERPreprint

Single-Dim Functional Control and Pathway-Specific Inhibition in a Passthrough-Merged Qwen2.5 Hybrid

Chen, Ho Yiing

發表日期

DOI 10.5281/zenodo.20347062 Zenodo 紀錄頁 PDF(89 KB)

01

摘要

ABSTRACTZenodo 原文

© Copyright 2026 Chen, Ho Yiing (ORCID: 0009-0006-6816-9891), Independent researcher, charenix.com. All rights reserved by the author. This work is licensed under the Creative Commons Attribution 4.0.

Restoring exactly one hidden-state coordinate (d=758, last four blocks of a passthrough-merged qwen2.5 hybrid) flips a Chinese narrative response into a bilingual codeblock-with-emoji response on a specific technical-explanation input, while leaving four other inputs visually unchanged.

Four findings:

  1. Single-d controller demo: Restoring d=758 alone in blocks 24-27 of v7b (a 24-block Instruct + 4-block Coder passthrough merge) triggers a reproducible style switch (Chinese narrative to bilingual codeblock + crab emoji) on the race-condition prompt. Other four prompts unchanged.
  2. 11-dim functional taxonomy: Sweeping one-at-a-time restoration across the 11 Mercury anchor dimensions sorts them into 4 categories: clean triggers (279, 382, 476, 758), trigger+destabilizers (11, 334, 510), pure destabilizers (12, 25, 481), and one hidden inhibitor (715).
  3. Pathway-specific inhibition: Pairing d=715 with each trigger reveals a binary pathway split: {279, 476} fully suppressed by 715, {382, 758} immune. First reported structural relationship inside the 11 anchors.
  4. Subspace consistency principle: Layer-norm-only ablation (9 scalar overrides) collapses generation on 2 of 5 prompts; full subspace restoration (50+ tensor slices per anchor) preserves coherence. Steering edits need full read-pathway integration, not scalar gain edits.

Single-coordinate control reached by ablation alone, no sparse autoencoder training, no gradient-based feature attribution. The controller is one integer index in the model's native basis.

Companion records: Mercury method (10.5281/zenodo.20313154), discovery (10.5281/zenodo.20313748), viewer dataset (10.5281/zenodo.20313150), scaling (10.5281/zenodo.20325676), cross-model dim preservation (10.5281/zenodo.20346626), SLERP/TIES case study (10.5281/zenodo.20346628).

02

全文 PDF

FULL TEXT1 個檔
  • 下載 PDFpaper-B-functional-control.pdf・89 KB・本站

PDF 與 Zenodo 上的檔案相同(大小與 md5 已核對)。

03

論文資料

DETAILSZenodo 紀錄 20347062
作者
Chen, Ho Yiing
發表日期
資源類型
Preprint
DOI
10.5281/zenodo.20347062
Zenodo
zenodo.org/records/20347062
授權
Creative Commons Attribution 4.0 International
版本
1.0.0

作者 Chen, Ho Yiing 是織田紀香的本名(陳禾穎)英文拼寫。標題、摘要、關鍵字與授權照 Zenodo 原文。

04

關鍵字

KEYWORDS13 個
  • mechanistic interpretability
  • activation steering
  • single-feature ablation
  • subspace patching
  • model merging
  • passthrough merge
  • anchor dimensions
  • pathway inhibition
  • feature control
  • Qwen2.5
  • Coder
  • Mercury
  • independent research
05

其他研究論文

MORE