NORIKA ODA

06RESEARCH PAPERPreprint

Coverage Failure as a Diagnostic Signal in Neural Model Probing

Chen, Ho Yiing

發表日期

DOI 10.5281/zenodo.20448669 Zenodo 紀錄頁 PDF(56 KB)

01

摘要

ABSTRACTZenodo 原文
We report a methodological observation from a multi-machine dense-grid activation probing study of nineteen small to mid-sized language models (124M to 7.6B parameters). Every experiment satisfied a nominal threshold of one hundred million observation slots, yet observed fill rate varied from 58.75 percent to 97.05 percent across experiments. The observed gap is strongly associated with protocol choices, in particular the prompt corpus size and the use of per-channel quantile binning. We cannot yet rule out interaction with the network under study, the prompt set, hook discovery completeness, or quantile edge quality; the comparisons we report are observational rather than controlled. We argue that total slot count alone is an invalid completion criterion for activation probing, that coverage percentage should be reported as a first-class result, and that under-coverage should be treated as a diagnostic signal about the probe protocol before being attributed to the model.
02

全文 PDF

FULL TEXT1 個檔
  • 下載 PDFpaper-2-coverage-failure.pdf・56 KB・本站

PDF 與 Zenodo 上的檔案相同(大小與 md5 已核對)。

03

論文資料

DETAILSZenodo 紀錄 20448669
作者
Chen, Ho Yiing
發表日期
資源類型
Preprint
DOI
10.5281/zenodo.20448669
Zenodo
zenodo.org/records/20448669
授權
Creative Commons Attribution 4.0 International
版本
v1

作者 Chen, Ho Yiing 是織田紀香的本名(陳禾穎)英文拼寫。標題、摘要、關鍵字與授權照 Zenodo 原文。

04

關鍵字

KEYWORDS14 個
  • LLM interpretability
  • mechanistic interpretability
  • activation observation
  • methodology
  • observation artifact
  • screening protocol
  • coverage metric
  • cell count
  • dense grid
  • reproducibility
  • Mercury
  • consumer hardware
  • open source
  • independent research
05

其他研究論文

MORE