NORIKA ODA

06RESEARCH PAPERPreprint

Mercury: An Addressable Million-Cell Sensor Grid for Browser-Accessible LLM Observability on Consumer Hardware

Chen, Ho Yiing

發表日期

DOI 10.5281/zenodo.20313154 Zenodo 紀錄頁 PDF(131 KB)

01

摘要

ABSTRACTZenodo 原文

v2 corrigendum (2026-05-21): Bibliography polished to canonical forms — Bycroft (December 2023) year corrected, full author lists added for Bricken et al. (24 authors) and Carter et al. (5 authors), DOIs added for Vig (10.18653/v1/P19-3007) and Activation Atlas (10.23915/distill.00015). No changes to method, results, or claims.

I present Mercury, an open-source observability layer for transformer language models that places up to one million addressable sensor cells across a model's hidden state space, captures activation patterns through a standard logits-processor hook, and produces an interactive 3D visualization in a single 2 MB self-contained HTML file.

Existing interpretability methods (sparse autoencoders, dictionary learning) typically require auxiliary model training and substantial GPU resources. Mercury runs on consumer hardware (one RTX 3060 12 GB) and completes a full observation pass in 3.5 minutes. I demonstrate Mercury on qwen2.5:7B, identifying 14,912 active sensor cells across ten multilingual prompts and 944 distinct firing signatures.

The a-priori Rosen-bridge topology, designed before any data was collected, recovers 18,113 visible co-firing edges where chance would predict 1,313, a 13.8x enrichment (p < 10^-50).

Companion records: Mercury-Viewer (10.5281/zenodo.20313150), and forthcoming Mercury discovery and scaling preprints.

02

全文 PDF

FULL TEXT1 個檔
  • 下載 PDFpaper1-mercury-method.pdf・131 KB・本站

PDF 與 Zenodo 上的檔案相同(大小與 md5 已核對)。

03

論文資料

DETAILSZenodo 紀錄 20313154
作者
Chen, Ho Yiing
發表日期
資源類型
Preprint
DOI
10.5281/zenodo.20313154
Zenodo
zenodo.org/records/20313154
授權
Creative Commons Attribution 4.0 International
版本
1.1.0

作者 Chen, Ho Yiing 是織田紀香的本名(陳禾穎)英文拼寫。標題、摘要、關鍵字與授權照 Zenodo 原文。

04

關鍵字

KEYWORDS13 個
  • LLM interpretability
  • mechanistic interpretability
  • transformer observability
  • sensor grid
  • activation analysis
  • Rosen bridge
  • Qwen2.5
  • consumer hardware
  • logits-processor hook
  • mmap binary format
  • open source
  • independent research
  • Mercury
05

其他研究論文

MORE