06RESEARCH PAPERPreprint
Mercury: An Addressable Million-Cell Sensor Grid for Browser-Accessible LLM Observability on Consumer Hardware
發表日期
摘要
ABSTRACTZenodo 原文v2 corrigendum (2026-05-21): Bibliography polished to canonical forms — Bycroft (December 2023) year corrected, full author lists added for Bricken et al. (24 authors) and Carter et al. (5 authors), DOIs added for Vig (10.18653/v1/P19-3007) and Activation Atlas (10.23915/distill.00015). No changes to method, results, or claims.
I present Mercury, an open-source observability layer for transformer language models that places up to one million addressable sensor cells across a model's hidden state space, captures activation patterns through a standard logits-processor hook, and produces an interactive 3D visualization in a single 2 MB self-contained HTML file.
Existing interpretability methods (sparse autoencoders, dictionary learning) typically require auxiliary model training and substantial GPU resources. Mercury runs on consumer hardware (one RTX 3060 12 GB) and completes a full observation pass in 3.5 minutes. I demonstrate Mercury on qwen2.5:7B, identifying 14,912 active sensor cells across ten multilingual prompts and 944 distinct firing signatures.
The a-priori Rosen-bridge topology, designed before any data was collected, recovers 18,113 visible co-firing edges where chance would predict 1,313, a 13.8x enrichment (p < 10^-50).
Companion records: Mercury-Viewer (10.5281/zenodo.20313150), and forthcoming Mercury discovery and scaling preprints.
全文 PDF
FULL TEXT1 個檔- 下載 PDFpaper1-mercury-method.pdf・131 KB・本站
PDF 與 Zenodo 上的檔案相同(大小與 md5 已核對)。
論文資料
DETAILSZenodo 紀錄 20313154- 作者
- Chen, Ho Yiing
- 發表日期
- 資源類型
- Preprint
- DOI
- 10.5281/zenodo.20313154
- Zenodo
- zenodo.org/records/20313154
- 授權
- Creative Commons Attribution 4.0 International
- 版本
- 1.1.0
作者 Chen, Ho Yiing 是織田紀香的本名(陳禾穎)英文拼寫。標題、摘要、關鍵字與授權照 Zenodo 原文。
關鍵字
KEYWORDS13 個- LLM interpretability
- mechanistic interpretability
- transformer observability
- sensor grid
- activation analysis
- Rosen bridge
- Qwen2.5
- consumer hardware
- logits-processor hook
- mmap binary format
- open source
- independent research
- Mercury