PhilArchive
open access
Deep Learning Models Also Recall Features
Recent work in mechanistic interpretability has studied how large language models recall facts stored in their weights. This paper argues that factual recall points to something broader: a general kind of operation in deep learning models, which I call feature recall. The core observation is that a linear projection can be read as retrieving stored information scaled by input activations. I define feature recall, show it applies across architectures, and contrast it with the established paradigm of feature combination. I also consider how cases of feature recall might be mechanistically identified. The account offers philosophers a new conceptual tool for understanding deep learning and points to empirical research directions for mechanistic interpretability research.
Conceptio Open Archive
Analyze & explore related research in Conceptio
Connect this record directly into your research workflow or AI agent. Explore citations across open repositories, query full text, and export structured proof bundles.
This document is indexed with metadata only: full text is not available in the archive for this record. Open the official source ↗
Related documents
- A Model of Understanding in Deep Learning Systems#76917
- Introduction to Deep Learning: Neural Networks, Large Language Models and Agentic AI#204210
- Measuring Structured Predictability in Neural Training Dynamics: A Cross-Regime Study#616645
- Measuring Structured Predictability in Neural Training Dynamics: A Cross-Regime Study#616145
- NPBoost: Neural Processes with Gradient-Boosted Fixed Effects#1064666
Record · ID 696554
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Retrieved via Conceptio: every document is proof-bundled with source, license, and retrieval metadata.
Bring this data into your agent: Connect via MCP or API · 20 free credits to start · no card required
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive
Read the Docs → · View CLI source on GitHub · Conceptio Open Knowledge Archive