Ingest: Verbalizable Representations Form a Global Workspace in Language Models

Type: kb/sources/types/ingest-report.md

Source: verbalizable-representations-global-workspace-llms.md Captured: 2026-07-06 From: https://transformer-circuits.pub/2026/workspace/index.html

Classification

Type: scientific-paper -- Anthropic Transformer Circuits research article with a new interpretability method, causal interventions, ablations, task batteries, training experiments, and limitations. Domains: interpretability, activation, learning-theory, observability Author: Anthropic interpretability researchers; strong author signal for access to Claude-family internals and concrete experiments, with the normal vendor and closed-model replication caveats.

Summary

The paper introduces the Jacobian lens, a method for reading token-aligned, verbalizable directions in model activations, and defines the J-space as sparse combinations of those directions. It argues that this J-space functions like a limited global workspace: concepts in it can be reported, deliberately modulated, used as intermediates in flexible reasoning, broadcast to downstream computations, and selectively bypassed by automatic processing. The strongest experiments use swaps and ablations to show causal roles, then apply the lens to alignment auditing, post-training's installation of an Assistant point of view, and counterfactual reflection training, where training on hypothetical reflective continuations changes behavior in the original unreflected contexts. The paper is explicit that this is a functional analogy, not a claim that LLMs reproduce human global-workspace architecture or settle consciousness questions.

Connections Found

The source lands in the KB's representational-form, activation, and learning-substrate cluster, not as a general context-engineering source. It directly supports representational form by giving a concrete example of a distributed-parametric operative part whose inspection method is probing and intervention. It strengthens Knowledge storage does not imply contextual activation because the paper distinguishes concepts being present in J-space from those concepts being causally used by the current task. It supports Process structure and output structure are independent levers and Treat continual learning as substrate coevolution through counterfactual reflection training: text about possible reflection changes model-internal behavior without directly supervising the target output. It also gives source-to-source comparison with An Enigma of Artificial Reason, since both use probes and causal interventions to separate surface behavior from hidden model state.

Extractable Value

  1. Probeable parametric operative parts -- The J-space is a worked example for the distributed-parametric branch of representational form: not readable like prose or testable like code, but partially inspectable through a trained/derived probe and causal interventions. This is new relative to the KB's mostly coarse "probe parametric artifacts behaviorally" wording. [quick-win]
  2. Presence is not causal activation, even inside the model -- The language experiments show a concept can appear in J-lens readouts across tasks but affect only report and flexible inference, not automatic continuation or anomaly detection. This is a tighter, model-internal cousin of Knowledge storage does not imply contextual activation. [deep-dive]
  3. Externalized reasoning can relieve internal-workspace demand -- GSM8K with explicit chain-of-thought is more robust to J-space ablation than direct answering, which gives a mechanistic explanation for why writing intermediate steps helps: it moves work onto the page so the model does not have to carry it in the internal workspace. This directly informs the KB's externalization and soft-context-bound notes. [experiment]
  4. Counterfactual reflection is cross-form process shaping -- Training on reflective continuations that are not present at evaluation implants ethical/reflection concepts in the workspace and changes behavior; ablation largely removes the benefit. This is strong evidence for prose/text supervision shaping distributed-parametric behavior through a process channel rather than an output-format channel. [deep-dive]
  5. Probeability is weaker than artifact inspectability -- The source complicates Inspectable artifact, not supervision, defeats the blackbox problem without overturning it: a probe can make part of a parametric system legible, but it does not provide stable discrete commitments, provenance, diffs, review, or rollback. [quick-win]
  6. Alignment auditing gains a cheap hidden-state signal, not a complete monitor -- J-lens readouts surface evaluation awareness, prompt-injection recognition, strategic deliberation, and hidden misaligned dispositions in examples, but the paper explicitly warns that automatic or reinforced circuits, multi-token concepts, and non-J-space mechanisms may evade it. [just-a-reference]

Limitations (our opinion)

The paper should not be imported as "LLM context engineering." It studies and modifies model-internal representations; context engineering is the architecture around what enters a bounded call, and explicitly excludes model training or architecture changes. The Jacobian lens is also a partial instrument: it is token-indexed, weak on multi-token or non-verbal concepts, and tied to a post-hoc workspace-layer boundary. The alignment-auditing results are promising but not sufficient for safety monitoring, and the counterfactual reflection result is narrow until replicated across goals, models, and possible side effects. Finally, the experiments are Anthropic-internal and partly on closed production models, so the KB should treat the results as high-value evidence with replication limits, not as a general law of all transformers.

Write a note titled Externalized reasoning trades internal workspace demand for context budget in kb/notes/, connecting this source with Agent context is constrained by soft degradation, not hard token limits, LLM-mediated schedulers are a degraded variant of the clean model, and Process structure and output structure are independent levers.