{
  "schema_version": "1.1",
  "id": "archive:https://arxiv.org/abs/2611.09818v1",
  "slug": "2611-09818v1-16acbgh",
  "url": "https://feed7.dev/p/2611-09818v1-16acbgh",
  "title": "Generative Latent Priors for Interpreting and Steering Protein Language Models",
  "why_included": "A diffusion prior for ESM-2 activations improves some protein-feature probes and isolated steering, but decoded sequences lose structural plausibility over repeated rounds. The work is outside everyday coding-agent practice.",
  "summary": "Generative Latent Priors learn distributions of frozen ESM-2 activations and are evaluated with **ESM-2-8M** and **ESM-2-650M**. As probes, they perform strongly on discrete protein concepts; as an editing prior, they steer three biochemical properties in isolation.",
  "practical_implication": "For builders working with protein language models, the result suggests activation priors can help inspect representations and guide edits, but generated sequences need validation after decoding and repeated editing.",
  "agent_context": "Generative Latent Priors learn distributions of frozen ESM-2 activations and are evaluated with **ESM-2-8M** and **ESM-2-650M**. As probes, they perform strongly on discrete protein concepts; as an editing prior, they steer three biochemical properties in isolation.\n\nFor builders working with protein language models, the result suggests activation priors can help inspect representations and guide edits, but generated sequences need validation after decoding and repeated editing.\n\nRepeated decoding compromised structural plausibility, and only the Helix motif succeeded in the reported SAE-based structural steering experiments. The paper attributes naturalness problems to rewriting coverage and the decoder as well as describing limitations of the method.",
  "source": {
    "name": "arXiv",
    "url": "https://arxiv.org/abs/2611.09818v1",
    "published_at": "2026-11-06T18:06:39.000Z"
  },
  "source_class": "blog_post",
  "content_type": "Paper",
  "layer": "model",
  "domains": [
    "research"
  ],
  "topics": [
    "reasoning"
  ],
  "verification": {
    "status": "needs_review",
    "label": "Needs Review",
    "method": "unverified",
    "verified_at": null
  },
  "uncertainty": [
    "Repeated decoding compromised structural plausibility, and only the Helix motif succeeded in the reported SAE-based structural steering experiments. The paper attributes naturalness problems to rewriting coverage and the decoder as well as describing limitations of the method."
  ],
  "connected_context": {
    "meaning": "This extends activation-based interpretation and steering into protein language models, while showing a sharper constraint: useful probes and isolated edits do not ensure plausible decoded sequences. The reported structural failures, including limited SAE-based steering success, make post-edit validation central to applying these methods.",
    "corpus_size": 1032,
    "generated_at": "2026-11-09T11:01:49.982Z",
    "connections": [
      {
        "title": "Towards interpreting any residual stream direction by scaling activation inversion",
        "source_name": "arXiv",
        "source_url": "https://arxiv.org/abs/2611.08465v1",
        "feed7_url": "https://feed7.dev/p/2611-08465v1-1gcivnw",
        "reason": "Both use internal activations to probe model representations, but MAEMs generate and verify text for language-model residual directions, whereas this work learns priors over protein-model activations and also tests sequence editing; their evidence does not establish transfer across model domains."
      },
      {
        "title": "SAEVerbalizer: Generating Explanations for Sparse Autoencoder Features via Representation Verbalization",
        "source_name": "arXiv",
        "source_url": "https://arxiv.org/abs/2608.13538v1",
        "feed7_url": "https://feed7.dev/p/2608-13538v1-06b1tmn",
        "reason": "SAEVerbalizer interprets sparse autoencoder directions as candidate feature explanations, while this paper tests SAE-based structural steering and reports success only for the Helix motif; the comparison separates readable interpretation from reliable control."
      }
    ]
  },
  "lifecycle": "Current",
  "published_at": "2026-11-06T18:06:39.000Z",
  "modified_at": "2026-11-06T18:06:39.000Z",
  "supersedes": [],
  "expires_at": null,
  "formats": {
    "html": "https://feed7.dev/p/2611-09818v1-16acbgh",
    "json": "https://feed7.dev/p/2611-09818v1-16acbgh.json",
    "markdown": "https://feed7.dev/p/2611-09818v1-16acbgh.md"
  }
}