RAG without Forgetting Deep Dive

Series · 1 posts

← Back to Paper Reading

  • RAG without Forgetting: Writing Successful Query Expansion Back into the Index

    Intermediate Retrieval, memory, and production RAG
    RAG without Forgetting Deep Dive · Part 1 · Note · Mar 23, 2026 · Paper · 2026 · NLP

    A source-grounded assessment of ERM's correctness gate, selective attribution, bounded key updates, BEIR/BRIGHT results, and missing artifacts.

    Understand it in 90 seconds
    Problem
    query expansion can bridge query–document mismatch but regenerates work on every request; persistent key expansion can write bad feedback into the index.
    Core insight
    ERM accepts an expansion unit only through a correctness gate, attributes it to document keys whose similarity it improves, and applies a bounded update. It updates keys, not retriever parameters.
    Strongest evidence
    the paper reports retrieval and generation results across 13 BEIR/BRIGHT domains, with Table 1, Table 2, Figure 3, and Appendix B.9 separating quality, latency, budget, and transfer.
    Main boundary
    there is no public implementation, live A/B, attack/privacy, or rollback study; a bad gate can turn a wrong association into persistent index state.
    Read the full deep dive

For speaking invitations, internal engineering sessions, or architecture exchange, see the topics and public work I can bring into the conversation.

Speaking & contact