SAG / ARCHITECTURE NOTE
DPR and bi-encoders: Fast semantic search across large document collections
Explains what DPR is and why it is needed, how it works, criteria for applying it to SAG architecture, and a practical checklist, drawing on research and official documentation.
Definition in one sentence
DPR is a dense retrieval method that separately encodes questions and documents as vectors, then quickly finds nearby vectors.
Key answer: It can connect questions and documents that have the same meaning despite using different words, and it can search large collections quickly by precomputing document vectors.
Why is this technology needed?
It can connect questions and documents that have the same meaning despite using different words, and it can search large collections quickly by precomputing document vectors.
How it works
The question encoder and document encoder are trained to bring relevant pairs closer together. The retrieval stage can focus on finding a broad set of candidates, leaving precise judgment to a subsequent reranker.
Accuracy is not the only consideration in design. Latency, cost, data boundaries, update frequency, and behavior on failure must also be defined to produce reproducible results in operation. For values that automation cannot determine with confidence, it is safer to leave them as unmeasured or requiring review rather than changing them to zero or treating them as successful.
Connection to SAG technology
If applying this to SAG, index customer questions and approved source documents within the tenant scope, and retain the document ID and version in the search results. This is an application principle for the current scope, in which external models are not connected.
Practical checklist
- Confirm that tenant filters also apply to vector search
- Train and evaluate using hard negatives—documents that are easily confused with relevant ones
- Record the vector model and index versions
- Distinguish the status of failures, empty results, and permission errors from success
- Revalidate before and after changes under the same conditions
Research and official documentation
Reference documents provide a basis for the principles and recommendations. They do not guarantee search visibility, AI mentions, rankings, or revenue; the actual effects of implementation must be verified through observations of service data under the same conditions.
Selection criteria and a specific application example
Because it compares a single question vector with pre-stored document vectors, this approach reduces the cost of rerunning the model for each document. However, opposing conditions with similar meanings, such as “available” and “unavailable,” may also appear among the candidates, so the conditions must be checked for a match.
Scope of application at SAG
This article covers research principles in search AI and extension designs. Read it in connection with SAG’s page collection, evidence logging, and report validation structure, but do not interpret it to mean that every search algorithm in the paper has been incorporated into the production pipeline. Whether it has been applied should be verified through the search module, evaluation data, and execution records.
How to continue reading about this technology
Compare the papers and application conditions for RAG, GraphRAG, and Self-RAG.
SAG / KNOWLEDGE LINKS