Manas Two-stage Retrieval — The efficient architecture for hierarchical documents

Manas Two-stage Retrieval — The efficient architecture for hierarchical documents

摘要

As more use cases are onboarded to Manas, one special scalability and efficiency challenge emerges when serving documents with a hierarchical structure. Manas, as a traditional search engine, was designed and optimized to support flattened documents. As a result, we have to flatten attributes of root documents all the way to the leaf level regardless of the hierarchical structure, leading to inefficiencies in both indexing and serving pipelines.