@helloiamleonie
Advanced Retrieval-Augmented Generation (RAG) techniques address the limitations of naive RAG pipelines. A recent survey on RAG classifies advanced RAG techniques into pre-retrieval, retrieval, and post-retrieval optimizations. š Paper: https://t.co/dWkf0Uc587 My latest article gives an overview of advanced RAG techniques: š¦ Pre-retrieval includes techniques like sliding windows, enhancing data granularity, adding metadata, or optimizing index structures, such as sentence window retrieval. š¦ Retrieval includes optimizing the embedding models (e.g., fine-tuning) or advanced retrieval techniques like hybrid search š¦ Post-retrieval includes reranking or prompt compression. We also implement a naive RAG pipeline using @llama_index and then enhance it to an advanced RAG pipeline using the following: ⢠Sentence window retrieval (as a pre-retrieval optimization) ⢠Hybrid search (as a retrieval optimization) ⢠Re-ranking (as a post-retrieval optimization) š» Jupyter Notebooks: https://t.co/MFiz00RQHb Read more on @TDataScience: https://t.co/zgD02G1Rn7