Rewrite Retrieve Read
llmsathina-rag-cookbooksadvanced_rag_techniquesopenaiAItutorialsChromaDBcookbooksfaissqdrantLLMPythonpineconeraglangchainweaviate
Export
Rewrite-Retrieve-Read (RRR)
Rewrite-Retrieve-Read is a three-step framework for tasks that involve retrieval augmentation, such as open-domain question answering. It focuses on improving the quality of retrieved information and generating accurate outputs by refining the input query.
Research Paper: Rewrite-Retrieve-Read
Initial Setup
[ ]
[ ]
[ ]
Indexing
[ ]
[ ]
[ ]
[ ]
Retriever
[ ]
RAG Chain
[ ]
[ ]
Simple Query
[ ]
[ ]
'The Matrix was directed by the Wachowskis.'
Distracted Query
[ ]
[ ]
"I don't know."
Rewrite Retrieve Read
[ ]
[ ]
[ ]
[ ]
'Who is the creator of the Matrix film series?'
[ ]
[ ]
'The Matrix was created by the Wachowskis.'
Preparing Data for Evaluation
[ ]
[ ]
[ ]
[ ]
[ ]
Evaluation in Athina AI
We will use Answer Relevancy eval here. It Measures how pertinent the generated response is to the given prompt. Please refer to our documentation for further details
[ ]
[ ]
[ ]
evaluating with [answer_relevancy]
100%|██████████| 1/1 [00:01<00:00, 1.08s/it]
You can view your dataset at: https://app.athina.ai/develop/ddec3010-12e6-4f5e-bbc0-188934bc90dc