RAG Via Function Calling
mistral-cookbookmistralrag
Export
RAG with multiple Databases via Function Calling
In this cookbook we are coding a RAG agent that uses the function calling mechanism to determine on which data base to execute a RAG query. We are not coding the RAG logic itself here but only the routing part of it. Using such architecture presents various advantages :
- It allows to gracefully scales to multiple RAG database
- it elegantly handles the switch between RAG phases and classic LLM instruct chat by activating the "auto" mode of the function calling
- It is very easy to evaluation and finetune such a router
Imports and Mistral client
[ ]
[10]
[5]
Type your API Key ········
Mock Questions
A Lemonade company wants to create its own internal RAG. In this example we will mock a RAG search on three different types of databases :
- HR -> Database containing information about any human ressource topic e.g., holidays, pearks, salary, office
- Product -> Database containing information about the specificities of the Lemonade product e.g., available tastes, price, packaging color
- Finance -> Database containing financial information e.g. revenue, costs of production, liabilities
[47]
Build router Agent
[52]
What are the different tastes of limonade ? Suggest search in Product DB
'Product'
Test router agent
[53]
################## What is the company's leave policy? Suggest search in HR DB CORRECT ################## What are the office hours? Suggest search in HR DB CORRECT ################## Do we have a dress code? Suggest search in HR DB CORRECT ################## What are the available benefits and perks? Suggest search in HR DB CORRECT ################## How do I request time off? Suggest search in HR DB CORRECT ################## What is the process for performance reviews? Suggest search in HR DB CORRECT ################## What are the salary brackets for different positions? Suggest search in HR DB CORRECT ################## What is the procedure for onboarding new employees? Suggest search in HR DB CORRECT ################## Are there any employee wellness programs? Suggest search in HR DB CORRECT ################## How do I report a workplace issue? Suggest search in HR DB CORRECT ################## What are the available Lemonade flavors? Suggest search in Product DB CORRECT ################## What is the price range for our products? Suggest search in Product DB CORRECT ################## What packaging options do we offer? Suggest search in Product DB CORRECT ################## What is the shelf life of our Lemonade? Suggest search in Product DB CORRECT ################## Do we offer custom packaging for large orders? Suggest search in Product DB CORRECT ################## How frequently do we introduce new flavors? Suggest search in Product DB CORRECT ################## What are the nutritional facts for our Lemonade? Suggest search in Product DB CORRECT ################## Do we have any sugar-free options? Suggest search in Product DB CORRECT ################## What are the main ingredients in our Lemonade? Suggest search in Product DB CORRECT ################## How do we ensure product quality? Suggest search in Product DB CORRECT ################## What was the revenue for the last fiscal year? Suggest search in Finance DB CORRECT ################## What are the major cost components? Suggest search in Finance DB CORRECT ################## How do we manage expenses and budgets? Suggest search in Finance DB CORRECT ################## What is the current financial health of the company? Suggest search in Finance DB CORRECT ################## What are our liabilities? Suggest search in Finance DB CORRECT ################## How are financial decisions made? Suggest search in Finance DB CORRECT ################## What is the return on investment for the company? Suggest search in Finance DB CORRECT ################## What financial reporting tools do we use? Suggest search in Finance DB CORRECT ################## What is the capital structure of the company? Suggest search in Finance DB CORRECT ################## What type of food is served in the cafeteria today? Suggest search in Other DB CORRECT ################## What is the best time to visit Hawaii? Suggest search in Other DB CORRECT