MongoDB with Bedrock agent quick tutorial

MongoDB Atlas and Amazon Bedrock have joined forces to streamline the development of generative AI applications through their seamless integration. MongoDB Atlas, a robust cloud-based database service, now offers native support for Amazon Bedrock, AWS's managed service for generative AI. This integration leverages Atlas's vector search capabilities, enabling the effective utilization of enterprise data to augment the foundational models provided by Bedrock, such as Anthropic's Claude and Amazon's Titan. The combination ensures that the generative AI models have access to the most relevant and up-to-date data, significantly improving the accuracy and reliability of AI-driven applications​ with MongoDB​.

This integration simplifies the workflow for developers aiming to implement retrieval-augmented generation (RAG). RAG helps mitigate the issue of hallucinations in AI models by allowing them to fetch and utilize specific data from a predefined knowledge base, in this case, MongoDB Atlas Developers can easily set up this workflow by creating a vector search index in Atlas, which stores the vector embeddings and metadata of the text data. This setup not only enhances the performance and reliability of AI applications but also ensures data privacy and security through features like AWS PrivateLink​​.

This notebook demonstrates how to interact with a predefined agent using AWS Bedrock in a Google Colab environment. It utilizes the boto3 library to communicate with the AWS Bedrock service and allows you to input prompts and receive responses directly within the notebook.

Key Features:

1. Secure Handling of AWS Credentials: The getpass module is used to securely enter your AWS Access Key and Secret Key.
2. Session Management: Each session is assigned a random session ID to maintain continuity in conversations.
3. Agent Invocation: The notebook sends user prompts to a predefined agent and streams the responses back to the user.

Requirements:

• AWS Access Key and Secret Key with appropriate permissions.
• Boto3 and Requests libraries for interacting with AWS services and fetching data from URLs.

Setting up MongoDB Atlas

1. Follow the getting started with Atlas guide and setup your cluster with 0.0.0.0/0 allowed connection for this notebook.
2. Predefined an Atlas Vector Index on database bedrock collection agenda, this collection will host the data for the AWS summit agenda and will serve as a context store for the agent: Index name: vector_index

	{
  "fields": [
    {
      "type": "vector",
      "path": "embedding",
      "numDimensions": 1024,
      "similarity": "cosine"
    },
    {
      "type" : "filter",
      "path" : "metadata"
    },
    {
      "type" : "filter",
      "path" : "text"
    },
  ]
}

Setup AWS Bedrock

We will use US-EAST-1 AWS region for this notebook

Follow our official tutorial to enable a bedrock knowledge base against the created database and collection in MongoDB Atlas. This guide highlight a detailed step of action to build the knowledge base and agent.

For this notebook, we will perform the following tasks according to the guide:

1. Go to the bedrock console and enable

• Amazon Titan Text Embedding model (amazon.titan-embed-text-v2:0)
• Claude 3 Sonnet Model (The LLM(

2. Upload the following source data about the AWS summit agenda to your S3 bucket:

• https://s3.amazonaws.com/bedrocklogs.pavel/ocr_db.aws_events.json
• https://s3.amazonaws.com/bedrocklogs.pavel/ocr_db.aws_sessions.json

This will be our source data listing the events happening in the summit.

3. Go to Secrets Manager on the AWS console and create credentials to our atlas cluster via "Other type of secret":

• key : username , value : <ATLAS_USERNAME>
• key : password , value : <ATLAS_PASSWORD>

4. Follow the setup of the knowledge base wizard to connect Bedrock models with Atlas :

• Click "Create Knowledge Base" and input:

• let's choose MongoDB Atlas in the "Vector Database" choose the "Choose a vector store you have created" section:

5. Click Next, review the details and "Create Knowledge Base".

6. Once the knowledge base is marked with "Status : Ready", go to Data source section, choose the one datasource we have and click the "Sync" button on its right upper corner. This operation should load the data to Atlas if everything was setup correctly.

Setting up an agenda agent

We can now set up our agent, who will work with a set of instructions and our knowledge base.

1. Go to the "Agents" tab in the bedrock UI.
2. Click "Create Agent" and give it a meaningful name (e.g. agenda_assistant)
3. Input the following data in the agent builder:

And now, we have a functioning agent that can be tested via the console. Let's move to the notebook.

Take note of the Agent ID and create an Agent Alias ID for the notebook

Interacting with the agent

To interact with the agent, we need to install the AWS python SDK:

Let's place the credentials for our AWS account.

Now, we need to initialise the boto3 client and get the agent ID and alias ID input.

Let's build the helper function to interact with the agent.

We can now interact with the agent using the application code.

Here you go! You have a powerful bedrock agent with MongoDB Atlas.

Conclusions The integration of MongoDB Atlas with Amazon Bedrock represents a significant advancement in the development and deployment of generative AI applications. By leveraging Atlas's vector search capabilities and the powerful foundational models available through Bedrock, developers can create applications that are both highly accurate and deeply informed by enterprise data. This seamless integration facilitates the retrieval-augmented generation (RAG) workflow, enabling AI models to access and utilize the most relevant data, thereby reducing the likelihood of hallucinations and improving overall performance.

The benefits of this integration extend beyond just technical enhancements. It also simplifies the generative AI stack, allowing companies to rapidly deploy scalable AI solutions with enhanced privacy and security features, such as those provided by AWS PrivateLink. This makes it an ideal solution for enterprises with stringent data security requirements. Overall, the combination of MongoDB Atlas and Amazon Bedrock provides a robust, efficient, and secure platform for building next-generation AI applications​ .