Website load, Extraction and Ingest with ELSER Example

This workbook demonstrates how to load a website, create passages and ingest into Elasticsearch.

In this example we will:

• load the website using the unstructured package
• chunk the text with LangChain document splitter
• ingest into Elasticsearch with LangChain Elasticsearch Vectorstore.

We will also setup your Elasticsearch cluster with ELSER model, so we can use it to embed the passages.

Connecting to Elasticsearch

Deploying ELSER

Loading a webpage, creating chunks into docs

This will load the webpage from the url provided, and then chunk the html text into passage docs.

Ingesting the passages into Elasticsearch

This will ingest the passage docs into the Elasticsearch index, under the specified INDEX_NAME.