Ingesting data with BigQuery

This notebook demonstrates how to consume data contained in BigQuery and index it into Elasticsearch. This notebook is based on the article Ingesting data with BigQuery.

Installing dependencies and importing packages

Declaring variables

This code will create inputs where you can enter your credentials. Here you can learn how to retrieve your Elasticsearch credentials: Finding Your Cloud ID.

Instance a Elasticsearch client

Creating mappings

Getting data from BigQuery

Indexing to Elasticsearch

Searching data

Deleting

Finally, we can delete the resources used to prevent them from consuming resources.