Data Connectors

Data connectors enable the ingestion of external unstructured data into a knowledge base.

Introduction

What is a data connector? EGP data connectors allow you to associate an external data source (such as a Confluence space or Google Drive folder) with your EGP knowledge base. We have separate API endpoints for creating data connectors to different types of data sources as listed below.

We currently support data connectors for ingesting files from Confluence, Google Drive, and S3. You can also directly upload local files to your knowledge base.

What should I do before creating a data connector?

• Make sure that you have already created a knowledge base. Every data connector is associated with a single knowledge base, and the files you sync through the data connector will be stored in that knowledge base.
• You should also create an account integration for the data type you want to ingest, via the Create Integration endpoint. For example, before creating a Confluence data connector, it is highly recommended that you integrate your Confluence account.

What is an account integration and how is it different from creating a data connector? Integrating an account allows you to store your account credentials on your EGP user, so that you don't have to provide credentials every time you want to create a new data connector. Making an account integration for the data type you want to ingest is a highly recommended first step before creating a data connector.

Get Started with the Data Connector API

Get started with the Data Connector API by following on Ingest Custom Data guide. The guide walks you through the end-to-end workflow on how to create an EGP knowledge base, create a data connector to ingest data into the knowledge base, and sync your files with your knowledge base.

After populating your knowledge base with your custom data using data connectors, you can perform a variety of actions on your knowledge base, such as retrieval, agents, and chat completions.

Have a data type you want to ingest via our APIs but currently isn't supported? Please fill out this form to submit a feature request.