Stream Data from Remote Sources
- Capella Columnar
- how-to
If you want to stream data to your Capella Columnar database, you create a remote data source.
Capella Columnar streams data from remote data sources and stores it in one or more collections. As long as it remains connected to the remote source, Capella Columnar copies any changes in the remote data to the local copy. If you disconnect it from the remote source, Couchbase Columnar still retains a copy of the data. If you later reconnect the link, it catches up on any updates it missed and continues streaming data changes.
Configuring Streaming
Configuring Capella Columnar to stream data from a remote source is a three-step process:
-
Create a Capella Columnar remote link that defines the data source and the credentials to access the data.
-
Create a linked collection to receive the streamed data.
-
Connect the link to start the flow of data.
The collections Couchbase Columnar saves the streamed data into are dedicated to streamed data. To shadow data in different source topics or collections, you set up a collection for each one. You can associate all of the collections that require the same access credentials with the same link.
Required Privileges
Your Columnar account must have either the Project Owner or Project Manager role to be able to create a link and its associated collection.
In addition, you must have credentials to connect to the remote system and access the data you want to stream.