Data Sync Peer-to-Peer
Description — Couchbase Lite database Peer-to-Peer Synchronization concepts using websockets
Related Content — API Reference | Passive Peer | Active Peer
Introduction
Couchbase Lite’s peer-to-peer synchronization solution offers secure storage and bidirectional synchronization of data between edge devices without the need for a centralized cloud-based control point.
The solution provides an out-of-the-box implementation of a websocket based listener for use in peer-to-peer applications communicating over in IP-based networks.
This implementation enables customers to:
-
Simplify application development by enabling sync with just a few lines of code
-
Optimize network bandwidth usage and reduce data transfer cost with Delta Sync support
-
Securely sync data with built-in support for TLS encryption and authentication support
-
Significantly reduce complexity of managing document conflicts from concurrent writes with built-in conflict resolution support.
-
Take advantage of built-in network resiliency
Overview
At its most basic, peer-to-peer synchronization requires one peer to act as the listener to the other peer’s replicator.
So, in order to use peer-to-peer synchronization in your application you must configure one peer to act as this listener using the provided listener API, the most important of which include URLEndpointListener and URLEndpointListenerConfiguration. Using these building blocks, developers can quickly implement peer-to-peer synchronization.
-
Configure the listener (passive peer, or server)
-
Initialize the listener, which listens for incoming websocket connections (on a user-defined, or auto-selected, port)
-
Configure a replicator (active peer, or client)
-
Use some form of discovery phase perhaps with a zero-config protocol such as Bonjour — see: https://developer.apple.com/bonjour/, or use known URL endpoints, to identify a listener
-
Point the replicator at the listener
-
Initialize the replicator
-
Replicator and listener engage in the configured security protocol exchanges to confirm connection
-
If connection is confirmed then replication will commence, synchronizing the two data stores.
As you can see this involves configuring a Passive Peer and an * Active Peer; you can find the instructions to do that on those two links and see a simple listener configuration in Basic Setup
You can also learn more about how to implement peer-to-peer synchronization by referring to our tutorial — see: Getting Started with Peer-to-Peer Synchronization.
Features
Couchbase Lite for Swift’s peer-to-peer synchronization solution provides support for cross-platform synchronization; for example, between Android and iOS devices.
Each listener instance serves one Couchbase Lite database. But there is no hard limit on the number of listener instances that you can associate with a database.
Nor does having a listener on a database prevent you opening replications to the other clients. So, for example, whilst listening for connections, a listener is able to actively initiate replications to other listeners. This can be for the same or a different database.
The listener will automatically select a port to use or will use a user-specified port. It will also listen on all available networks, unless you specify a specific network to use.
Security
peer-to-peer synchronization supports encryption and authentication over TLS with multiple modes, including:
-
No encryption, that-is, clear text.
-
CA Cert
-
Self-signed Cert
-
Anonymous Self-signed — an auto-generated anonymous TLS identity is generated if no identity is specified. This provides encryption but not authentication.
Any self-signed certificates generated by the convenience API are stored in secure storage.
The replicator (client) can handle certificates pinned by the listener for authentication purposes.
Support is also provided for basic authentication using username and password credentials. Whilst this can be used in clear text mode, developers are strongly advised to use TLS encryption.
For testing and development purposes, support is provided for the client (active, replicator) to skip verification of self-signed certificates; this mode ought not be used in production.
Error Handling
When a listener is stopped, then all connected replicators are notified by a websocket error. Your application should distinguish between transient and permanent connectivity errors.
Basic Setup
You can configure a peer-to-peer synchronization with just a few lines of code as shown here in Example 2 and Example 3.
This simple listener configuration will give you a listener ready to participate in an encrypted synchronization with a replicator providing a valid user name and password.
var config = URLEndpointListenerConfiguration(database: database) (1)
config.authenticator = ListenerPasswordAuthenticator { username, password in
return "valid.user" == username && "valid.password.string" == String(password)
} (2)
let listener = URLEndpointListener(config: config) (3)
try listener.start() (4)| 1 | Initialize the listener configuration |
| 2 | Configure the client authenticator to require basic authentication |
| 3 | Initialize the listener |
| 4 | Start the listener |
This simple replicator configuration will give you an encrypted, bi-directional peer-to-peer synchronization with automatic conflict resolution.
let tgtUrl = URL(string: "wss://10.1.1.12:8092/otherDB")!
let targetEndpoint = URLEndpoint(url: tgtUrl) // (1)
var thisConfig = ReplicatorConfiguration(database: database, target: targetEndpoint) (2)
thisConfig.acceptOnlySelfSignedServerCertificate = true (3)
let thisAuthenticator = BasicAuthenticator(username: "valid.user", password: "valid.password.string")
thisConfig.authenticator = thisAuthenticator (4)
self.replicator = Replicator(config: thisConfig) (5)
self.replicator.start(); (6)| 1 | Get the listener’s endpoint. Here we use a known URL, but it could be a URL established dynamically in a discovery phase. |
| 2 | Initialize the replicator configuration with the database to be synchronized and the listener it is to synchronize with |
| 3 | Configure the replicator to expect a self-signed certificate from the listener |
| 4 | Configure the replicator to present basic authentication credentials if the listener prompts for them (client authentication is optional) |
| 5 | Initialize the replicator |
| 6 | Start the replicator |
API Highlights
URLEndpointListener
The URLEndpointListener is the listener for peer-to-peer synchronization.
It acts like a passive replicator, in the same way that Sync Gateway does in a 'standard' replication.
On the client side, the listener’s endpoint is used to point the replicator to the listener.
Core functionalities of the listener are:
-
Users can initialize the class using a URLEndpointListenerConfiguration object.
-
The listener can be started, or can be stopped.
-
Once the listener is started, a total number of connections or active connections can be checked.
API Reference: URLEndpointListener
URLEndpointListenerConfiguration
Use this to create a configuration object you can then use to initialize the listener.
- Port
-
This is the port that the listener will listen to.
If the port is null or zero, the listener will auto-assign an available port to listen on.
Default value is null or zero depending on platform. When the listener is not started, the port is null (or zero if the platform requires).
- Network Interface
-
Use this to select a specific Network Interface to use, in the form of the IP Address or network interface name.
If the network interface is specified, only that interface wil be used.
If the network interface is not specified, all available network interfaces will be used.
The value is null if the listener is not started.
- disableTLS
-
You can use URLEndpointListenerConfiguration's disableTLS method to disable TLS communication if necessary
The
disableTLSsetting must be 'false' when Client Cert Authentication is required.Basic Authentication can be used with, or without, TLS.
disableTLS works in conjunction with
TLSIdentity, to enable developers to define the key and certificate to be used.-
If
disableTLSis true — TLS communication is disabled and TLS identity is ignored. Active peers will use thews://URL scheme used to connect to the listener. -
If
disableTLSis false or not specified — TLS communication is enabled.Active peers will use the
wss://URL scheme to connect to the listener.
API Reference: disableTLS
-
- tlsIdentity
-
Use URLEndpointListenerConfiguration's tlsIdentity method to configure the TLS Identity used in TLS communication.
If
TLSIdentityis not set, then the listener uses an auto-generated anonymous self-signed identity (unlessdisableTLS = true). Whilst the client cannot use this to authenticate the server, it will use it to encrypt communication, giving a more secure option than non-TLS communication.The auto-generated anonymous self-signed identity is saved in secure storage for future use to obviate the need to re-generate it.
When the listener is not started, the identity is null. When TLS is disabled, the identity is always null.
API Reference: tlsIdentity
- authenticator
-
Use this to specify the authenticator the listener uses to authenticate the client’s connection request. This should be set to one of the following:
-
ListenerPasswordAuthenticator
-
ListenerCertificateAuthenticator
-
Null — there is no authentication.
API Reference: authenticator
-
- readOnly
-
Use this to allow only pull replication. Default value is false.
- enableDeltaSync
-
The option to enable Delta Sync and replicate only changed data also depends on the delta sync settings at database level. The default value is false.
API Reference: URLEndpointListenerConfiguration
Security
Authentication
Peer-to-peer sync supports Basic Authentication and TLS Authentication. For anything other than test deployments, we strongly encourage the use of TLS. In fact, peer-to-peer sync using URLEndpointListener is encrypted using TLS by default.
The authentication mechanism used is defined at endpoint level, meaning that it is independent of the database being replicated. So when replicating multiple database instances you may use basic on one instance an another authentication method on other instances.
| The Minimum supported version of TLS is TLS 1.2. |
Peer-to-Peer Synchronization using URLEndpointListener supports certificate based authentication of the server and-or listener:
-
Replicator certificates can be: self signed, from trusted CA or anonymous (system generated).
-
Listeners certificates may be: self signed or trusted CA signed.
Where a TLS certificate is not explicitly specified for the listener, the Listener implementation will generate anonymous certificate to use for encryption
-
The URLEndpointListener supports the ability to opt out of TLS encryption communication.
Active clients replicating with a URLEndpointListener have the option to skip validation of server certificates when the listener is configured with self-signed certificates.
This option is ignored when dealing with CA certificates.
Using Secure Storage
The use of TLS, its associated keys and certificates requires using secure storage to minimize the chances of a security breach. The implementation of this storage differs from platform to platform. Table 1 summarizes the secure storage used to store keys and certificates for Swift.
Key |
Value |
Platform |
Android |
Key Storage |
Android System KeyStore |
Certificate Storage |
Android System KeyStore |
Notes |
|
Reference |
|
Platform |
MacOS/iOS |
Key Storage |
KeyChain |
Certificate Storage |
KeyChain |
Notes |
Use kSecAttrLabel of the SecCertificate to store the TLSIdentity’s label |
Reference |
https://developer.apple.com/documentation/security/keychain_services |
Platform |
Java |
Key Storage |
User Specified KeyStore |
Certificate Storage |
User Specified KeyStore |
Notes |
|
Reference |
https://docs.oracle.com/javase/7/docs/api/java/security/KeyStore.html |
Platform |
.Net (excluding Xamarin) |
Key Storage |
Opaque; Keys are stored automatically by the runtime when storing the certificate with the PersistKeySet flag set. |
Certificate Storage |
User specified X509Store |
Notes |
|
Reference |
Platform |
Xamarin |
Key Storage |
RSACryptoServiceProvider provided by Xamarin. |
Certificate Storage |
User specified X509Store |
Notes |
|
Reference |