Documents

Description — Couchbase Lite concepts — Data model — Documents
Related Content — Databases | Blobs | Indexing |

Overview

Document Structure

In Couchbase Lite the term 'document' refers to an entry in the database. You can compare it to a record, or a row in a table.

Each document has an ID or unique identifier. This ID is similar to a primary key in other databases.

You can specify the ID programmatically. If you omit it, it will be automatically generated as a UUID.

the ID must be unique within the database. You cannot change it after you have written the document.

The document also has a value which contains the actual application data. This value is stored as a dictionary collection of key-value (k-v) pairs. The values can be made of up several different Data Types such as numbers, strings, arrays, and nested objects.

Data Encoding

The document body is stored in an internal, efficient, binary form called Fleece. This internal form can be easily converted into a manageable native dictionary format for manipulation in applications.

Fleece data is stored in the smallest format that will hold the value whilst maintaining the integrity of the value.

Fleece data encoding

When working with Android-Java, the Fleece encoding cycle can result in the Java type information being lost. Therefore care should be taken with non-explicit functions such as toArray() or toMap(), when storing and recovering data in a document, or converting that document to JSON and back.

Always use explicit creation of the expected type, whenever the type of result is not itself explicit. For example:

Map<String, Object> doc = db.getDocument(someDoc.getId()).toMap();
Long testVal = Long.valueOf(doc.get(“test”))

Similarly, interpreting data not stored as boolean as a boolean value can give inconsistent results.

Data Types

The Document class offers a set of property accessors for various scalar types, such as:

Boolean
Date
Double
Float
Int
Long
String

These accessors take care of converting to/from JSON encoding, and make sure you get the type you expect.

In addition to these basic data types Couchbase Lite provides for the following:

Dictionary: represents a read-only key-value pair collection
MutableDictionary: represents a writeable key-value pair collection
Array: represents a readonly ordered collection of objects
MutableArray: represents a writeable collection of objects
Blob: represents an arbitrary piece of binary data

JSON

Couchbase Lite also provides for the direct handling of JSON data implemented in most cases by the provision of a toJSON() method on appropriate API classes (for example, on MutableDocument, Dictionary, Blob and Array) — see Working with JSON Data.

Constructing a Document

An individual document often represents a single instance of an object in application code.

You can consider a document as the equivalent of a 'row' in a relational table, with each of the document’s attributes being equivalent to a 'column'.

Documents can contain nested structures. This allows developers to express many-to-many relationships without requiring a reference or join table, and is naturally expressive of hierarchical data.

Most apps will work with one or more documents, persisting them to a local database and optionally syncing them, either centrally or to the cloud.

In this section we provide an example of how you might create a hotel document, which provides basic contact details and price data.

Data Model

hotel: {
  type: string (value = `hotel`)
  name: string
  address: dictionary {
    street: string
    city: string
    state: string
    country: string
    code: string
  }
  phones: array
  rate: float
}

Open a Database

First open your database. If the database does not already exist, Couchbase Lite will create it for you.

Kotlin
Java

// Initialize the Couchbase Lite system
CouchbaseLite.init(context)

// Get the database (and create it if it doesn’t exist).
DatabaseConfiguration config = new DatabaseConfiguration()

config.setDirectory(context.getFilesDir().getAbsolutePath())

Database database = new Database("getting-started", config)

// Initialize the Couchbase Lite system
CouchbaseLite.init(context);

// Get the database (and create it if it doesn’t exist).
DatabaseConfiguration config = new DatabaseConfiguration();

config.setDirectory(context.getFilesDir().getAbsolutePath());

Database database = new Database("getting-started", config);

See Databases for more information

Create a Document

Now create a new document to hold your application’s data.

Use the mutable form, so that you can add data to the document.

Kotlin
Java

// Create your new document
// The lack of 'const' indicates this document is mutable
MutableDocument mutableDoc = new MutableDocument()

// Create your new document
// The lack of 'const' indicates this document is mutable
MutableDocument mutableDoc = new MutableDocument();

For more on using Documents, see Document Initializers and Mutability.

Create a Dictionary

Now create a mutable dictionary (address).

Each element of the dictionary value will be directly accessible via its own key.

Kotlin
Java

// Create and populate mutable dictionary
// Create a new mutable dictionary and populate some keys/values
MutableDictionary address = new MutableDictionary()
address.setString("street", "1 Main st.")
address.setString("city", "San Francisco")
address.setString("state", "CA")
address.setString("country", "USA")
address.setString("code"), "90210")

// Create and populate mutable dictionary
// Create a new mutable dictionary and populate some keys/values
MutableDictionary address = new MutableDictionary();
address.setString("street", "1 Main st.");
address.setString("city", "San Francisco");
address.setString("state", "CA");
address.setString("country", "USA");
address.setString("code"), "90210");

Learn more about Using Dictionaries.

Create an Array

Since the hotel may have multiple contact numbers, provide a field (phones) as a mutable array.

Kotlin
Java

// Create and populate mutable array
MutableArray phones = new MutableArray()
phones.addString("650-000-0000")
phones.addString("650-000-0001")

// Create and populate mutable array
MutableArray phones = new MutableArray();
phones.addString("650-000-0000");
phones.addString("650-000-0001");

Learn more about Using Arrays

Populate a Document

Now add your data to the mutable document created earlier. Each data item is stored as a key-value pair.

Kotlin
Java

// Initialize and populate the document

// Add document type and hotel name as string
mutable_doc.setString("type", "hotel"))
mutable_doc.setString("name", "Hotel Java Mo"))

// Add average room rate (float)
mutable_doc.setFloat("room_rate", 121.75f)

// Add address (dictionary)
mutable_doc.setDictionary("address", address)

// Add phone numbers(array)
mutable_doc.setArray("phones", phones)

// Initialize and populate the document

// Add document type and hotel name as string
mutable_doc.setString("type", "hotel"));
mutable_doc.setString("name", "Hotel Java Mo"));

// Add average room rate (float)
mutable_doc.setFloat("room_rate", 121.75f);

// Add address (dictionary)
mutable_doc.setDictionary("address", address);

// Add phone numbers(array)
mutable_doc.setArray("phones", phones);

Couchbase recommend using a type attribute to define each logical document type.

Save a Document

Now persist the populated document to your Couchbase Lite database. This will auto-generate the document id.

Kotlin
Java

database.save(mutable_doc)

database.save(mutable_doc);

Close the Database

With your document saved, you can now close our Couchbase Lite database.

Kotlin
Java

database.close()

database.close();

Working with Data

Checking a Document’s Properties

To check whether a given property exists in the document, use the `Document.Contains(String key) method.

If you try to access a property which doesn’t exist in the document, the call will return the default value for that getter method (0 for Document.getInt() 0.0 for Document.getFloat() etc.).

Fleece data encoding

Care should be taken when storing and recovering data in a document or converting that document to JSON and back.
Data encoding (Fleece) can result in Long values being converted to Float instead of Double.
Interpreting data as boolean can also give inconsistent results.

Date accessors

Couchbase Lite offers Date accessors as a convenience. Dates are a common data type, but JSON doesn’t natively support them, so the convention is to store them as strings in ISO-8601 format.

Example 1. Date Getter

This example sets the date on the createdAt property and reads it back using the Document.getDate() accessor method.

Kotlin
Java

doc.setValue("createdAt", Date())
val date = doc.getDate("createdAt")

newTask.setValue("createdAt", new Date());
Date date = newTask.getDate("createdAt");

Using Dictionaries

API References

Example 2. Read Only

Kotlin
Java

  val document = database!!.getDocument("doc1")

  // Getting a dictionary from the document's properties
  val dict = document?.getDictionary("address")

  // Access a value with a key from the dictionary
  val street = dict?.getString("street")

  // Iterate dictionary
  for (key in dict!!.keys) {
      println("Key ${key} = ${dict.getValue(key)}")
  }

// Create a mutable copy
val mutable_Dict = dict.toMutable()

Document document = database.getDocument("doc1");

// Getting a dictionary from the document's properties
Dictionary dict = document.getDictionary("address");

// Access a value with a key from the dictionary
String street = dict.getString("street");

// Iterate dictionary
for (String key : dict) {
    dict.getValue(key);
    Log.i("x", "Key %s, = %s", key, dict.getValue(key));
}

// Create a mutable copy
MutableDictionary mutable_Dict = dict.toMutable();

Example 3. Mutable

Kotlin
Java

// Create a new mutable dictionary and populate some keys/values
val mutable_dict = MutableDictionary()
mutable_dict.setString("street", "1 Main st.")
mutable_dict.setString("city", "San Francisco")

// Add the dictionary to a document's properties and save the document
val mutable_doc = MutableDocument("doc1")
mutable_doc.setDictionary("address", mutable_dict)
database!!.save(mutable_doc)

// Create a new mutable dictionary and populate some keys/values
MutableDictionary mutable_dict = new MutableDictionary();
mutable_dict.setString("street", "1 Main st.");
mutable_dict.setString("city", "San Francisco");

// Add the dictionary to a document's properties and save the document
MutableDocument mutable_doc = new MutableDocument("doc1");
mutable_doc.setDictionary("address", mutable_dict);
database.save(mutable_doc);

Using Arrays

API References

Example 4. Read Only

Kotlin
Java

val document = database?.getDocument("doc1")

// Getting a phones array from the document's properties
val array = document?.getArray("phones")

// Get element count
val count = array?.count()

// Access an array element by index
val phone = array?.getString(1)

// Iterate array
for ( (index, item) in array!!) {
    println("Row  ${index} = ${item}")
}

// Create a mutable copy
val mutable_array = array.toMutable()

Document document = database.getDocument("doc1");

// Getting a phones array from the document's properties
Array array = document.getArray("phones");

// Get element count
int count = array.count();

// Access an array element by index
if (count >= 0) { String phone = array.getString(1); }

// Iterate dictionary
for (int i = 0; i < count; i++)
{
    Log.i("tag", "Item %d = %s", i, array.getString(i));
}

// Create a mutable copy
MutableArray mutable_array = array.toMutable();

Example 5. Mutable

Kotlin
Java

// Create a new mutable array and populate data into the array
val mutable_array = MutableArray()
mutable_array.addString("650-000-0000")
mutable_array.addString("650-000-0001")

// Set the array to document's properties and save the document
val mutable_doc = MutableDocument("doc1")
mutable_doc.setArray("phones", mutable_array)
database?.save(mutable_doc)

// Create a new mutable array and populate data into the array
MutableArray mutable_array = new MutableArray();
mutable_array.addString("650-000-0000");
mutable_array.addString("650-000-0001");

// Set the array to document's properties and save the document
MutableDocument mutable_doc = new MutableDocument("doc1");
mutable_doc.setArray("phones", mutable_array);
database.save(mutable_doc);

Using Blobs

For more on working with blobs, see Blobs

Document Initializers

You can use the following methods/initializers:

Use the MutableDocument() initializer to create a new document where the document ID is randomly generated by the database.
Use the MutableDocument(String id) initializer to create a new document with a specific ID.
Use the Database.getDocument() method to get a document. If the document doesn’t exist in the database, the method will return null. You can use this behavior to check if a document with a given ID already exists in the database.

Example 6. Persist a document

The following code example creates a document and persists it to the database.

Kotlin
Java

val doc = MutableDocument()
doc.let {
    it.setString("type", "task")
    it.setString("owner", "todo")
    it.setDate("createdAt", Date())
}
database.save(doc)

MutableDocument newTask = new MutableDocument();
newTask.setString("type", "task");
newTask.setString("owner", "todo");
newTask.setDate("createdAt", new Date());
try {
    database.save(newTask);
} catch (CouchbaseLiteException e) {
    Log.e(TAG, e.toString());
}

Mutability

By default, a document is immutable when it is read from the database. Use the `Document.toMutable() to create an updatable instance of the document.

Example 7. Make a mutable document

Changes to the document are persisted to the database when the save method is called.

Kotlin
Java

database.getDocument("xyz")?.toMutable()?.let {
    it.setString("name", "apples")
    database.save(it)
}

Document document = database.getDocument("xyz");
MutableDocument mutableDocument = document.toMutable();
mutableDocument.setString("name", "apples");
try {
    database.save(mutableDocument);
} catch (CouchbaseLiteException e) {
    Log.e(TAG, e.toString());
}

Any user change to the value of reserved keys (_id, _rev or _deleted) will be detected when a document is saved and will result in an exception (Error Code 5 — CorruptRevisionData) — see also Document Constraints.

Batch operations

If you’re making multiple changes to a database at once, it’s faster to group them together. The following example persists a few documents in batch.

Example 8. Batch operations

Kotlin
Java

database.inBatch(UnitOfWork {
    for (i in 0..9) {
        val doc = MutableDocument()
        doc.let {
            it.setValue("type", "user")
            it.setValue("name", "user $i")
            it.setBoolean("admin", false)
        }
        database.save(doc)
        Log.i(TAG, "saved user document: ${doc.getString("name")}")
    }
})

try {
    database.inBatch(() -> {
        for (int i = 0; i < 10; i++) {
            MutableDocument doc = new MutableDocument();
            doc.setValue("type", "user");
            doc.setValue("name", "user " + i);
            doc.setBoolean("admin", false);
            try {
                database.save(doc);
            } catch (CouchbaseLiteException e) {
                Log.e(TAG, e.toString());
            }
            Log.i(TAG, String.format("saved user document %s", doc.getString("name")));
        }
    });
} catch (CouchbaseLiteException e) {
    Log.e(TAG, e.toString());
}

At the local level this operation is still transactional: no other Database instances, including ones managed by the replicator can make changes during the execution of the block, and other instances will not see partial changes. But Couchbase Mobile is a distributed system, and due to the way replication works, there’s no guarantee that Sync Gateway or other devices will receive your changes all at once.

Document change events

You can register for document changes. The following example registers for changes to the document with ID user.john and prints the verified_account property when a change is detected.

Example 9. Document change events

Kotlin
Java

database.addDocumentChangeListener("user.john") { change ->
    database.getDocument(change.documentID)?.let {
        Toast.makeText(
            context,
            "Status: ${it.getString("verified_account")}",
            Toast.LENGTH_SHORT
        ).show()
    }
}

database.addDocumentChangeListener(
    "user.john",
    change -> {
        Document doc = database.getDocument(change.getDocumentID());
        if (doc != null) {
            Toast.makeText(context, "Status: " + doc.getString("verified_account"), Toast.LENGTH_SHORT).show();
        }
    });

Using Kotlin Flows and LiveData

Kotlin users can also take advantage of Flows and LiveData to monitor for changes.

The following methods show how to watch for document changes in a given database or for changes to a specific document.

Database Changes
Document Changes

    val dbChanges: LiveData<MutableList<String>> = argDb.databaseChangeFlow()
        .map { it.documentIDs }
        .asLiveData()

    val docChanges: LiveData<DocumentChange?> = argDb.documentChangeFlow("1001")
        .map {
            it.takeUnless {
                it.database.getDocument(it.documentID)?.getString("owner").equals(argDocOwner)
            }
        }
        .asLiveData()

Document Expiration

Document expiration allows users to set the expiration date for a document. When the document expires, it is purged from the database. The purge is not replicated to Sync Gateway.

Example 10. Set document expiration

This example sets the TTL for a document to 5 minutes from the current time.

Kotlin
Java

// Purge the document one day from now
database.setDocumentExpiration(
    "doc123",
    Date(Instant.now().plus(1, ChronoUnit.DAYS).toEpochMilli())
)

// Reset expiration
database.setDocumentExpiration("doc1", null)

// Query documents that will be expired in less than five minutes
val query = QueryBuilder
    .select(SelectResult.expression(Meta.id))
    .from(DataSource.database(database))
    .where(
        Meta.expiration.lessThan(
            Expression.longValue(Instant.now().plus(5, ChronoUnit.MINUTES).toEpochMilli())
        )
    )

// Purge the document one day from now
Instant ttl = Instant.now().plus(1, ChronoUnit.DAYS);
database.setDocumentExpiration("doc123", new Date(ttl.toEpochMilli()));

// Reset expiration
database.setDocumentExpiration("doc1", null);

// Query documents that will be expired in less than five minutes
Instant fiveMinutesFromNow = Instant.now().plus(5, ChronoUnit.MINUTES);
Query query = QueryBuilder
    .select(SelectResult.expression(Meta.id))
    .from(DataSource.database(database))
    .where(Meta.expiration.lessThan(Expression.doubleValue(fiveMinutesFromNow.toEpochMilli())));

Document Constraints

Couchbase Lite APIs do not explicitly disallow the use of attributes with the underscore prefix at the top level of document. This is to facilitate the creation of documents for use either in local only mode where documents are not synced, or when used exclusively in peer-to-peer sync.

"_id", :"_rev" and "_sequence" are reserved keywords and must not be used as top-level attributes — see Example 11.

Users are cautioned that any attempt to sync such documents to Sync Gateway will result in an error. To be future proof, you are advised to avoid creating such documents. Use of these attributes for user-level data may result in undefined system behavior.

For more guidance — see: Sync Gateway - data modeling guidelines

Example 11. Reserved Keys List

_attachments
_deleted ^[1]
_id ^[1]
_removed
_rev ^[1]
_sequence

Working with JSON Data

In this section: Arrays | Blobs | Dictionaries | Documents | Query Results as JSON

The toJSON() typed-accessor means you can easily work with JSON data, native and Couchbase Lite objects.

Arrays

Convert an ArrayObject to and from JSON using the toJSON() and toArray methods — see Example 4.

Additionally you can:

Initialize a 'MutableArrayObject' using data supplied as a JSON string. This is done using the init(json) constructor — see: Example 4
Convert an ArrayFragment object to a JSON String
Set data with a JSON string using setJSON()

Example 12. Arrays as JSON strings

Kotlin
Java

// initialize array from JSON string
val mArray = MutableArray(JSON)

// Create and save new document using the array
for (i in 0 until mArray.count()) {
    mArray.getDictionary(i)?.apply {
        Log.i(TAG, getString("name") ?: "unknown")
        db.save(MutableDocument(getString("id"), toMap()))
    }
}

// Get an array from the document as a JSON string
db.getDocument("1002")?.getArray("features")?.apply {
    // Print its elements
    for (feature in toList()) {
        Log.i(TAG, "$feature")
    }
    Log.i(TAG, toJSON())
}

// initialize array from JSON string
final MutableArray mArray = new MutableArray(JSON);

// Create and save new document using the array
for (int i = 0; i < mArray.count(); i++) {
  final Dictionary dict = mArray.getDictionary(i);
  Log.i(TAG, dict.getString("name"));
  db.save(new MutableDocument(dict.getString("id"), dict.toMap()));
}

// Get an array from the document as a JSON string
final Array features = db.getDocument("1002").getArray("features");
// Print its elements
for (Object feature: features.toList()) {
    Log.i(TAG, feature.toString());
}
Log.i(TAG, features.toJSON());

Blobs

Convert a Blob to JSON using the toJSON method — see Example 13.

You can use isBlob() to check whether a given dictionary object is a blob or not — see Example 13.

Note that the blob object must first be saved to the database (generating the required metadata) before you can use the toJSON method.

Example 13. Blobs as JSON strings

Kotlin
Java

val thisBlob = db.getDocument("thisdoc-id")!!.toMap()
if (!Blob.isBlob(thisBlob)) {
  return
}
val blobType = thisBlob["content_type"].toString()
val blobLength = thisBlob["length"] as Number?

final Map<String, ?> thisBlob = db.getDocument("thisdoc-id").toMap();
if (!Blob.isBlob(thisBlob)) { return; }

final String blobType = thisBlob.get("content_type").toString();
final Number blobLength = (Number) thisBlob.get("length");

Dictionaries

Convert a DictionaryObject to and from JSON using the toJSON and toDictionary methods — see Example 14.

Additionally you can:

Initialize a 'MutableDictionaryObject' using data supplied as a JSON string. This is done using the init(json) constructor-- see: Example 14
Set data with a JSON string using setJSON()

Example 14. Dictionaries as JSON strings

Kotlin
Java

val mDict = MutableDictionary(JSON)
Log.i(TAG, "$mDict")
Log.i(TAG, "Details for: ${mDict.getString("name")}")
for (key in mDict.keys) {
  Log.i(TAG, key + " => " + mDict.getValue(key))
}

final MutableDictionary mDict = new MutableDictionary(JSON);
Log.i(TAG, mDict.toString());

Log.i(TAG, "Details for: " + mDict.getString("name"));
for (String key: mDict.getKeys()) {
  Log.i(TAG, key + " => " + mDict.getValue(key));
}

Documents

Convert a Document to and from JSON strings using the toJSON() and setJSON() methods — see Example 15.

Additionally you can:

Initialize a 'MutableDocument' using data supplied as a JSON string. This is done using the init(json) or init(id: json:) constructor — see: Example 15
Set data with a JSON string using setJSON()

Example 15. Documents as JSON strings

Kotlin
Java

QueryBuilder
.select(SelectResult.expression(Meta.id).as("metaId"))
.from(DataSource.database(srcDb))
.execute()
.forEach {
  it.getString("metaId")?.let { thisId ->
    // Get a document as a JSON string
    srcDb.getDocument(thisId)?.toJSON()?.let { json ->
      Log.i(TAG, "JSON String = $json")
      
      // Initialize a MutableDocument using the JSON string and save to a separate database
      val hotelFromJSON = MutableDocument(thisId, json)
      dstDb.save(hotelFromJSON)
      
      // Retrieve the document created from JSON and print values
      dstDb.getDocument(thisId)?.toMap()?.forEach { e ->
        Log.i(TAG, "$e.key => $e.value")
      }
    }
  }
}

final Query listQuery = QueryBuilder
.select(SelectResult.expression(Meta.id).as("metaId"))
.from(DataSource.database(srcDb));

for (Result row: listQuery.execute()) {
  final String thisId = row.getString("metaId");

// Get a document as a JSON string
  final String json = srcDb.getDocument(thisId).toJSON();
  Log.i(TAG, "JSON String = " + json);

  // Initialize a MutableDocument using the JSON string and save to a separate database
  final MutableDocument hotelFromJSON = new MutableDocument(thisId, json);
  dstDb.save(hotelFromJSON);

  // Retrieve the document created from JSON and print values
  for (Map.Entry entry: dstDb.getDocument(thisId).toMap().entrySet()) {
    Log.i(TAG, entry.getKey() + " => " + entry.getValue());
  }
}

Query Results as JSON

Convert a Query Result to JSON using its toJSON() accessor method.

Example 16. Using JSON Results

Use Result.toJSON() to transform your result string into a JSON string, which can easily be serialized or used as required in your application. See <> for a working example.

Kotlin
Java

// Uses Jackson JSON processor
val mapper = ObjectMapper()
val hotels: ArrayList<Hotel> = ArrayList()

for (result in listQuery.execute()) {

    // Get result as JSON string
    val json = result.toJSON()

    // Get Hashmap from JSON string
    val dictFromJSONstring = mapper.readValue(json, HashMap::class.java)

    // Use created hashmap
    val hotelId = dictFromJSONstring["id"].toString() //
    val hotelType = dictFromJSONstring["type"].toString()
    val hotelname = dictFromJSONstring["name"].toString()


    // Get custom object from JSON string
    val thisHotel = mapper.readValue(json, Hotel::class.java)
    hotels.add(thisHotel)
}

// Uses Jackson JSON processor

ArrayList<Hotel> hotels = new ArrayList<Hotel>();
HashMap<String, Object> dictFromJSONstring;
for (Result result : listQuery.execute()) {

  // Get result as JSON string
  String thisJsonString = result.toJSON();

  // Get Java  Hashmap from JSON string
  HashMap<String, Object> dictFromJSONstring =
          mapper.readValue(thisJsonString, HashMap.class);


  // Use created hashmap
  String hotelId = dictFromJSONstring.get("id").toString();
  String hotelType = dictFromJSONstring.get("type").toString();
  String hotelname = dictFromJSONstring.get("name").toString();


  // Get custom object from JSON string
  Hotel thisHotel =
          mapper.readValue(thisJsonString, Hotel.class);
  hotels.add(thisHotel);

JSON String Format

If your query selects ALL then the JSON format will be:

{
  database-name: {
    key1: "value1",
    keyx: "valuex"
  }
}

If your query selects a sub-set of available properties then the JSON format will be:

{
  key1: "value1",
  keyx: "valuex"
}

How to . . .

Learn more . . .

Dive Deeper . . .

Mobile Forum | Blog | Tutorials

1. Any change to this reserved key will be detected when it is saved and will result in a Couchbase exception (Error Code 5 — `CorruptRevisionData`)