Expand description
Database handling Core Fedimint database traits and types
This module provides the core key-value database for Fedimint.
§Usage
To use the database, you typically follow these steps:
- Create a
Database
instance - Begin a transaction
- Perform operations within the transaction
- Commit the transaction
§Example
use fedimint_core::db::mem_impl::MemDatabase;
use fedimint_core::db::{Database, DatabaseTransaction, IDatabaseTransactionOpsCoreTyped};
use fedimint_core::encoding::{Decodable, Encodable};
use fedimint_core::impl_db_record;
use fedimint_core::module::registry::ModuleDecoderRegistry;
#[derive(Debug, PartialEq, Eq, PartialOrd, Ord, Encodable, Decodable)]
pub struct TestKey(pub u64);
#[derive(Debug, Encodable, Decodable, Eq, PartialEq, PartialOrd, Ord)]
pub struct TestVal(pub u64);
#[repr(u8)]
#[derive(Clone)]
pub enum TestDbKeyPrefix {
Test = 0x42,
}
impl_db_record!(
key = TestKey,
value = TestVal,
db_prefix = TestDbKeyPrefix::Test,
);
// Create a new in-memory database
let db = Database::new(MemDatabase::new(), ModuleDecoderRegistry::default());
// Begin a transaction
let mut tx = db.begin_transaction().await;
// Perform operations
tx.insert_entry(&TestKey(1), &TestVal(100)).await;
let value = tx.get_value(&TestKey(1)).await;
// Commit the transaction
tx.commit_tx().await;
// For operations that may need to be retried due to conflicts, use the
// `autocommit` function:
db.autocommit(
|dbtx, _| {
Box::pin(async move {
dbtx.insert_entry(&TestKey(1), &TestVal(100)).await;
anyhow::Ok(())
})
},
None,
)
.await
.unwrap();
§Isolation of database transactions
Fedimint requires that the database implementation implement Snapshot Isolation. Snapshot Isolation is a database isolation level that guarantees consistent reads from the time that the snapshot was created (at transaction creation time). Transactions with Snapshot Isolation level will only commit if there has been no write to the modified keys since the snapshot (i.e. write-write conflicts are prevented).
Specifically, Fedimint expects the database implementation to prevent the following anomalies:
Non-Readable Write: TX1 writes (K1, V1) at time t but cannot read (K1, V1) at time (t + i)
Dirty Read: TX1 is able to read TX2’s uncommitted writes.
Non-Repeatable Read: TX1 reads (K1, V1) at time t and retrieves (K1, V2) at time (t + i) where V1 != V2.
Phantom Record: TX1 retrieves X number of records for a prefix at time t and retrieves Y number of records for the same prefix at time (t + i).
Lost Writes: TX1 writes (K1, V1) at the same time as TX2 writes (K1, V2). V2 overwrites V1 as the value for K1 (write-write conflict).
| Type | Non-Readable Write | Dirty Read | Non-Repeatable Read | Phantom Record | Lost Writes | | –––– | —————— | ––––– | —————–– | ––––––– | ———– | | MemoryDB | Prevented | Prevented | Prevented | Prevented | Possible | | RocksDB | Prevented | Prevented | Prevented | Prevented | Prevented | | Sqlite | Prevented | Prevented | Prevented | Prevented | Prevented |
Modules§
Structs§
- Base functionality around
IRawDatabase
to make it aIDatabase
- Struct that implements
IRawDatabaseTransaction
and can be wrapped easier in other structs since it does not consumedself
by move. - A helper for tracking and logging on
Drop
any instances of uncommitted writes - Session type for
DatabaseTransaction
that is allowed to commit - A public-facing newtype over
IDatabase
- A high level database transaction handle
- Deprecated: Use
DatabaseVersionKey(ModuleInstanceId)
instead. - An iterator over the variants of DbKeyPrefix
- Code used to access
global_dbtx
- Session type for a
DatabaseTransaction
that is not allowed to commit - A database that wraps an
inner
one and adds a prefix to all operations, effectively creating an isolated partition. - A database transactions that wraps an
inner
one and adds a prefix to all operations, effectively creating an isolated partition.
Enums§
- Error returned when the autocommit function fails
- Maybe
Ref 🔒
Constants§
Traits§
DatabaseKey
that represents the lookup structure for retrieving key/value pairs from the database.- Marker trait for
DatabaseKey
s whereNOTIFY
is true - A key that can be used to query one or more
DatabaseRecord
ExtendsDatabaseKeyPrefix
to prepend the key’s prefix. - A key + value pair in the database with a unique prefix Extends
DatabaseKeyPrefix
to prepend the key’s prefix. DatabaseValue
that represents the value structure of database records.- A database that on top of a raw database operation, implements key notification system.
- Fedimint database transaction
- Additional operations (only some) database transactions expose, on top of
IDatabaseTransactionOpsCore
- Core raw a operations database transactions supports
- Like
IDatabaseTransactionOpsCore
, but typed - Raw database implementation
- An extension trait with convenience operations on
IRawDatabase
- Raw database transaction (e.g. rocksdb implementation)
- A database type that has decoders, which allows it to implement
IDatabaseTransactionOpsCoreTyped
Functions§
apply_migrations
iterates from the on disk database version for the module.- Applies the database migrations to a non-isolated database.
- Creates the
DatabaseVersion
inside the database if it does not exist. If necessary, this function will migrate the legacy database version to the expectedDatabaseVersionKey
. - Verifies that all database migrations are defined contiguously and returns the “current” database version, which is one greater than the last key in the map.
- Helper function to retrieve the
module_instance_id
for modules, otherwise return 0xff for the global namespace. - Removes
DatabaseVersion
fromDatabaseVersionKeyV0
if it exists and returns the current database version. If the current version does not exist, usetarget_db_version
if the database is new. Otherwise, returnDatabaseVersion(0)
to ensure all migrations are run.
Type Aliases§
CoreMigrationFn
that modules can implement to “migrate” the database to the next database version.- Just ignore this type, it’s only there to make compiler happy