Cloud components of DataKernel Framework


Technologies for building private fully decentralized cloud solutions and applications. Suitable for working with trusted servers only.
Components Description Examples
RPC High-performance and fault-tolerant remote procedure call module for building distributed applications with an extremely efficient asynchronous binary RPC streaming protocol. RPC examples
FS Basis for building efficient, scalable remote file storage with implementation of caching and fast asynchronous file I/O based on Java NIO. Utilizes CSP for fast and reliable file transfer. FS examples
OT This module allows to build collaborative software systems based on Git-like approach and with automatic conflict resolution, utilizing a special algorithm for operational transformations.  
OT-MySQL Enables binding OT repositories to MySQL (or any other) database. You can even store OTRepository commits in-memory or as files on a disk.  
LSMT Aggregation Log-structured merge-tree table which stores aggregate functions and designed for OLAP workload.  
LSMT OLAP Cube Multidimensional OLAP (Online Analytical Processing) database with predefined set of dimensions, measures, and log-structured merge-tree tables containing pre-aggregated data. LSMT database efficiently executes multi-dimensional analytical queries.  
Dataflow Distributed stream-based batch processing engine for Big Data applications. Represents a set of tools to work with data sets which can span multiple partitions.  
CRDT Conflict-free replicated data type implementation (specifically, state-based CRDT). Contains tools to create collaborative editing applications using CRDT approach to merge data that comes from multiple nodes into a single CRDT structure. CRDT examples
Multilog This module manages integrity of log files stored in distributed file system and allows to work with them as if they were stored in a single place.  
ETL Processes logs using operational transformations. Uses OT module to persist logs and resolve conflicts.