LSM Tree Aggregation Module

LSM Tree Aggregation represents database tables that contain pre-aggregated data with possibility to implement user-defined aggregate functions.

You can add the Aggregation module to your project by inserting a dependency in pom.xml:

<dependency>
    <groupId>io.datakernel</groupId>
    <artifactId>datakernel-aggregation</artifactId>
    <version>3.1.0</version>
</dependency>

Features

Log-Structured Merge Trees as a core storage principle (unlike OLTP databases, it is designed from ground up for OLAP workload, so databases built on top of this table can easily handle high insert volumes of data: for example, transactional logs)
Up to ~1.5M of inserts per second into aggregation on a single core
Aggregations storage medium can use any distributed file system

This module on GitHub repository

Prev

Next