About Dandelion
Dandelion is a cutting-edge distributed transactional fault-tolerant datastore inspired by the resilience and adaptability of nature. Our project combines innovative technologies to create a robust and efficient solution for modern data management challenges, all while maintaining the lightness and flexibility of a dandelion seed.
Key Components
1
DLHT (Dandelion HashTable)
High-performance hash table design optimized for fast lookups and efficient memory usage.
DLHT is our high-performance hashtable design, optimized for fast lookups and efficient memory usage. Like the intricate structure of a dandelion's seed head, it forms the backbone of our data storage system, ensuring quick access to your data.
Hercules, our GaussDB execution framework, specializes DLHT for concurrency-aware hash joins and hash aggregations, turning the hashtable into a core primitive for "record-class" analytics. The result is fewer repartition barriers, fewer copies, lower synchronization cost, and better scaling on many-core NUMA machines.
2
DLTree (Dandelion B+ Tree)
Efficient range queries and ordered data storage.
DLTree is our implementation of a B+ tree, designed for efficient range queries and ordered data storage. It complements DLHT by providing fast access to sorted data and supporting complex query operations. DLTree follows the Spiderman technique, which couples software prefetching with request multiplexing to boost traversal performance.
Long Vu won a global undergraduate award for his thesis describing Spiderman and demonstrating 30% performance improvement on the fastest B+tree.
3
U2PC (Unanimous Two-Phase Commit)
Distributed transaction consistency with ACID guarantees.
U2PC is our innovative protocol for ensuring data consistency across distributed systems. It provides a unanimous approach to transaction management, guaranteeing ACID properties in a distributed environment.
4
Pandora with M. Dananjaya and V. Nagarajan
Strongly-consistent transactions over passive disaggregated memory.
Pandora is our pioneering protocol enabling strongly-consistent distributed transactions over passive disaggregated memory. Pandora leverages the decentralized nature of disaggregated memory to ensure exceptional availability and correctness without compromising performance.
5
DLStore (Dandelion Datastore)
The complete datastore system that brings the components together.
The Dandelion Datastore combines DLHT, DLTree, U2PC and other transactional protocols with a datastore-optimized network library to create a fast distributed in-memory datastore with strongly-consistent and fault-tolerant transactions.
Contact
Dandelion is a project developed in Huawei Edinburgh Research Center. The team includes Antonios Katsarakis, Vasilis Gavrielatos, Chris Jensen, Long Vu, and Nikos Ntarmos. Get in touch: antonios.katsarakis@huawei.com