Warabi (Blob storage component)

Warabi is a Mochi microservice that provides blob (Binary Large OBject) storage capabilities for distributed HPC services. It is built on Thallium and offers multiple storage backends including memory, persistent memory (pmem), and ABT-IO.

Warabi has been designed for flexibility and performance. It supports:

• Multiple backends: memory, persistent memory, ABT-IO

• Regions: Logical, fix-sized containers for storing raw data

• Transfer managers: Configurable strategies for data transfer

• Migration: Moving data between providers or storage backends

• Async operations: Non-blocking I/O for improved performance

• Bedrock integration: Easy deployment and configuration

This section will walk you through a series of tutorials on how to use Warabi. Note that Warabi was developed in C++, hence its primary API (and the API discussed in these pages) is in C++. However, Warabi also provide a C API and a Python API.

• Getting started with Warabi
• Basic operations
• Backend: memory
• Backend: pmem
• Backend: abt-io
• Transfer managers
• Target migration
• C API
• Python Bindings
• C API Documentation
• C++ API Documentation