Reliquery

Data storage solution for Research

By The Dev Effect

Reliquery is a portable storage solution that simplifies where to store, how to store, and how to share research data and results. Once data is stored in a Relic a researcher can easily share and visualize that data using either the python API (more languages coming soon) or Reliquery's convenient UI. Focus on research rather than setup.

The main building blocks of Reliquery are Relic objects. Relics are the stand in for any object of study that may occur in research, not just ML models. A dataset, quality check artifact, a trial from a study, or even lab equipment can be represented as a Relic.

Relics are designed to be easy to use. An example of storing Numpy array shows how we have simplified the process of saving and serializing data.

from reliquery import Relic
import numpy as np

relic = Relic(name="Name", relic_type="Type")

# add an array
relic.add_array(name="zeros", array=np.zeros((2,10)))

# list arrays in a Relic returning a list of array names
relic.list_arrays()

# get an array 
arr = relic.get_array(name="zeros")

Adding tags to a Relic is a powerful tool that allows a user to organize their relics in any form they choose. These tags can then be queried to collect Relics by a given criteria:

from reliquery import Relic, Reliquery
import numpy as np

relic = Relic(name="Name", relic_type="Type")

# add an array
relic.add_array(name="ones", array=np.ones((10,10)))

# add a tag to a Relic
relic.add_tag({"trial-id": "trial-a"})

# create a Reliquery object used to query Relics
reliquery = Reliquery()

# query Relics by tag
relics = reliquery.get_relics_by_tag("trial-id", "trial-a")

The Dev Effect has also developed Reliquery-UI, a web UI that allows researchers to explore the current state of their research. Sharing scientific results and data is as simple as sharing a link.

Mock-up web view of a Relic in a hosted UI.

While you can use Reliquery right now without any hosting, we are excited to be launching a hosted version of Reliquery and are opening pre-release access to anyone interested. If you’re interested please sign up below!

We are busy adding a whole slew of new features: including support for storages like Dropbox and Google Drive, models, videos, hosting notebooks.

Please check out https://github.com/The-Dev-Effect/reliquery and https://github.com/The-Dev-Effect/reliquery-ui.

Give Reliquery a try and let us know what you think.