Dl/Dataset

Data Lake Knowledge Center | Models

Introduction

Definition

A Dataset object represent a series of Data Unit objects for the same purpose.

For example, a dataset could represent daily nasdaq stock quotes, every day, it has a data unit that captures the open price, close price, high and low price for all stock traded on nasdaq stock exchange market.

Fields

id:  UUID
    Primary key

name: str
    A unique name that people can reference this data series, since id is very difficult to remember for human beings.

description: str
    A human readable string that helps people to understand this dataset.

owner: str
    The owner of this dataset. In case people have questions about this dataset, the owner should be contacted.

is_disconnected:
    If True, then this dataset is disconnected and user can no longer append data unit to it.

Examples:

Considerations

Data Units

• Each DataUnit object has a dataset_id field, which tells the owner of the dataset.
• For any Dataset object we can tell list of DataUnit it owns.