Dl/DataLocation

Data Lake Knowledge Center | Models

Introduction

Definition

A DataLocation object captures the location of the data and the format of the data.

Fields

id:  UUID
    Primary key
url: str
    Specifies the location of the data. 
    For example: "s3://mubucket/stock_quotes/2023-08-20.jsonl" is a valid url, it represent a data object located in AWS S3, bucket name is mubucket, object key is stock_quotes/2023-08-20.jsonl
format: str
    A string represent the format of the data, for example, "JSONL", "CSV", "PARQUET", etc. 

Examples:

{
    id: "617b2e86-9698-4b99-8956-57ce99d8de39",
    url: "s3://mubucket/stock_quotes/2023-08-20.jsonl"
    format: "JSONL"
}