Dl/DataLocation

Data Lake Knowledge Center | Models

Introduction

Definition

A DataLocation object captures the location of the data and the format of the data.

Fields

id:  UUID
    Primary key
url: str
    Specifies the location of the data. 
    For example: "s3://mubucket/stock_quotes/2023-08-20.jsonl" is a valid url, it represent a data object located in AWS S3, bucket name is mubucket, object key is stock_quotes/2023-08-20.jsonl
format: str
    A string represent the format of the data, for example, "JSONL", "CSV", "PARQUET", etc.