Dl/DataLocation: Difference between revisions
From stonehomewiki
Jump to navigationJump to search
Stonezhong (talk | contribs) No edit summary |
Stonezhong (talk | contribs) |
||
| Line 3: | Line 3: | ||
= Introduction = | = Introduction = | ||
<div class="toccolours mw-collapsible mw-collapsed expandable"> | <div class="toccolours mw-collapsible mw-collapsed expandable"> | ||
<div class="mw-collapsible-preview"></div> | <div class="mw-collapsible-preview">Definition</div> | ||
<div class="mw-collapsible-content"> | <div class="mw-collapsible-content"> | ||
<h2>A DataLocation object captures the location of the data and the format of the data.</h2> | |||
<h2>Fields</h2> | |||
<pre><nowiki> | |||
id: UUID | |||
Primary key | |||
url: str | |||
Specifies the location of the data. | |||
For example: "s3://mubucket/stock_quotes/2023-08-20.jsonl" is a valid url, it represent a data object located in AWS S3, bucket name is mubucket, object key is stock_quotes/2023-08-20.jsonl | |||
format: str | |||
A string represent the format of the data, for example, "JSONL", "CSV", "PARQUET", etc. | |||
</nowiki></pre> | |||
</div> | </div> | ||
</div> | </div> | ||
<p></p> | <p></p> | ||
Revision as of 04:22, 23 August 2023
Data Lake Knowledge Center | Models
