Dl/glossary: Difference between revisions

Revision as of 22:57, 5 March 2023

Dataframe

A basic data unit that carries data. For example:

Dataframe should be immutable once it is published -- the data it carries should never change.

Asset

Represent underneath data a dataframe is loaded from. For example:

Dataset

bbb

@@ Line 14: / Line 14: @@
 <p></p>
-<div class="toccolours mw-collapsible mw-collapsed mono expandable">
+<div class="toccolours mw-collapsible mw-collapsed expandable">
 <div class="mw-collapsible-preview">Asset</div>
 <div class="mw-collapsible-content">
-An assert represent data storage location where you can load data and get dataframe
+Represent underneath data a dataframe is loaded from. For example:
+* A parquet file in AWS S3 bucket
+* A parquet file in HDFS
+* A parquet file in local filesystem
+* A table in DB (RDBMS)
+* A subset of a table in DB (RDBMS) -- via a filter
+* A collection in mongodb
+* A subset of a collection in mongodb -- via a filter
 </div>
 </div>