Data Lake Knowledge Center
Purpose
Data Management
APIs
- CRUD dataset
- Add, remove dataframe from dataset
- Load dataset
Web UI
- Browse dataset
- CRUD dataset
- Search dataset
Use cases:
- User can see datasets, view author, team, description, schema, publish time, etc
- User can search datasets based on author, team, description, schema, publish time, etc.
- User can create new dataset on Web UI
- A data ingestion app can create dataset via API
- A data ingestion app can add dataframe to a dataset via API
